Constructing Scientific Arguments Using Evidence from Dynamic Computational Climate Models

ERIC Educational Resources Information Center

Pallant, Amy; Lee, Hee-Sun

2015-01-01

Modeling and argumentation are two important scientific practices students need to develop throughout school years. In this paper, we investigated how middle and high school students (N = 512) construct a scientific argument based on evidence from computational models with which they simulated climate change. We designed scientific argumentation…

Real-time remote scientific model validation

NASA Technical Reports Server (NTRS)

Frainier, Richard; Groleau, Nicolas

1994-01-01

This paper describes flight results from the use of a CLIPS-based validation facility to compare analyzed data from a space life sciences (SLS) experiment to an investigator's preflight model. The comparison, performed in real-time, either confirms or refutes the model and its predictions. This result then becomes the basis for continuing or modifying the investigator's experiment protocol. Typically, neither the astronaut crew in Spacelab nor the ground-based investigator team are able to react to their experiment data in real time. This facility, part of a larger science advisor system called Principal Investigator in a Box, was flown on the space shuttle in October, 1993. The software system aided the conduct of a human vestibular physiology experiment and was able to outperform humans in the tasks of data integrity assurance, data analysis, and scientific model validation. Of twelve preflight hypotheses associated with investigator's model, seven were confirmed and five were rejected or compromised.

20 CFR 404.727 - Evidence of a deemed valid marriage.

Code of Federal Regulations, 2010 CFR

2010-04-01

... 20 Employees' Benefits 2 2010-04-01 2010-04-01 false Evidence of a deemed valid marriage. 404.727... DISABILITY INSURANCE (1950- ) Evidence Evidence of Age, Marriage, and Death § 404.727 Evidence of a deemed valid marriage. (a) General. A deemed valid marriage is a ceremonial marriage we consider valid even...

Design and validation of general biology learning program based on scientific inquiry skills

NASA Astrophysics Data System (ADS)

Cahyani, R.; Mardiana, D.; Noviantoro, N.

2018-03-01

Scientific inquiry is highly recommended to teach science. The reality in the schools and colleges is that many educators still have not implemented inquiry learning because of their lack of understanding. The study aims to1) analyze students’ difficulties in learning General Biology, 2) design General Biology learning program based on multimedia-assisted scientific inquiry learning, and 3) validate the proposed design. The method used was Research and Development. The subjects of the study were 27 pre-service students of general elementary school/Islamic elementary schools. The workflow of program design includes identifying learning difficulties of General Biology, designing course programs, and designing instruments and assessment rubrics. The program design is made for four lecture sessions. Validation of all learning tools were performed by expert judge. The results showed that: 1) there are some problems identified in General Biology lectures; 2) the designed products include learning programs, multimedia characteristics, worksheet characteristics, and, scientific attitudes; and 3) expert validation shows that all program designs are valid and can be used with minor revisions. The first section in your paper.

Questioning the Evidence for a Claim in a Socio-Scientific Issue: An Aspect of Scientific Literacy

ERIC Educational Resources Information Center

Roberts, Ros; Gott, Richard

2010-01-01

Understanding the science in a "socio-scientific issue" is at the heart of the varied definitions of "scientific literacy". Many consider that understanding evidence is necessary to participate in decision making and to challenge the science that affects people's lives. A model is described that links practical work,…

Homosexuality and scientific evidence: On suspect anecdotes, antiquated data, and broad generalizations.

PubMed

Kinney, Robert L

2015-11-01

The American Psychiatric Association and the American Psychological Association have suggested for many years now that there is significant empirical evidence supporting the claim that homosexuality is a normal variant of human sexual orientation as opposed to a mental disorder. This paper summarizes and analyzes that purported scientific evidence and explains that much (if not all) of the evidence is irrelevant and does not support the homosexuality-is-not-a-mental-disorder claim. As a result of their deficiencies and arbitrariness, the credibility those two groups that are typically deemed authoritative and trustworthy is called into question. Lay summary: At one time, homosexuality was considered to be mentally disordered. Since the 1970s, however, major medical associations in the U.S. have labeled homosexuality as a normal counterpart of heterosexuality. Those medical associations have proposed that their homosexuality-is-normal claim is based on "scientific evidence." This article critically reviews that "scientific evidence" and finds that much of their literature does not support the claim that homosexuality is normal. This article suggests that instead of supporting their claim with scientific evidence, those major medical associations arbitrarily label homosexuality as normal.

Web Based Semi-automatic Scientific Validation of Models of the Corona and Inner Heliosphere

NASA Astrophysics Data System (ADS)

MacNeice, P. J.; Chulaki, A.; Taktakishvili, A.; Kuznetsova, M. M.

2013-12-01

Validation is a critical step in preparing models of the corona and inner heliosphere for future roles supporting either or both the scientific research community and the operational space weather forecasting community. Validation of forecasting quality tends to focus on a short list of key features in the model solutions, with an unchanging order of priority. Scientific validation exposes a much larger range of physical processes and features, and as the models evolve to better represent features of interest, the research community tends to shift its focus to other areas which are less well understood and modeled. Given the more comprehensive and dynamic nature of scientific validation, and the limited resources available to the community to pursue this, it is imperative that the community establish a semi-automated process which engages the model developers directly into an ongoing and evolving validation process. In this presentation we describe the ongoing design and develpment of a web based facility to enable this type of validation of models of the corona and inner heliosphere, on the growing list of model results being generated, and on strategies we have been developing to account for model results that incorporate adaptively refined numerical grids.

I Spy with My Little Eye: Jurors' Detection of Internal Validity Threats in Expert Evidence

PubMed Central

McAuliff, Bradley D.; Duckworth, Tejah D.

2010-01-01

This experiment examined whether jury-eligible community members (N = 223) were able to detect internally invalid psychological science presented at trial. Participants read a simulated child sexual abuse case in which the defense expert described a study he had conducted on witness memory and suggestibility. We varied the study's internal validity (valid, missing control group, confound, and experimenter bias) and publication status (published, unpublished). Expert evidence quality ratings were higher for the valid versus missing control group version only. Publication increased ratings of defendant guilt when the study was missing a control group. Variations in internal validity did not influence perceptions of child victim credibility or police interview quality. Participants' limited detection of internal validity threats underscores the need to examine the effectiveness of traditional legal safeguards against junk science in court and improve the scientific reasoning ability of lay people and legal professionals. PMID:20162342

20 CFR 404.725 - Evidence of a valid ceremonial marriage.

Code of Federal Regulations, 2010 CFR

2010-04-01

... 20 Employees' Benefits 2 2010-04-01 2010-04-01 false Evidence of a valid ceremonial marriage. 404... DISABILITY INSURANCE (1950- ) Evidence Evidence of Age, Marriage, and Death § 404.725 Evidence of a valid ceremonial marriage. (a) General. A valid ceremonial marriage is one that follows procedures set by law in...

Homosexuality and scientific evidence: On suspect anecdotes, antiquated data, and broad generalizations

PubMed Central

Kinney, Robert L.

2015-01-01

The American Psychiatric Association and the American Psychological Association have suggested for many years now that there is significant empirical evidence supporting the claim that homosexuality is a normal variant of human sexual orientation as opposed to a mental disorder. This paper summarizes and analyzes that purported scientific evidence and explains that much (if not all) of the evidence is irrelevant and does not support the homosexuality-is-not-a-mental-disorder claim. As a result of their deficiencies and arbitrariness, the credibility those two groups that are typically deemed authoritative and trustworthy is called into question. Lay summary: At one time, homosexuality was considered to be mentally disordered. Since the 1970s, however, major medical associations in the U.S. have labeled homosexuality as a normal counterpart of heterosexuality. Those medical associations have proposed that their homosexuality-is-normal claim is based on “scientific evidence.” This article critically reviews that “scientific evidence” and finds that much of their literature does not support the claim that homosexuality is normal. This article suggests that instead of supporting their claim with scientific evidence, those major medical associations arbitrarily label homosexuality as normal. PMID:26997677

Criminal profiling as expert witness evidence: The implications of the profiler validity research.

PubMed

Kocsis, Richard N; Palermo, George B

The use and development of the investigative tool colloquially known as criminal profiling has steadily increased over the past five decades throughout the world. Coupled with this growth has been a diversification in the suggested range of applications for this technique. Possibly the most notable of these has been the attempted transition of the technique from a tool intended to assist police investigations into a form of expert witness evidence admissible in legal proceedings. Whilst case law in various jurisdictions has considered with mutual disinclination the evidentiary admissibility of criminal profiling, a disjunction has evolved between these judicial examinations and the scientifically vetted research testing the accuracy (i.e., validity) of the technique. This article offers an analysis of the research directly testing the validity of the criminal profiling technique and the extant legal principles considering its evidentiary admissibility. This analysis reveals that research findings concerning the validity of criminal profiling are surprisingly compatible with the extant legal principles. The overall conclusion is that a discrete form of crime behavioural analysis is supported by the profiler validity research and could be regarded as potentially admissible expert witness evidence. Finally, a number of theoretical connections are also identified concerning the skills and qualifications of individuals who may feasibly provide such expert testimony. Copyright © 2016 Elsevier Ltd. All rights reserved.

Consensus statements from the Workshop "Probiotics and Health: Scientific evidence".

PubMed

Guarner, F; Requena, T; Marcos, A

2010-01-01

This report shows the level of scientific consensus on definition, characteristics and health benefits of probiotics. The content of the report has derived from the scientific meeting: Workshop on Probiotics and Health. Scientific evidence, that congregated several Spanish experts, including gastroenterologists, microbiologists, nutritionists, immunologists and food technologists, among others, who have agreed with the statements shown in this document. Each statement has been sustained with the most relevant scientific aspects that were discussed during the Workshop and the following evaluation of the report by all experts who approved and signed it.

78 FR 6056 - Smokeless Tobacco Product Warning Statements; Request for Comments and Scientific Evidence

Federal Register 2010, 2011, 2012, 2013, 2014

2013-01-29

... by scientific evidence, regarding what changes to the smokeless tobacco product warnings, if any... scientific evidence, regarding what changes, if any, to the smokeless tobacco product warnings would promote... supporting evidence should address how any changes in the warnings would affect both users' and nonusers...

Applying hospital evidence to paramedicine: issues of indirectness, validity and knowledge translation.

PubMed

Bigham, Blair; Welsford, Michelle

2015-05-01

The practice of emergency medicine (EM) has been intertwined with emergency medical services (EMS) for more than 40 years. In this commentary, we explore the practice of translating hospital based evidence into the prehospital setting. We will challenge both EMS and EM dogma-bringing hospital care to patients in the field is not always better. In providing examples of therapies championed in hospitals that have failed to translate into the field, we will discuss the unique prehospital environment, and why evidence from the hospital setting cannot necessarily be translated to the prehospital field. Paramedicine is maturing so that the capability now exists to conduct practice-specific research that can inform best practices. Before translation from the hospital environment is implemented, evidence must be evaluated by people with expertise in three domains: critical appraisal, EM, and EMS. Scientific evidence should be assessed for: quality and bias; directness, generalizability, and validity to the EMS population; effect size and anticipated benefit from prehospital application; feasibility (including economic evaluation, human resource availability in the mobile environment); and patient and provider safety.

The effect of scientific evidence on conservation practitioners' management decisions.

PubMed

Walsh, Jessica C; Dicks, Lynn V; Sutherland, William J

2015-02-01

A major justification of environmental management research is that it helps practitioners, yet previous studies show it is rarely used to inform their decisions. We tested whether conservation practitioners focusing on bird management were willing to use a synopsis of relevant scientific literature to inform their management decisions. This allowed us to examine whether the limited use of scientific information in management is due to a lack of access to the scientific literature or whether it is because practitioners are either not interested or unable to incorporate the research into their decisions. In on-line surveys, we asked 92 conservation managers, predominantly from Australia, New Zealand, and the United Kingdom, to provide opinions on 28 management techniques that could be applied to reduce predation on birds. We asked their opinions before and after giving them a summary of the literature about the interventions' effectiveness. We scored the overall effectiveness and certainty of evidence for each intervention through an expert elicitation process-the Delphi method. We used the effectiveness scores to assess the practitioners' level of understanding and awareness of the literature. On average, each survey participant changed their likelihood of using 45.7% of the interventions after reading the synopsis of the evidence. They were more likely to implement effective interventions and avoid ineffective actions, suggesting that their intended future management strategies may be more successful than current practice. More experienced practitioners were less likely to change their management practices than those with less experience, even though they were not more aware of the existing scientific information than less experienced practitioners. The practitioners' willingness to change their management choices when provided with summarized scientific evidence suggests that improved accessibility to scientific information would benefit conservation management

Examining the impact of sexism on evaluations of social scientific evidence in discrimination litigation.

PubMed

Kim, Anita; Tidwell, Natasha

2014-12-01

The present 2 studies involved undergraduate participants and investigated whether various types of sexism and other correlated predictors, such as political conservatism and scientific discounting, can predict people's evaluations of social science research on sex stereotypes, sexism, and sex discrimination. In Study 1, participants high in hostile sexism, scientific discounting, and/or political conservatism were more critical of scientific studies that provided evidence for sexism than identical studies showing null results. Study 2 showed that participants high in modern sexism, hostile sexism, and political conservatism evaluated social scientific studies more negatively; in addition, assessments of social scientific evidence quality mediated the effect of modern sexism on admissibility ratings (b = -0.15, z = -4.16, p = .00). Overall, these results suggest that sexist beliefs can bias one's judgments of social scientific evidence. Future research should explore whether the same psychological processes operate for judges and jurors as they evaluate the admissibility of evidence and examine ways to attenuate the effect of sexism on evaluations. PsycINFO Database Record (c) 2014 APA, all rights reserved.

Standards of practice, professional judgment, and scientific evidence to establish and extend a beyond-use date.

PubMed

Thomson, Cassandra Marie; Savji, Taslim

2014-01-01

The establishment of both a beyond-use date and the extension of a beyond-use date need to be scientifically based. What is accepted as scientific evidence is at times misleading. The pharmacist may have the right to utilize some degree of professional judgment in both establishing and extending a beyond-use date, after a review of appropriate scientific literature. Notwithstanding this scientific review, it is the concept of professional judgment that seemingly needs to be better defined. A new-found appreciation for professional judgment will bring us to the understanding that a validated stability-indicating assay is the correct manner in which to extend a beyond-use date. This article addresses and discusses the recommendations and rigor required to establish and extend a beyond-use date. The perspectives of the pharmacist and physician are explored, as well as the impact of an extended beyond-use date, or lack thereof, are discussed. The application of a set of fundamental principles will be revealed, which will lead to finite conclusions as to the necessary methodology to establish as well as extend a beyond-use date.

Frames of scientific evidence: How journalists represent the (un)certainty of molecular medicine in science television programs.

PubMed

Ruhrmann, Georg; Guenther, Lars; Kessler, Sabrina Heike; Milde, Jutta

2015-08-01

For laypeople, media coverage of science on television is a gateway to scientific issues. Defining scientific evidence is central to the field of science, but there are still questions if news coverage of science represents scientific research findings as certain or uncertain. The framing approach is a suitable framework to classify different media representations; it is applied here to investigate the frames of scientific evidence in film clips (n=207) taken from science television programs. Molecular medicine is the domain of interest for this analysis, due to its high proportion of uncertain and conflicting research findings and risks. The results indicate that television clips vary in their coverage of scientific evidence of molecular medicine. Four frames were found: Scientific Uncertainty and Controversy, Scientifically Certain Data, Everyday Medical Risks, and Conflicting Scientific Evidence. They differ in their way of framing scientific evidence and risks of molecular medicine. © The Author(s) 2013.

Evidence of Construct Validity in Published Achievement Tests.

ERIC Educational Resources Information Center

Nolet, Victor; Tindal, Gerald

Valid interpretation of test scores is the shared responsibility of the test designer and the test user. Test publishers must provide evidence of the validity of the decisions their tests are intended to support, while test users are responsible for analyzing this evidence and subsequently using the test in the manner indicated by the publisher.…

The Evidence-Based Reasoning Framework: Assessing Scientific Reasoning

ERIC Educational Resources Information Center

Brown, Nathaniel J. S.; Furtak, Erin Marie; Timms, Michael; Nagashima, Sam O.; Wilson, Mark

2010-01-01

Recent science education reforms have emphasized the importance of students engaging with and reasoning from evidence to develop scientific explanations. A number of studies have created frameworks based on Toulmin's (1958/2003) argument pattern, whereas others have developed systems for assessing the quality of students' reasoning to support…

What Constitutes Science and Scientific Evidence: Roles of Null Hypothesis Testing

ERIC Educational Resources Information Center

Chang, Mark

2017-01-01

We briefly discuss the philosophical basis of science, causality, and scientific evidence, by introducing the hidden but most fundamental principle of science: the similarity principle. The principle's use in scientific discovery is illustrated with Simpson's paradox and other examples. In discussing the value of null hypothesis statistical…

Complementary medicine for axial spondyloarthritis: is there any scientific evidence?

PubMed

Danve, Abhijeet; Deodhar, Atul A

2018-07-01

Majority of patients with axial spondyloarthritis (axSpA) report use of complementary and alternative medicine (CAM) therapies before and even after the diagnosis, due to perceived efficacy and wide-spread belief that these modalities lack side effects. In this review, we describe the available scientific evidence for the CAM therapies in axSpA. Clinical trials of the CAM therapies in axSpA are generally hampered by small sample size, short duration, difficulties in blinding, lack of control groups and strong placebo effect. Nonetheless, exercise programs like Pilates and mind-body techniques such as Tai Chi may have favorable effect on the disease activity and function. Although not yet confirmed, the modulation of the microbiome with the help of probiotics or fecal transplant has face validity given the evolving scientific rationale. Diet has only limited role in the management of axSpA. Deep tissue massage, omega-3 fatty acids and Stanger bath were found to be useful in small studies. CAM therapies are not always entirely well tolerated, particularly the manipulative techniques like chiropractic and Tui-na in patients with advanced disease and osteoporosis. There are no trials of yoga in axSpA despite the wider acceptance and use of yoga as an effective mind-body technique. Larger and better quality clinical trials of CAM therapies are needed to confirm their efficacy and safety in the management of axSpA and to include them in the 'mainstream' medicine.

Alcohol-induced blackout as a criminal defense or mitigating factor: an evidence-based review and admissibility as scientific evidence.

PubMed

Pressman, Mark R; Caudill, David S

2013-07-01

Alcohol-related amnesia--alcohol blackout--is a common claim of criminal defendants. The generally held belief is that during an alcohol blackout, other cognitive functioning is severely impaired or absent. The presentation of alcohol blackout as scientific evidence in court requires that the science meets legal reliability standards (Frye, FRE702/Daubert). To determine whether "alcohol blackout" meets these standards, an evidence-based analysis of published scientific studies was conducted. A total of 26 empirical studies were identified including nine in which an alcohol blackout was induced and directly observed. No objective or scientific method to verify the presence of an alcoholic blackout while it is occurring or to confirm its presence retrospectively was identified. Only short-term memory is impaired and other cognitive functions--planning, attention, and social skills--are not impaired. Alcoholic blackouts would not appear to meet standards for scientific evidence and should not be admissible. © 2013 American Academy of Forensic Sciences.

Subtle Scientific Fallacies Undermine the Validity of Neuroendocrinological Research: Do Not Draw Premature Conclusions on the Role of Female Sex Hormones.

PubMed

Hengartner, Michael P

2017-01-01

Major scientific flaws such as reporting and publication biases are well documented, even though acknowledgment of their importance appears to be lacking in various psychological and medical fields. Subtle and less obvious biases including selective reviews of the literature and empirically unsupported conclusions and recommendations have received even less attention. Using the literature on the association between transition to menopause, hormones and the onset of depression as a guiding example, I outline how such scientific fallacies undermine the validity of neuroendocrinological research. It is shown that in contrast to prominent claims, first, most prospective studies do not support the notion that the menopausal transition relates to increased risk for depression, second, that associations between hormone levels and depression are largely inconsistent and irreproducible, and, third, that the evidence for the efficacy of hormone therapy for the treatment of depression is very weak and at best inconclusive. I conclude that a direct and uniform association between female sex hormones and depression is clearly not supported by the literature and that more attention should be paid to the manifold scientific biases that undermine the validity of findings in psychological and medical research, with a specific focus on the behavioral neurosciences.

Contested evidence: Exposure to competing scientific claims and public support for banning bisphenol A.

PubMed

Brewer, Paul R; Ley, Barbara L

2014-05-01

The public controversy surrounding bisphenol A (BPA) revolves around competing claims about what scientific evidence shows regarding the effects of the chemical on human health. This study uses an experiment embedded within a public opinion survey to test the effects of exposure to such claims on public support for banning the use of BPA in products. Exposure to the claim that "there is not enough scientific evidence that BPA harms human health" reduced support, whereas exposure to the claim that there "is enough scientific evidence" failed to increase support. No effect emerged among those simultaneously exposed to both claims. The "not enough evidence" claim influenced less educated respondents and women but not college-educated respondents or men. Aspects of the underlying structure of opinion also differed depending on which claim(s) respondents received. The results illuminate how members of the public respond to competing scientific claims regarding controversial issues.

Assessment of Scientific Literacy: Development and Validation of the Quantitative Assessment of Socio-Scientific Reasoning (QuASSR)

ERIC Educational Resources Information Center

Romine, William L.; Sadler, Troy D.; Kinslow, Andrew T.

2017-01-01

We describe the development and validation of the Quantitative Assessment of Socio-scientific Reasoning (QuASSR) in a college context. The QuASSR contains 10 polytomous, two-tiered items crossed between two scenarios, and is based on theory suggesting a four-pronged structure for SSR (complexity, perspective taking, inquiry, and skepticism). In…

[Scientific evidence on the legalization of abortion in Mexico City].

PubMed

Gayón-Vera, Eduardo

2010-03-01

On April 24 2007, abortion before 12 weeks became legal in Mexico City. The arguments for this decision were: diminish the maternal morbidity and mortality, avoid a "severe health problem" and accomplish the women's physical, mental and social well being. To analyze the scientific evidences that support or reject this arguments. Retrospective study realized by bibliographic search of electronic data basis and Internet portals of interested groups. Mexico is considered by the World Health Organization, one of the countries in the world with low maternal mortality rates (<100/100,000 live births). The main causes are: preeclampsia-eclampsia, pregnancy related hemorrhage, complications of pregnancy, delivery and puerperium, and other causes (92.2 to 93.1%). In 2007, the Health Services of Mexico City reported 11 deaths (0.03% of the total maternal deaths) associated with "non-spontaneous abortion". In the hospitals of the Mexican Institute of Social Security, maternal deaths as consequence of induced abortions were, approximately, three every year. The evidences used as arguments in favor of abortion come from studies performed in Sub-Saharan African countries, which do not apply to Mexico. The scientific evidences show that induced abortion has important psychological sequels in women, a higher frequency of illegal drug abuse, alcoholism, child abuse, low birth weight in the following pregnancy, greater risk of subsequent miscarriage and greater mortality rate. There are no scientific evidences to support the arguments used for the legal approval of abortion in Mexico City.

Developing instruments concerning scientific epistemic beliefs and goal orientations in learning science: a validation study

NASA Astrophysics Data System (ADS)

Lin, Tzung-Jin; Tsai, Chin-Chung

2017-11-01

The purpose of this study was to develop and validate two survey instruments to evaluate high school students' scientific epistemic beliefs and goal orientations in learning science. The initial relationships between the sampled students' scientific epistemic beliefs and goal orientations in learning science were also investigated. A final valid sample of 600 volunteer Taiwanese high school students participated in this survey by responding to the Scientific Epistemic Beliefs Instrument (SEBI) and the Goal Orientations in Learning Science Instrument (GOLSI). Through both exploratory and confirmatory factor analyses, the SEBI and GOLSI were proven to be valid and reliable for assessing the participants' scientific epistemic beliefs and goal orientations in learning science. The path analysis results indicated that, by and large, the students with more sophisticated epistemic beliefs in various dimensions such as Development of Knowledge, Justification for Knowing, and Purpose of Knowing tended to adopt both Mastery-approach and Mastery-avoidance goals. Some interesting results were also found. For example, the students tended to set a learning goal to outperform others or merely demonstrate competence (Performance-approach) if they had more informed epistemic beliefs in the dimensions of Multiplicity of Knowledge, Uncertainty of Knowledge, and Purpose of Knowing.

Memory for Scientific Arguments and Their Sources: Claim-Evidence Consistency Matters

ERIC Educational Resources Information Center

Steffens, Brent; Britt, M. Anne; Braasch, Jason L.; Strømsø, Helge; Bråten, Ivar

2014-01-01

We investigated whether memory for scientific arguments and their sources were affected by the appropriateness of the claim-evidence relationship. Undergraduates read health articles in one of four conditions derived by crossing claim type (causal with definite qualifier, associative with tentative qualifier) and evidence type (experimental,…

An evidence-based patient-centered method makes the biopsychosocial model scientific.

PubMed

Smith, Robert C; Fortin, Auguste H; Dwamena, Francesca; Frankel, Richard M

2013-06-01

To review the scientific status of the biopsychosocial (BPS) model and to propose a way to improve it. Engel's BPS model added patients' psychological and social health concerns to the highly successful biomedical model. He proposed that the BPS model could make medicine more scientific, but its use in education, clinical care, and, especially, research remains minimal. Many aver correctly that the present model cannot be defined in a consistent way for the individual patient, making it untestable and non-scientific. This stems from not obtaining relevant BPS data systematically, where one interviewer obtains the same information another would. Recent research by two of the authors has produced similar patient-centered interviewing methods that are repeatable and elicit just the relevant patient information needed to define the model at each visit. We propose that the field adopt these evidence-based methods as the standard for identifying the BPS model. Identifying a scientific BPS model in each patient with an agreed-upon, evidence-based patient-centered interviewing method can produce a quantum leap ahead in both research and teaching. A scientific BPS model can give us more confidence in being humanistic. In research, we can conduct more rigorous studies to inform better practices. Copyright © 2013 Elsevier Ireland Ltd. All rights reserved.

Implementing scientific evidence to improve the quality of Child Protection

PubMed Central

Cowley, Laura; Tempest, Vanessa; Maguire, Sabine; Mann, Mala; Naughton, Aideen; Wain, Laura; Kemp, Alison

2013-01-01

In contrast to other areas of medical practice, there was a lack of a clear, concise and accessible synthesis of scientific literature to aid the recognition and investigation of suspected child abuse, and no national training program or evidence based guidelines for clinicians. The project's aim was to identify the current scientific evidence for the recognition and investigation of suspected child abuse and neglect and to disseminate and introduce this into clinical practice. Since 2003 a comprehensive program of Systematic Reviews of all aspects of physical abuse, emotional abuse, and neglect of children, has been developed. Based on NHS Centre for Reviews and Dissemination standards, methodology was devised and reviewers trained. Dissemination was via peer reviewed publications, a series of leaflets highlighting key points in a Question and Answer format, and a website. To date, 21 systematic reviews have been completed, generating 28 peer reviewed publications, and six leaflets around each theme (eg fractures, bruising). More than 250,000 have been distributed to date. Our website generates more than 10,000 hits monthly. It hosts primary reviews that are updated annually, links to all included studies, publications, and detailed methodology. The reviews have directly informed five national clinical guidelines, and the first evidence based training in Child Maltreatment. Child abuse is every health practitioner's responsibility, and it is vital that the decisions made are evidence based, as it is expected in all other fields of medicine. Although challenging, this project demonstrates that it is possible to conduct high quality systematic reviews in this field. For the first time a clear concise synthesis of up to date scientific evidence is available to all practitioners in a range of accessible formats. This has underpinned high quality national guidance and training programs. It ensures all professionals have the appropriate knowledge base in this difficult

Is there any evidence for the validity of diagnostic criteria used for accommodative and nonstrabismic binocular dysfunctions?

PubMed Central

Cacho-Martínez, Pilar; García-Muñoz, Ángel; Ruiz-Cantero, María Teresa

2013-01-01

Purpose To analyze the diagnostic criteria used in the scientific literature published in the past 25 years for accommodative and nonstrabismic binocular dysfunctions and to explore if the epidemiological analysis of diagnostic validity has been used to propose which clinical criteria should be used for diagnostic purposes. Methods We carried out a systematic review of papers on accommodative and non-strabic binocular disorders published from 1986 to 2012 analysing the MEDLINE, CINAHL, PsycINFO and FRANCIS databases. We admitted original articles about diagnosis of these anomalies in any population. We identified 839 articles and 12 studies were included. The quality of included articles was assessed using the QUADAS-2 tool. Results The review shows a wide range of clinical signs and cut-off points between authors. Only 3 studies (regarding accommodative anomalies) assessed diagnostic accuracy of clinical signs. Their results suggest using the accommodative amplitude and monocular accommodative facility for diagnosing accommodative insufficiency and a high positive relative accommodation for accommodative excess. The remaining 9 articles did not analyze diagnostic accuracy, assessing a diagnosis with the criteria the authors considered. We also found differences between studies in the way of considering patients’ symptomatology. 3 studies of 12 analyzed, performed a validation of a symptom survey used for convergence insufficiency. Conclusions Scientific literature reveals differences between authors according to diagnostic criteria for accommodative and nonstrabismic binocular dysfunctions. Diagnostic accuracy studies show that there is only certain evidence for accommodative conditions. For binocular anomalies there is only evidence about a validated questionnaire for convergence insufficiency with no data of diagnostic accuracy. PMID:24646897

Gathering Validity Evidence for Surgical Simulation: A Systematic Review.

PubMed

Borgersen, Nanna Jo; Naur, Therese M H; Sørensen, Stine M D; Bjerrum, Flemming; Konge, Lars; Subhi, Yousif; Thomsen, Ann Sofia S

2018-06-01

To identify current trends in the use of validity frameworks in surgical simulation, to provide an overview of the evidence behind the assessment of technical skills in all surgical specialties, and to present recommendations and guidelines for future validity studies. Validity evidence for assessment tools used in the evaluation of surgical performance is of paramount importance to ensure valid and reliable assessment of skills. We systematically reviewed the literature by searching 5 databases (PubMed, EMBASE, Web of Science, PsycINFO, and the Cochrane Library) for studies published from January 1, 2008, to July 10, 2017. We included original studies evaluating simulation-based assessments of health professionals in surgical specialties and extracted data on surgical specialty, simulator modality, participant characteristics, and the validity framework used. Data were synthesized qualitatively. We identified 498 studies with a total of 18,312 participants. Publications involving validity assessments in surgical simulation more than doubled from 2008 to 2010 (∼30 studies/year) to 2014 to 2016 (∼70 to 90 studies/year). Only 6.6% of the studies used the recommended contemporary validity framework (Messick). The majority of studies used outdated frameworks such as face validity. Significant differences were identified across surgical specialties. The evaluated assessment tools were mostly inanimate or virtual reality simulation models. An increasing number of studies have gathered validity evidence for simulation-based assessments in surgical specialties, but the use of outdated frameworks remains common. To address the current practice, this paper presents guidelines on how to use the contemporary validity framework when designing validity studies.

Reading for tracing evidence: developing scientific knowledge through science text

NASA Astrophysics Data System (ADS)

Probosari, R. M.; Widyastuti, F.; Sajidan, S.; Suranto, S.; Prayitno, B. A.

2018-05-01

The purposes of this study were to investigate students’ learning progression on reading activity, science concept comprehension and how they imply it in scientific communication in the classroom. Fifty-nine biology education students participated in this study. This classroom research was developed to portray students’ reading activity, factors affecting reading comprehension, and the development of reading motivation. Qualitative analysis was used to describe the whole activities, involve the instruction, process and the product of reading activity. The result concluded that each student has their own way in interpreting the information from scientific text, but generally, they can filter and apply it in their argument as a part of reasoning and evidence. The findings can be used to direct reading activity to the goal of inquiry in order to support the nature of reading as evidence.

Developing Instruments Concerning Scientific Epistemic Beliefs and Goal Orientations in Learning Science: A Validation Study

ERIC Educational Resources Information Center

Lin, Tzung-Jin; Tsai, Chin-Chung

2017-01-01

The purpose of this study was to develop and validate two survey instruments to evaluate high school students' scientific epistemic beliefs and goal orientations in learning science. The initial relationships between the sampled students' scientific epistemic beliefs and goal orientations in learning science were also investigated. A final valid…

Is there any evidence for the validity of diagnostic criteria used for accommodative and nonstrabismic binocular dysfunctions?

PubMed

Cacho-Martínez, Pilar; García-Muñoz, Ángel; Ruiz-Cantero, María Teresa

2014-01-01

To analyze the diagnostic criteria used in the scientific literature published in the past 25 years for accommodative and nonstrabismic binocular dysfunctions and to explore if the epidemiological analysis of diagnostic validity has been used to propose which clinical criteria should be used for diagnostic purposes. We carried out a systematic review of papers on accommodative and non-strabic binocular disorders published from 1986 to 2012 analysing the MEDLINE, CINAHL, PsycINFO and FRANCIS databases. We admitted original articles about diagnosis of these anomalies in any population. We identified 839 articles and 12 studies were included. The quality of included articles was assessed using the QUADAS-2 tool. The review shows a wide range of clinical signs and cut-off points between authors. Only 3 studies (regarding accommodative anomalies) assessed diagnostic accuracy of clinical signs. Their results suggest using the accommodative amplitude and monocular accommodative facility for diagnosing accommodative insufficiency and a high positive relative accommodation for accommodative excess. The remaining 9 articles did not analyze diagnostic accuracy, assessing a diagnosis with the criteria the authors considered. We also found differences between studies in the way of considering patients' symptomatology. 3 studies of 12 analyzed, performed a validation of a symptom survey used for convergence insufficiency. Scientific literature reveals differences between authors according to diagnostic criteria for accommodative and nonstrabismic binocular dysfunctions. Diagnostic accuracy studies show that there is only certain evidence for accommodative conditions. For binocular anomalies there is only evidence about a validated questionnaire for convergence insufficiency with no data of diagnostic accuracy. Copyright © 2012 Spanish General Council of Optometry. Published by Elsevier Espana. All rights reserved.

SEE: structured representation of scientific evidence in the biomedical domain using Semantic Web techniques

PubMed Central

2014-01-01

Background Accounts of evidence are vital to evaluate and reproduce scientific findings and integrate data on an informed basis. Currently, such accounts are often inadequate, unstandardized and inaccessible for computational knowledge engineering even though computational technologies, among them those of the semantic web, are ever more employed to represent, disseminate and integrate biomedical data and knowledge. Results We present SEE (Semantic EvidencE), an RDF/OWL based approach for detailed representation of evidence in terms of the argumentative structure of the supporting background for claims even in complex settings. We derive design principles and identify minimal components for the representation of evidence. We specify the Reasoning and Discourse Ontology (RDO), an OWL representation of the model of scientific claims, their subjects, their provenance and their argumentative relations underlying the SEE approach. We demonstrate the application of SEE and illustrate its design patterns in a case study by providing an expressive account of the evidence for certain claims regarding the isolation of the enzyme glutamine synthetase. Conclusions SEE is suited to provide coherent and computationally accessible representations of evidence-related information such as the materials, methods, assumptions, reasoning and information sources used to establish a scientific finding by adopting a consistently claim-based perspective on scientific results and their evidence. SEE allows for extensible evidence representations, in which the level of detail can be adjusted and which can be extended as needed. It supports representation of arbitrary many consecutive layers of interpretation and attribution and different evaluations of the same data. SEE and its underlying model could be a valuable component in a variety of use cases that require careful representation or examination of evidence for data presented on the semantic web or in other formats. PMID:25093070

SEE: structured representation of scientific evidence in the biomedical domain using Semantic Web techniques.

PubMed

Bölling, Christian; Weidlich, Michael; Holzhütter, Hermann-Georg

2014-01-01

Accounts of evidence are vital to evaluate and reproduce scientific findings and integrate data on an informed basis. Currently, such accounts are often inadequate, unstandardized and inaccessible for computational knowledge engineering even though computational technologies, among them those of the semantic web, are ever more employed to represent, disseminate and integrate biomedical data and knowledge. We present SEE (Semantic EvidencE), an RDF/OWL based approach for detailed representation of evidence in terms of the argumentative structure of the supporting background for claims even in complex settings. We derive design principles and identify minimal components for the representation of evidence. We specify the Reasoning and Discourse Ontology (RDO), an OWL representation of the model of scientific claims, their subjects, their provenance and their argumentative relations underlying the SEE approach. We demonstrate the application of SEE and illustrate its design patterns in a case study by providing an expressive account of the evidence for certain claims regarding the isolation of the enzyme glutamine synthetase. SEE is suited to provide coherent and computationally accessible representations of evidence-related information such as the materials, methods, assumptions, reasoning and information sources used to establish a scientific finding by adopting a consistently claim-based perspective on scientific results and their evidence. SEE allows for extensible evidence representations, in which the level of detail can be adjusted and which can be extended as needed. It supports representation of arbitrary many consecutive layers of interpretation and attribution and different evaluations of the same data. SEE and its underlying model could be a valuable component in a variety of use cases that require careful representation or examination of evidence for data presented on the semantic web or in other formats.

Development and Validation of a Multimedia-Based Assessment of Scientific Inquiry Abilities

ERIC Educational Resources Information Center

Kuo, Che-Yu; Wu, Hsin-Kai; Jen, Tsung-Hau; Hsu, Ying-Shao

2015-01-01

The potential of computer-based assessments for capturing complex learning outcomes has been discussed; however, relatively little is understood about how to leverage such potential for summative and accountability purposes. The aim of this study is to develop and validate a multimedia-based assessment of scientific inquiry abilities (MASIA) to…

Consumer perception versus scientific evidence about health benefits and safety risks from fish consumption.

PubMed

Verbeke, Wim; Sioen, Isabelle; Pieniak, Zuzanna; Van Camp, John; De Henauw, Stefaan

2005-06-01

To investigate the gap between consumer perception and scientific evidence related to health benefits and safety risks from fish consumption. Consumer perceptions from a cross-sectional survey in March 2003 in Belgium were compared with scientific evidence based on a literature review. A quota sampling procedure was used with age as quota control variable. Subjects completed a self-administered questionnaire including health benefit beliefs from fish, fish content and effect beliefs for nutrients and harmful substances. Adults (n=429), who were the main person responsible for food purchasing in the household (284 women; 145 men), aged 18-83 years, from different regional, education, family size and income groups. Fish is predominantly perceived as a healthy food that reduces risk for coronary heart disease, which corroborates scientific evidence. This perception is stronger among women than among men. In contrast with scientific evidence, 46% of the consumers believe that fish contains dietary fibre, whereas less than one-third is aware that fish contains omega-3 fatty acids and that this nutrient has a positive impact on human health. The gap between perception and evidence is larger among consumers with lower education. In general, consumers are better aware of the content and effect of harmful substances than of nutrients in fish. Despite conclusive evidence about the content and positive effect of omega-3 fatty acids in fish, related consumer awareness and beliefs are poor and often wrong. This study exemplifies the need for nutrition education and more effective communication about the health benefits of fish consumption.

Research in Special Education: Scientific Methods and Evidence-Based Practices

ERIC Educational Resources Information Center

Odom, Samuel L.; Brantlinger, Ellen; Gersten, Russell; Horner, Robert H.; Thompson, Bruce; Harris, Karen R.

2005-01-01

This article sets the context for the development of research quality indicators and guidelines for evidence of effective practices provided by different methodologies. The current conceptualization of scientific research in education and the complexity of conducting research in special education settings underlie the development of quality…

Empirical Evidence or Intuition? An Activity Involving the Scientific Method

ERIC Educational Resources Information Center

Overway, Ken

2007-01-01

Students need to have basic understanding of scientific method during their introductory science classes and for this purpose an activity was devised which involved a game based on famous Monty Hall game problem. This particular activity allowed students to banish or confirm their intuition based on empirical evidence.

Belief beyond the evidence: using the proposed effect of breakfast on obesity to show 2 practices that distort scientific evidence1234

PubMed Central

Brown, Andrew W; Bohan Brown, Michelle M

2013-01-01

Background: Various intentional and unintentional factors influence beliefs beyond what scientific evidence justifies. Two such factors are research lacking probative value (RLPV) and biased research reporting (BRR). Objective: We investigated the prevalence of RLPV and BRR in research about the proposition that skipping breakfast causes weight gain, which is called the proposed effect of breakfast on obesity (PEBO) in this article. Design: Studies related to the PEBO were synthesized by using a cumulative meta-analysis. Abstracts from these studies were also rated for the improper use of causal language and biased interpretations. In separate analyses, articles that cited an observational study about the PEBO were rated for the inappropriate use of causal language, and articles that cited a randomized controlled trial (RCT) about the PEBO were rated for misleadingly citing the RCT. Results: The current body of scientific knowledge indicates that the PEBO is only presumed true. The observational literature on the PEBO has gratuitously established the association, but not the causal relation, between skipping breakfast and obesity (final cumulative meta-analysis P value <10−42), which is evidence of RLPV. Four examples of BRR are evident in the PEBO literature as follows: 1) biased interpretation of one's own results, 2) improper use of causal language in describing one's own results, 3) misleadingly citing others’ results, and 4) improper use of causal language in citing others’ work. Conclusions: The belief in the PEBO exceeds the strength of scientific evidence. The scientific record is distorted by RLPV and BRR. RLPV is a suboptimal use of collective scientific resources. PMID:24004890

Is Parental Alienation Disorder a Valid Concept? Not According to Scientific Evidence. A Review of "Parental Alienation, DSM-5 and ICD-11" by William Bernet

ERIC Educational Resources Information Center

Pepiton, M. Brianna; Alvis, Lindsey J.; Allen, Kenneth; Logid, Gregory

2012-01-01

This article reviews a recent book arguing how a concept known as parental alienation syndrome--now parental alienation disorder--should be included in official psychiatric/psychological and medical classification diagnostic manuals. Anecdotal cases and opinion are presented as research and scientific evidence, and stories are presented as…

Public perception and communication of scientific uncertainty.

PubMed

Broomell, Stephen B; Kane, Patrick Bodilly

2017-02-01

Understanding how the public perceives uncertainty in scientific research is fundamental for effective communication about research and its inevitable uncertainty. Previous work found that scientific evidence differentially influenced beliefs from individuals with different political ideologies. Evidence that threatens an individual's political ideology is perceived as more uncertain than nonthreatening evidence. The authors present 3 studies examining perceptions of scientific uncertainty more broadly by including sciences that are not politically polarizing. Study 1 develops scales measuring perceptions of scientific uncertainty. It finds (a) 3 perceptual dimensions of scientific uncertainty, with the primary dimension representing a perception of precision; (b) the precision dimension of uncertainty is strongly associated with the perceived value of a research field; and (c) differences in perceived uncertainty across political affiliations. Study 2 manipulated these dimensions, finding that Republicans were more sensitive than Democrats to descriptions of uncertainty associated with a research field (e.g., psychology). Study 3 found that these views of a research field did not extend to the evaluation of individual results produced by the field. Together, these studies show that perceptions of scientific uncertainty associated with entire research fields are valid predictors of abstract perceptions of scientific quality, benefit, and allocation of funding. Yet, they do not inform judgments about individual results. Therefore, polarization in the acceptance of specific results is not likely due to individual differences in perceived scientific uncertainty. Further, the direction of influence potentially could be reversed, such that perceived quality of scientific results could be used to influence perceptions about scientific research fields. (PsycINFO Database Record (c) 2017 APA, all rights reserved).

Literature evidence in open targets - a target validation platform.

PubMed

Kafkas, Şenay; Dunham, Ian; McEntyre, Johanna

2017-06-06

We present the Europe PMC literature component of Open Targets - a target validation platform that integrates various evidence to aid drug target identification and validation. The component identifies target-disease associations in documents and ranks the documents based on their confidence from the Europe PMC literature database, by using rules utilising expert-provided heuristic information. The confidence score of a given document represents how valuable the document is in the scope of target validation for a given target-disease association by taking into account the credibility of the association based on the properties of the text. The component serves the platform regularly with the up-to-date data since December, 2015. Currently, there are a total number of 1168365 distinct target-disease associations text mined from >26 million PubMed abstracts and >1.2 million Open Access full text articles. Our comparative analyses on the current available evidence data in the platform revealed that 850179 of these associations are exclusively identified by literature mining. This component helps the platform's users by providing the most relevant literature hits for a given target and disease. The text mining evidence along with the other types of evidence can be explored visually through https://www.targetvalidation.org and all the evidence data is available for download in json format from https://www.targetvalidation.org/downloads/data .

Investigating Socioscientific Issues via Scientific Habits of Mind: Development and validation of the Scientific Habits of Mind Survey

NASA Astrophysics Data System (ADS)

Çalik, Muammer; Coll, Richard Kevin

2012-08-01

In this paper, we describe the Scientific Habits of Mind Survey (SHOMS) developed to explore public, science teachers', and scientists' understanding of habits of mind (HoM). The instrument contained 59 items, and captures the seven SHOM identified by Gauld. The SHOM was validated by administration to two cohorts of pre-service science teachers: primary science teachers with little science background or interest (n = 145), and secondary school science teachers (who also were science graduates) with stronger science knowledge (n = 145). Face validity was confirmed by the use of a panel of experts and a pilot study employing participants similar in demographics to the intended sample. To confirm convergent and discriminant validity, confirmatory factor analysis and evaluation of the reliability were calculated. Statistical data and other data gathered from interviews suggest that the SHOMS will prove to be a useful tool for educators and researchers who wish to investigate HoM for a variety of participants.

Health Sciences-Evidence Based Practice questionnaire (HS-EBP) for measuring transprofessional evidence-based practice: Creation, development and psychometric validation.

PubMed

Fernández-Domínguez, Juan Carlos; de Pedro-Gómez, Joan Ernest; Morales-Asencio, José Miguel; Bennasar-Veny, Miquel; Sastre-Fullana, Pedro; Sesé-Abad, Albert

2017-01-01

Most of the EBP measuring instruments available to date present limitations both in the operationalisation of the construct and also in the rigour of their psychometric development, as revealed in the literature review performed. The aim of this paper is to provide rigorous and adequate reliability and validity evidence of the scores of a new transdisciplinary psychometric tool, the Health Sciences Evidence-Based Practice (HS-EBP), for measuring the construct EBP in Health Sciences professionals. A pilot study and a subsequent two-stage validation test sample were conducted to progressively refine the instrument until a reduced 60-item version with a five-factor latent structure. Reliability was analysed through both Cronbach's alpha coefficient and intraclass correlations (ICC). Latent structure was contrasted using confirmatory factor analysis (CFA) following a model comparison aproach. Evidence of criterion validity of the scores obtained was achieved by considering attitudinal resistance to change, burnout, and quality of professional life as criterion variables; while convergent validity was assessed using the Spanish version of the Evidence-Based Practice Questionnaire (EBPQ-19). Adequate evidence of both reliability and ICC was obtained for the five dimensions of the questionnaire. According to the CFA model comparison, the best fit corresponded to the five-factor model (RMSEA = 0.049; CI 90% RMSEA = [0.047; 0.050]; CFI = 0.99). Adequate criterion and convergent validity evidence was also provided. Finally, the HS-EBP showed the capability to find differences between EBP training levels as an important evidence of decision validity. Reliability and validity evidence obtained regarding the HS-EBP confirm the adequate operationalisation of the EBP construct as a process put into practice to respond to every clinical situation arising in the daily practice of professionals in health sciences (transprofessional). The tool could be useful for EBP individual

Macro- and Micro-Validation: Beyond the "Five Sources" Framework for Classifying Validation Evidence and Analysis

ERIC Educational Resources Information Center

Newton, Paul E.

2016-01-01

This paper argues that the dominant framework for conceptualizing validation evidence and analysis--the "five sources" framework from the 1999 "Standards"--is seriously limited. Its limitation raises a significant barrier to understanding the nature of comprehensive validation, and this presents a significant threat to…

Scientific evidence on perineal trauma during labor: Integrative review.

PubMed

Vieira, Flaviana; Guimarães, Janaina V; Souza, Marcia C S; Sousa, Poliana M L; Santos, Rafaela F; Cavalcante, Agueda M R Z

2018-04-01

To assess the scientific evidence for management and preservation of perineal integrity during the expulsive stage of labor. Integrative review that employed the Population, Intervention, Comparison, Outcome strategy to formulate the research question: Which perineal measure(s) is(are) effective in maintaining perineal integrity during labor? The search was performed in the databases MEDLINE, LILACS, BDENF and SciELO. The ten selected studies were analyzed based on their level of evidence and grade of recommendation. Four categories of measures were located: antenatal perineal care, perineal massage during the expulsive phase of labor, manual perineal support during the expulsive phase of labor and perineal hyaluronidase injection. Based on its level of evidence, perineal massage with lubricants performed by the women or their partners at the end of pregnancy may be recommended as a measure favorable for perineal protection. Copyright © 2018 Elsevier B.V. All rights reserved.

Theory of Multiple Intelligences: Is It a Scientific Theory?

ERIC Educational Resources Information Center

Chen, Jie-Qi

2004-01-01

This essay discusses the status of multiple intelligences (MI) theory as a scientific theory by addressing three issues: the empirical evidence Gardner used to establish MI theory, the methodology he employed to validate MI theory, and the purpose or function of MI theory.

When Assessment Data Are Words: Validity Evidence for Qualitative Educational Assessments.

PubMed

Cook, David A; Kuper, Ayelet; Hatala, Rose; Ginsburg, Shiphra

2016-10-01

Quantitative scores fail to capture all important features of learner performance. This awareness has led to increased use of qualitative data when assessing health professionals. Yet the use of qualitative assessments is hampered by incomplete understanding of their role in forming judgments, and lack of consensus in how to appraise the rigor of judgments therein derived. The authors articulate the role of qualitative assessment as part of a comprehensive program of assessment, and translate the concept of validity to apply to judgments arising from qualitative assessments. They first identify standards for rigor in qualitative research, and then use two contemporary assessment validity frameworks to reorganize these standards for application to qualitative assessment.Standards for rigor in qualitative research include responsiveness, reflexivity, purposive sampling, thick description, triangulation, transparency, and transferability. These standards can be reframed using Messick's five sources of validity evidence (content, response process, internal structure, relationships with other variables, and consequences) and Kane's four inferences in validation (scoring, generalization, extrapolation, and implications). Evidence can be collected and evaluated for each evidence source or inference. The authors illustrate this approach using published research on learning portfolios.The authors advocate a "methods-neutral" approach to assessment, in which a clearly stated purpose determines the nature of and approach to data collection and analysis. Increased use of qualitative assessments will necessitate more rigorous judgments of the defensibility (validity) of inferences and decisions. Evidence should be strategically sought to inform a coherent validity argument.

Health Sciences-Evidence Based Practice questionnaire (HS-EBP) for measuring transprofessional evidence-based practice: Creation, development and psychometric validation

PubMed Central

Fernández-Domínguez, Juan Carlos; de Pedro-Gómez, Joan Ernest; Morales-Asencio, José Miguel; Sastre-Fullana, Pedro; Sesé-Abad, Albert

2017-01-01

Introduction Most of the EBP measuring instruments available to date present limitations both in the operationalisation of the construct and also in the rigour of their psychometric development, as revealed in the literature review performed. The aim of this paper is to provide rigorous and adequate reliability and validity evidence of the scores of a new transdisciplinary psychometric tool, the Health Sciences Evidence-Based Practice (HS-EBP), for measuring the construct EBP in Health Sciences professionals. Methods A pilot study and a subsequent two-stage validation test sample were conducted to progressively refine the instrument until a reduced 60-item version with a five-factor latent structure. Reliability was analysed through both Cronbach’s alpha coefficient and intraclass correlations (ICC). Latent structure was contrasted using confirmatory factor analysis (CFA) following a model comparison aproach. Evidence of criterion validity of the scores obtained was achieved by considering attitudinal resistance to change, burnout, and quality of professional life as criterion variables; while convergent validity was assessed using the Spanish version of the Evidence-Based Practice Questionnaire (EBPQ-19). Results Adequate evidence of both reliability and ICC was obtained for the five dimensions of the questionnaire. According to the CFA model comparison, the best fit corresponded to the five-factor model (RMSEA = 0.049; CI 90% RMSEA = [0.047; 0.050]; CFI = 0.99). Adequate criterion and convergent validity evidence was also provided. Finally, the HS-EBP showed the capability to find differences between EBP training levels as an important evidence of decision validity. Conclusions Reliability and validity evidence obtained regarding the HS-EBP confirm the adequate operationalisation of the EBP construct as a process put into practice to respond to every clinical situation arising in the daily practice of professionals in health sciences (transprofessional). The

Development of Lesson Plans and Student Worksheets Based Socio-Scientific Issues on Pollution Environmental Topic

NASA Astrophysics Data System (ADS)

Rahayu, S.; Meyliana, M.; Arlingga, A.; Reny, R.; Siahaan, P.; Hernani, H.

2017-09-01

The aim of this study is to develop lesson plans and student worksheets based socio-scientific issues on pollution environmental topic for seventh-grade junior high school students. Environmental pollution topic split into several subtopics namely air pollution, water pollution and soil pollution. The composing of lesson plans were developed based on socio-scientific issues with five stages, namely (1) Motivate; (2) Challenge; (3) Collect scientific evidence; (4) Analyse the evidence; (5) Build knowledge and make connections; and (6) Use evidence. While student worksheets contain articles on socio-scientific issues, practice, and there are a few questions to determine students’ reasoning. The method that is used in this research is research and development (R & D method). Development model used in this study is a model of Plomp that consists of four stages, namely: (1) Initial Research; (2) Design; (3) Realization or Construction; (4) Testing, evaluation and revision; (5) Implementation, while the research was limited to the fourth stage. Lesson plans and student worksheets based on socio-scientific issues was validated through an expert validation. The result showed that lesson plans and student worksheets based socio-scientific issues on pollution theme have a very decent and be able to apply in science classroom.

The key-features approach to assess clinical decisions: validity evidence to date.

PubMed

Bordage, G; Page, G

2018-05-17

The key-features (KFs) approach to assessment was initially proposed during the First Cambridge Conference on Medical Education in 1984 as a more efficient and effective means of assessing clinical decision-making skills. Over three decades later, we conducted a comprehensive, systematic review of the validity evidence gathered since then. The evidence was compiled according to the Standards for Educational and Psychological Testing's five sources of validity evidence, namely, Content, Response process, Internal structure, Relations to other variables, and Consequences, to which we added two other types related to Cost-feasibility and Acceptability. Of the 457 publications that referred to the KFs approach between 1984 and October 2017, 164 are cited here; the remaining 293 were either redundant or the authors simply mentioned the KFs concept in relation to their work. While one set of articles reported meeting the validity standards, another set examined KFs test development choices and score interpretation. The accumulated validity evidence for the KFs approach since its inception supports the decision-making construct measured and its use to assess clinical decision-making skills at all levels of training and practice and with various types of exam formats. Recognizing that gathering validity evidence is an ongoing process, areas with limited evidence, such as item factor analyses or consequences of testing, are identified as well as new topics needing further clarification, such as the use of the KFs approach for formative assessment and its place within a program of assessment.

Validity evidence as a key marker of quality of technical skill assessment in OTL-HNS.

PubMed

Labbé, Mathilde; Young, Meredith; Nguyen, Lily H P

2018-01-13

Quality monitoring of assessment practices should be a priority in all residency programs. Validity evidence is one of the main hallmarks of assessment quality and should be collected to support the interpretation and use of assessment data. Our objective was to identify, synthesize, and present the validity evidence reported supporting different technical skill assessment tools in otolaryngology-head and neck surgery (OTL-HNS). We performed a secondary analysis of data generated through a systematic review of all published tools for assessing technical skills in OTL-HNS (n = 16). For each tool, we coded validity evidence according to the five types of evidence described by the American Educational Research Association's interpretation of Messick's validity framework. Descriptive statistical analyses were conducted. All 16 tools included in our analysis were supported by internal structure and relationship to variables validity evidence. Eleven articles presented evidence supporting content. Response process was discussed only in one article, and no study reported on evidence exploring consequences. We present the validity evidence reported for 16 rater-based tools that could be used for work-based assessment of OTL-HNS residents in the operating room. The articles included in our review were consistently deficient in evidence for response process and consequences. Rater-based assessment tools that support high-stakes decisions that impact the learner and programs should include several sources of validity evidence. Thus, use of any assessment should be done with careful consideration of the context-specific validity evidence supporting score interpretation, and we encourage deliberate continual assessment quality-monitoring. NA. Laryngoscope, 2018. © 2018 The American Laryngological, Rhinological and Otological Society, Inc.

The scientific consensus on climate change as a gateway belief: experimental evidence.

PubMed

van der Linden, Sander L; Leiserowitz, Anthony A; Feinberg, Geoffrey D; Maibach, Edward W

2015-01-01

There is currently widespread public misunderstanding about the degree of scientific consensus on human-caused climate change, both in the US as well as internationally. Moreover, previous research has identified important associations between public perceptions of the scientific consensus, belief in climate change and support for climate policy. This paper extends this line of research by advancing and providing experimental evidence for a "gateway belief model" (GBM). Using national data (N = 1104) from a consensus-message experiment, we find that increasing public perceptions of the scientific consensus is significantly and causally associated with an increase in the belief that climate change is happening, human-caused and a worrisome threat. In turn, changes in these key beliefs are predictive of increased support for public action. In short, we find that perceived scientific agreement is an important gateway belief, ultimately influencing public responses to climate change.

The Scientific Consensus on Climate Change as a Gateway Belief: Experimental Evidence

PubMed Central

van der Linden, Sander L.; Leiserowitz, Anthony A.; Feinberg, Geoffrey D.; Maibach, Edward W.

2015-01-01

There is currently widespread public misunderstanding about the degree of scientific consensus on human-caused climate change, both in the US as well as internationally. Moreover, previous research has identified important associations between public perceptions of the scientific consensus, belief in climate change and support for climate policy. This paper extends this line of research by advancing and providing experimental evidence for a “gateway belief model” (GBM). Using national data (N = 1104) from a consensus-message experiment, we find that increasing public perceptions of the scientific consensus is significantly and causally associated with an increase in the belief that climate change is happening, human-caused and a worrisome threat. In turn, changes in these key beliefs are predictive of increased support for public action. In short, we find that perceived scientific agreement is an important gateway belief, ultimately influencing public responses to climate change. PMID:25714347

20 CFR 219.31 - Evidence of a valid ceremonial marriage.

Code of Federal Regulations, 2010 CFR

2010-04-01

... 20 Employees' Benefits 1 2010-04-01 2010-04-01 false Evidence of a valid ceremonial marriage. 219... marriage. (a) Preferred evidence. Preferred evidence of a ceremonial marriage is— (1) A copy of the public record of the marriage, certified by the custodian of the record or by a Board employee; (2) A copy of a...

Validity evidence for the measurement of the strength of motivation for medical school.

PubMed

Kusurkar, Rashmi; Croiset, Gerda; Kruitwagen, Cas; ten Cate, Olle

2011-05-01

The Strength of Motivation for Medical School (SMMS) questionnaire is designed to determine the strength of motivation of students particularly for medical study. This research was performed to establish the validity evidence for measuring strength of motivation for medical school. Internal structure and relations to other variables were used as the sources of validity evidence. The SMMS questionnaire was filled out by 1,494 medical students in different years of medical curriculum. The validity evidence for the internal structure was analyzed by principal components analysis with promax rotation. Validity evidence for relations to other variables was tested by comparing the SMMS scores with scores on the Academic Motivation Scale (AMS) and the exhaustion scale of Maslach Burnout Inventory-Student Survey (MBI-SS) for measuring study stress. Evidence for internal consistency was determined through the Cronbach's alpha for reliability. The analysis showed that the SMMS had a 3-factor structure. The validity in relations to other variables was established as both, the subscales and full scale scores significantly correlated positively with the intrinsic motivation scores and with the more autonomous forms of extrinsic motivation, the correlation decreasing and finally becoming negative towards the extrinsic motivation end of the spectrum. They also had significant negative correlations with amotivation scale of the AMS and exhaustion scale of MBI-SS. The Cronbach's alpha for reliability of the three subscales and full SMMS scores was 0.70, 0.67, 0.55 and 0.79. The strength of motivation for medical school has a three factor structure and acceptable validity evidence was found in our study.

Synthesizing Quantitative Evidence for Evidence-based Nursing: Systematic Review.

PubMed

Oh, Eui Geum

2016-06-01

As evidence-based practice has become an important issue in healthcare settings, the educational needs for knowledge and skills for the generation and utilization of healthcare evidence are increasing. Systematic review (SR), a way of evidence generation, is a synthesis of primary scientific evidence, which summarizes the best evidence on a specific clinical question using a transparent, a priori protocol driven approach. SR methodology requires a critical appraisal of primary studies, data extraction in a reliable and repeatable way, and examination for validity of the results. SRs are considered hierarchically as the highest form of evidence as they are a systematic search, identification, and summarization of the available evidence to answer a focused clinical question with particular attention to the methodological quality of studies or the credibility of opinion and text. The purpose of this paper is to introduce an overview of the fundamental knowledge, principals and processes in SR. The focus of this paper is on SR especially for the synthesis of quantitative data from primary research studies that examines the effectiveness of healthcare interventions. To activate evidence-based nursing care in various healthcare settings, the best and available scientific evidence are essential components. This paper will include some examples to promote understandings. Copyright © 2016. Published by Elsevier B.V.

Measuring Practitioner Attitudes toward Evidence-Based Treatments: A Validation Study

ERIC Educational Resources Information Center

Ashcraft, Rindee G. P.; Foster, Sharon L.; Lowery, Amy E.; Henggeler, Scott W.; Chapman, Jason E.; Rowland, Melisa D.

2011-01-01

A better understanding of clinicians' attitudes toward evidence-based treatments (EBT) will presumably enhance the transfer of EBTs for substance-abusing adolescents from research to clinical application. The reliability and validity of two measures of therapist attitudes toward EBT were examined: the Evidence-Based Practice Attitude Scale…

Applicability Analysis of Validation Evidence for Biomedical Computational Models

DOE Office of Scientific and Technical Information (OSTI.GOV)

Pathmanathan, Pras; Gray, Richard A.; Romero, Vicente J.

Computational modeling has the potential to revolutionize medicine the way it transformed engineering. However, despite decades of work, there has only been limited progress to successfully translate modeling research to patient care. One major difficulty which often occurs with biomedical computational models is an inability to perform validation in a setting that closely resembles how the model will be used. For example, for a biomedical model that makes in vivo clinically relevant predictions, direct validation of predictions may be impossible for ethical, technological, or financial reasons. Unavoidable limitations inherent to the validation process lead to challenges in evaluating the credibilitymore » of biomedical model predictions. Therefore, when evaluating biomedical models, it is critical to rigorously assess applicability, that is, the relevance of the computational model, and its validation evidence to the proposed context of use (COU). However, there are no well-established methods for assessing applicability. In this paper, we present a novel framework for performing applicability analysis and demonstrate its use with a medical device computational model. The framework provides a systematic, step-by-step method for breaking down the broad question of applicability into a series of focused questions, which may be addressed using supporting evidence and subject matter expertise. The framework can be used for model justification, model assessment, and validation planning. While motivated by biomedical models, it is relevant to a broad range of disciplines and underlying physics. Finally, the proposed applicability framework could help overcome some of the barriers inherent to validation of, and aid clinical implementation of, biomedical models.« less

Applicability Analysis of Validation Evidence for Biomedical Computational Models

DOE PAGES

Pathmanathan, Pras; Gray, Richard A.; Romero, Vicente J.; ...

2017-09-07

Computational modeling has the potential to revolutionize medicine the way it transformed engineering. However, despite decades of work, there has only been limited progress to successfully translate modeling research to patient care. One major difficulty which often occurs with biomedical computational models is an inability to perform validation in a setting that closely resembles how the model will be used. For example, for a biomedical model that makes in vivo clinically relevant predictions, direct validation of predictions may be impossible for ethical, technological, or financial reasons. Unavoidable limitations inherent to the validation process lead to challenges in evaluating the credibilitymore » of biomedical model predictions. Therefore, when evaluating biomedical models, it is critical to rigorously assess applicability, that is, the relevance of the computational model, and its validation evidence to the proposed context of use (COU). However, there are no well-established methods for assessing applicability. In this paper, we present a novel framework for performing applicability analysis and demonstrate its use with a medical device computational model. The framework provides a systematic, step-by-step method for breaking down the broad question of applicability into a series of focused questions, which may be addressed using supporting evidence and subject matter expertise. The framework can be used for model justification, model assessment, and validation planning. While motivated by biomedical models, it is relevant to a broad range of disciplines and underlying physics. Finally, the proposed applicability framework could help overcome some of the barriers inherent to validation of, and aid clinical implementation of, biomedical models.« less

[Evidence-based medicine: the art of applying scientific knowledge in clinical practice].

PubMed

Lopes, A A

2000-01-01

This article was written with the objective of describing the concept of Evidence Based Medicine (EBM) and the competences required for its practice. EBM should be viewed as an integration of clinical experience with the ability to analyze and rationally apply the scientific information while taking care of patients. The application of methods and strategies to enhance the scientific background of the physician while taking into account the humanitarian values of the medical profession should contribute to improve the quality of the medical care that is offered in Brazil. The Medical Schools and Associations may play important roles in the promotion of EBM.

Korean consumers' perceptions of health/functional food claims according to the strength of scientific evidence

PubMed Central

Kim, Ji Yeon; Kang, Eun Jin; Kwon, Oran

2010-01-01

In this study, we investigated that consumers could differentiate between levels of claims and clarify how a visual aid influences consumer understanding of the different claim levels. We interviewed 2,000 consumers in 13 shopping malls on their perception of and confidence in different levels of health claims using seven point scales. The average confidence scores given by participants were 4.17 for the probable level and 4.07 for the possible level; the score for the probable level was significantly higher than that for the possible level (P < 0.05). Scores for confidence in claims after reading labels with and without a visual aid were 5.27 and 4.43, respectively; the score for labeling with a visual aid was significantly higher than for labeling without a visual aid (P < 0.01). Our results provide compelling evidence that providing health claims with qualifying language differentiating levels of scientific evidence can help consumers understand the strength of scientific evidence behind those claims. Moreover, when a visual aid was included, consumers perceived the scientific levels more clearly and had greater confidence in their meanings than when a visual aid was not included. Although this result suggests that consumers react differently to different claim levels, it is not yet clear whether consumers understand the variations in the degree of scientific support. PMID:21103090

Performance Validity Testing in Neuropsychology: Scientific Basis and Clinical Application-A Brief Review.

PubMed

Greher, Michael R; Wodushek, Thomas R

2017-03-01

Performance validity testing refers to neuropsychologists' methodology for determining whether neuropsychological test performances completed in the course of an evaluation are valid (ie, the results of true neurocognitive function) or invalid (ie, overly impacted by the patient's effort/engagement in testing). This determination relies upon the use of either standalone tests designed for this sole purpose, or specific scores/indicators embedded within traditional neuropsychological measures that have demonstrated this utility. In response to a greater appreciation for the critical role that performance validity issues play in neuropsychological testing and the need to measure this variable to the best of our ability, the scientific base for performance validity testing has expanded greatly over the last 20 to 30 years. As such, the majority of current day neuropsychologists in the United States use a variety of measures for the purpose of performance validity testing as part of everyday forensic and clinical practice and address this issue directly in their evaluations. The following is the first article of a 2-part series that will address the evolution of performance validity testing in the field of neuropsychology, both in terms of the science as well as the clinical application of this measurement technique. The second article of this series will review performance validity tests in terms of methods for development of these measures, and maximizing of diagnostic accuracy.

Dental movement acceleration: Literature review by an alternative scientific evidence method

PubMed Central

Camacho, Angela Domínguez; Cujar, Sergio Andres Velásquez

2014-01-01

The aim of this study was to analyze the majority of publications using effective methods to speed up orthodontic treatment and determine which publications carry high evidence-based value. The literature published in Pubmed from 1984 to 2013 was reviewed, in addition to well-known reports that were not classified under this database. To facilitate evidence-based decision making, guidelines such as the Consolidation Standards of Reporting Trials, Preferred Reporting items for systematic Reviews and Meta-analyses, and Transparent Reporting of Evaluations with Non-randomized Designs check list were used. The studies were initially divided into three groups: local application of cell mediators, physical stimuli, and techniques that took advantage of the regional acceleration phenomena. The articles were classified according to their level of evidence using an alternative method for orthodontic scientific article classification. 1a: Systematic Reviews (SR) of randomized clinical trials (RCTs), 1b: Individual RCT, 2a: SR of cohort studies, 2b: Individual cohort study, controlled clinical trials and low quality RCT, 3a: SR of case-control studies, 3b: Individual case-control study, low quality cohort study and short time following split mouth designs. 4: Case-series, low quality case-control study and non-systematic review, and 5: Expert opinion. The highest level of evidence for each group was: (1) local application of cell mediators: the highest level of evidence corresponds to a 3B level in Prostaglandins and Vitamin D; (2) physical stimuli: vibratory forces and low level laser irradiation have evidence level 2b, Electrical current is classified as 3b evidence-based level, Pulsed Electromagnetic Field is placed on the 4th level on the evidence scale; and (3) regional acceleration phenomena related techniques: for corticotomy the majority of the reports belong to level 4. Piezocision, dentoalveolar distraction, alveocentesis, monocortical tooth dislocation and ligament

Presenting Global Warming and Evolution as Public Health Issues to Encourage Acceptance of Scientific Evidence

ERIC Educational Resources Information Center

Stover, Shawn K.; McArthur, Laurence B.; Mabry, Michelle L.

2013-01-01

Although evidence supporting anthropogenic global warming and evolution by natural selection is considerable, the public does not embrace these concepts. The current study explores the hypothesis that individuals will become more receptive to scientific viewpoints if evidence for evolution and implications of global warming are presented as issues…

Scientific Research in Homeopathic Medicine: Validation, Methodology and Perspectives

PubMed Central

2007-01-01

Verona's School of Homeopathic Medicine (www.omeopatia.org) organized a day of full immersion in the field of homeopathy, focusing on the validity of this much-debated discipline. There is widespread consensus in the medical community that evidence-based medicine is the best standard for assessing efficacy and safety of healthcare practices, and systematic reviews with strict protocols are essential to establish proof for various therapies. Students, homeopathic practitioners, academic and business representatives, who are interested in or curious about homeopathic practices attended the conference.

Scientific Evidence as Content Knowledge: A Replication Study with English and Turkish Pre-Service Primary Teachers

ERIC Educational Resources Information Center

Roberts, Ros; Sahin-Pekmez, Esin

2012-01-01

Pre-service teachers around the world need to develop their content knowledge of scientific evidence to meet the requirements of recent school curriculum developments which prepare pupils to be scientifically literate. This research reports a replication study in Turkey of an intervention originally carried out with pre-service primary teachers in…

Developing resident learning profiles: Do scientific evidence epistemology beliefs, EBM self-efficacy beliefs and EBM skills matter?

NASA Astrophysics Data System (ADS)

Robert, Nancy J.

This study investigated resident scientific evidence epistemology beliefs, evidence based medicine (EBM) self-efficacy beliefs, and EBM skills. A convenience sample of fifty-one residents located in six U.S. based residency programs completed an online instrument. Hofer's epistemology survey questionnaire was modified to test responses based on four types of scientific evidence encountered in medical practice (Clinical Trial Phase 1, Clinical Trial Phase 3, Meta-analysis and Qualitative). It was hypothesized that epistemology beliefs would differ based on the type of scientific evidence considered. A principal components analysis produced a two factor solution that was significant across type of scientific evidence suggesting that when evaluating epistemology beliefs context does matter. Factor 1 is related to the certainty of research methods and the certainty of medical conclusions and factor 2 denotes medical justification. For each type of scientific evidence, both factors differed on questions comprising the factor structure with significant differences found for the factor 1 and 2 questions. A justification belief case problem using checklist format was triangulated with the survey results, and as predicted the survey and checklist justification z scores indicated no significant differences, and two new justification themes emerged. Modified versions of Finney and Schraw's statistical self-efficacy and skill instruments produced expected significant EBM score correlations with unexpected results indicating that the number of EBM and statistics courses are not significant for EBM self-efficacy and skill scores. The study results were applied to the construction of a learning profile that provided residents belief and skill feedback specific to individual learning needs. The learning profile design incorporated core values related to 'Believer' populations that focus on art, harmony, tact and diplomacy. Future research recommendations include testing context

European Code against Cancer 4th Edition: Process of reviewing the scientific evidence and revising the recommendations.

PubMed

Minozzi, Silvia; Armaroli, Paola; Espina, Carolina; Villain, Patricia; Wiseman, Martin; Schüz, Joachim; Segnan, Nereo

2015-12-01

The European Code Against Cancer is a set of recommendations to give advice on cancer prevention. Its 4th edition is an update of the 3rd edition, from 2003. Working Groups of independent experts from different fields of cancer prevention were appointed to review the recommendations, supported by a Literature Group to provide scientific and technical support in the assessment of the scientific evidence, through systematic reviews of the literature. Common procedures were developed to guide the experts in identifying, retrieving, assessing, interpreting and summarizing the scientific evidence in order to revise the recommendations. The Code strictly followed the concept of providing advice to European Union citizens based on the current best available science. The advice, if followed, would be expected to reduce cancer risk, referring both to avoiding or reducing exposure to carcinogenic agents or changing behaviour related to cancer risk and to participating in medical interventions able to avert specific cancers or their consequences. The information sources and procedures for the review of the scientific evidence are described here in detail. The 12 recommendations of the 4th edition of the European Code Against Cancer were ultimately approved by a Scientific Committee of leading European cancer and public health experts. Copyright © 2015 International Agency for Research on Cancer. Published by Elsevier Ltd. All rights reserved.

Convergent Validity Evidence regarding the Validity of the Chilean Standards-Based Teacher Evaluation System

ERIC Educational Resources Information Center

Santelices, Maria Veronica; Taut, Sandy

2011-01-01

This paper describes convergent validity evidence regarding the mandatory, standards-based Chilean national teacher evaluation system (NTES). The study examined whether NTES identifies--and thereby rewards or punishes--the "right" teachers as high- or low-performing. We collected in-depth teaching performance data on a sample of 58…

Validity evidence for the Fundamentals of Laparoscopic Surgery (FLS) program as an assessment tool: a systematic review.

PubMed

Zendejas, Benjamin; Ruparel, Raaj K; Cook, David A

2016-02-01

The Fundamentals of Laparoscopic Surgery (FLS) program uses five simulation stations (peg transfer, precision cutting, loop ligation, and suturing with extracorporeal and intracorporeal knot tying) to teach and assess laparoscopic surgery skills. We sought to summarize evidence regarding the validity of scores from the FLS assessment. We systematically searched for studies evaluating the FLS as an assessment tool (last search update February 26, 2013). We classified validity evidence using the currently standard validity framework (content, response process, internal structure, relations with other variables, and consequences). From a pool of 11,628 studies, we identified 23 studies reporting validity evidence for FLS scores. Studies involved residents (n = 19), practicing physicians (n = 17), and medical students (n = 8), in specialties of general (n = 17), gynecologic (n = 4), urologic (n = 1), and veterinary (n = 1) surgery. Evidence was most common in the form of relations with other variables (n = 22, most often expert-novice differences). Only three studies reported internal structure evidence (inter-rater or inter-station reliability), two studies reported content evidence (i.e., derivation of assessment elements), and three studies reported consequences evidence (definition of pass/fail thresholds). Evidence nearly always supported the validity of FLS total scores. However, the loop ligation task lacks discriminatory ability. Validity evidence confirms expected relations with other variables and acceptable inter-rater reliability, but other validity evidence is sparse. Given the high-stakes use of this assessment (required for board eligibility), we suggest that more validity evidence is required, especially to support its content (selection of tasks and scoring rubric) and the consequences (favorable and unfavorable impact) of assessment.

Evaluating Existing and New Validity Evidence for the Academic Motivation Scale

ERIC Educational Resources Information Center

Fairchild, Amanda J.; Horst, S. Jeanne; Finney, Sara J.; Barron, Kenneth E.

2005-01-01

The current study evaluates existing and new validity evidence for the Academic Motivation Scale (AMS; Vallerand et al., 1992). We first provide a narrative review synthesizing past research, and then conduct a validity investigation of the scores from the measure. Data analysis using a sample of 1406 American college students provided construct…

Scientific reasoning in early and middle childhood: the development of domain-general evidence evaluation, experimentation, and hypothesis generation skills.

PubMed

Piekny, Jeanette; Maehler, Claudia

2013-06-01

According to Klahr's (2000, 2005; Klahr & Dunbar, 1988) Scientific Discovery as Dual Search model, inquiry processes require three cognitive components: hypothesis generation, experimentation, and evidence evaluation. The aim of the present study was to investigate (a) when the ability to evaluate perfect covariation, imperfect covariation, and non-covariation evidence emerges, (b) when experimentation emerges, (c) when hypothesis generation skills emerge, and (d), whether these abilities develop synchronously during childhood. We administered three scientific reasoning tasks referring to the three components to 223 children of five age groups (from age 4.0 to 13.5 years). Our results show that the three cognitive components of domain-general scientific reasoning emerge asynchronously. The development of domain-general scientific reasoning begins with the ability to handle unambiguous data, progresses to the interpretation of ambiguous data, and leads to a flexible adaptation of hypotheses according to the sufficiency of evidence. When children understand the relation between the level of ambiguity of evidence and the level of confidence in hypotheses, the ability to differentiate conclusive from inconclusive experiments accompanies this development. Implications of these results for designing science education concepts for young children are briefly discussed. © 2012 The British Psychological Society.

Validity Evidence for the Neuro-Endoscopic Ventriculostomy Assessment Tool (NEVAT).

PubMed

Breimer, Gerben E; Haji, Faizal A; Cinalli, Giuseppe; Hoving, Eelco W; Drake, James M

2017-02-01

Growing demand for transparent and standardized methods for evaluating surgical competence prompted the construction of the Neuro-Endoscopic Ventriculostomy Assessment Tool (NEVAT). To provide validity evidence of the NEVAT by reporting on the tool's internal structure and its relationship with surgical expertise during simulation-based training. The NEVAT was used to assess performance of trainees and faculty at an international neuroendoscopy workshop. All participants performed an endoscopic third ventriculostomy (ETV) on a synthetic simulator. Participants were simultaneously scored by 2 raters using the NEVAT procedural checklist and global rating scale (GRS). Evidence of internal structure was collected by calculating interrater reliability and internal consistency of raters' scores. Evidence of relationships with other variables was collected by comparing the ETV performance of experts, experienced trainees, and novices using Jonckheere's test (evidence of construct validity). Thirteen experts, 11 experienced trainees, and 10 novices participated. The interrater reliability by the intraclass correlation coefficient for the checklist and GRS was 0.82 and 0.94, respectively. Internal consistency (Cronbach's α) for the checklist and the GRS was 0.74 and 0.97, respectively. Median scores with interquartile range on the checklist and GRS for novices, experienced trainees, and experts were 0.69 (0.58-0.86), 0.85 (0.63-0.89), and 0.85 (0.81-0.91) and 3.1 (2.5-3.8), 3.7 (2.2-4.3) and 4.6 (4.4-4.9), respectively. Jonckheere's test showed that the median checklist and GRS score increased with performer expertise ( P = .04 and .002, respectively). This study provides validity evidence for the NEVAT to support its use as a standardized method of evaluating neuroendoscopic competence during simulation-based training. Copyright © 2016 by the Congress of Neurological Surgeons

[Bibliometric analysis of scientific articles on evidence-based nursing of burn in the mainland of China].

PubMed

Yue, L Q; Pi, X Q; Fan, X G

2016-07-20

To analyze the current research status of evidence-based nursing of burn in the mainland of China, in order to provide basis for the improvement of scientificity of burn nursing practice. Chinese scientific articles on evidence-based nursing of burn in the mainland of China published from January 1997 to December 2015 were retrieved from Chinese Biology Medicine disc, Chinese Journals Full-text Database, Wanfang Database, and VIP Database. From the results retrieved, date with regard to publication year, region of affiliation of the first author, journal distribution, literature type, literature quality assessment, topic of evidence-based research, fund program support, implementation of evidence-based practice steps, and language and quantity of reference. Data were processed with Microsoft Excel software. A total of 50 articles conforming to the criteria were retrieved. (1) Articles about evidence-based nursing of burn arose in 2004. Compared with that in the previous year, there was no obvious increase in the number of relevant articles in each year from 2004 to 2011. The number of literature in 2012 was obviously increased than that in each year from 2004 to 2011, while the number of literature in each year from 2012 to 2015 was not obviously increased compared with that in the previous year. (2) The regions of affiliation of the first author were distributed in 13 provinces, 3 minority autonomous regions, and 3 municipalities, with the largest distribution in East China, and Northwest China and Southwest China in the follow. (3) The articles were published in 32 domestic journals, with 9 (28.12%) nursing journals, 5 (15.62%) burn medical related journals, and 18 (56.25%) other journals. Twenty (40%) articles were published in Source Journal for Chinese Scientific and Technical Papers. (4) Regarding the literature type, 31 (62%) articles dealt with clinical experiences, 17 (34%) articles dealt with scientific research, and 2 (4%) articles dealt with case report

A prospective multiple case study of the impact of emerging scientific evidence on established colorectal cancer screening programs: a study protocol.

PubMed

Geddie, Hannah; Dobrow, Mark J; Hoch, Jeffrey S; Rabeneck, Linda

2012-06-01

Health-policy decision making is a complex and dynamic process, for which strong evidentiary support is required. This includes scientifically produced research, as well as information that relates to the context in which the decision takes place. Unlike scientific evidence, this "contextual evidence" is highly variable and often includes information that is not scientifically produced, drawn from sources such as political judgement, program management experience and knowledge, or public values. As the policy decision-making process is variable and difficult to evaluate, it is often unclear how this heterogeneous evidence is identified and incorporated into "evidence-based policy" decisions. Population-based colorectal cancer screening poses an ideal context in which to examine these issues. In Canada, colorectal cancer screening programs have been established in several provinces over the past five years, based on the fecal occult blood test (FOBT) or the fecal immunochemical test. However, as these programs develop, new scientific evidence for screening continues to emerge. Recently published randomized controlled trials suggest that the use of flexible sigmoidoscopy for population-based screening may pose a greater reduction in mortality than the FOBT. This raises the important question of how policy makers will address this evidence, given that screening programs are being established or are already in place. This study will examine these issues prospectively and will focus on how policy makers monitor emerging scientific evidence and how both scientific and contextual evidence are identified and applied for decisions about health system improvement. This study will employ a prospective multiple case study design, involving participants from Ontario, Alberta, Manitoba, Nova Scotia, and Quebec. In each province, data will be collected via document analysis and key informant interviews. Documents will include policy briefs, reports, meeting minutes, media

Scientific Reporting: Raising the Standards.

PubMed

McLeroy, Kenneth R; Garney, Whitney; Mayo-Wilson, Evan; Grant, Sean

2016-10-01

This article is based on a presentation that was made at the 2014 annual meeting of the editorial board of Health Education & Behavior. The article addresses critical issues related to standards of scientific reporting in journals, including concerns about external and internal validity and reporting bias. It reviews current reporting guidelines, effects of adopting guidelines, and offers suggestions for improving reporting. The evidence about the effects of guideline adoption and implementation is briefly reviewed. Recommendations for adoption and implementation of appropriate guidelines, including considerations for journals, are provided. © 2016 Society for Public Health Education.

The Scientific Status of Projective Techniques.

PubMed

Lilienfeld, S O; Wood, J M; Garb, H N

2000-11-01

Although projective techniques continue to be widely used in clinical and forensic settings, their scientific status remains highly controversial. In this monograph, we review the current state of the literature concerning the psychometric properties (norms, reliability, validity, incremental validity, treatment utility) of three major projective instruments: Rorschach Inkblot Test, Thematic Apperception Test (TAT), and human figure drawings. We conclude that there is empirical support for the validity of a small number of indexes derived from the Rorschach and TAT. However, the substantial majority of Rorschach and TAT indexes are not empirically supported. The validity evidence for human figure drawings is even more limited. With a few exceptions, projective indexes have not consistently demonstrated incremental validity above and beyond other psychometric data. In addition, we summarize the results of a new meta-analysis intended to examine the capacity of these three instruments to detect child sexual abuse. Although some projective instruments were better than chance at detecting child sexual abuse, there were virtually no replicated findings across independent investigative teams. This meta-analysis also provides the first clear evidence of substantial file drawer effects in the projectives literature, as the effect sizes from published studies markedly exceeded those from unpublished studies. We conclude with recommendations regarding the (a) construction of projective techniques with adequate validity, (b) forensic and clinical use of projective techniques, and (c) education and training of future psychologists regarding projective techniques. © 2000 Association for Psychological Science.

Herbs with potential nephrotoxic effects according to traditional Persian medicine: Review and assessment of scientific evidence.

PubMed

Kolangi, Fatemeh; Memariani, Zahra; Bozorgi, Mahboubeh; Mozaffarpur, Seyyed Ali; Mirzapour, Mohaddeseh

2018-04-03

The increased use of herbal remedies particularly in patients with kidney diseases indicated the importance of studies which focused on nephrotoxic plants. The present study aimed to review and assess the kidney-damaging herbs mentioned in the Persian medicine [PM] books. The main PM books were searched for nephrotoxic herbs and their relevant reformers traditionally proposed for preventing renal damage. PubMed, Scopus and Google Scholar were investigated for evaluation of the scientific evidence relating to the nephrotoxicity of herbs. A total of 64 plants with kidney damage potential and their reformer medicaments were recorded in 7 sources included in this review. Allium schoenoprasum and Marrubium vulgare were the most repeated and emphasized nephrotoxic plants in PM books, but there was not any relevant scientific evidence. Despite the lack of clinical studies, some evidence was found for 38% of plants that were related to renal damage. The most repeated reformers for reducing the renal side effects mainly consisted of gum tragacanth, gum Arabic, mastic gum, anise, jujube and honey and some evidence was found for their nephroprotective activities. The present study reviewed and assessed the herbs with adverse renal effects in the main PM books. Some evidence was in line with the potential nephrotoxicity of plants and their ‎reformers. Despite the lack of clinical research for evaluation of their renal damage, the herbs may be focused in term of their nephrotoxicity; and there is a need for further studies on the scientific basis of their nephrotoxicity. Copyright© Bentham Science Publishers; For any queries, please email at epub@benthamscience.org.

Validity of Scientific Based Chemistry Android Module to Empower Science Process Skills (SPS) in Solubility Equilibrium

NASA Astrophysics Data System (ADS)

Antrakusuma, B.; Masykuri, M.; Ulfa, M.

2018-04-01

Evolution of Android technology can be applied to chemistry learning, one of the complex chemistry concept was solubility equilibrium. this concept required the science process skills (SPS). This study aims to: 1) Characteristic scientific based chemistry Android module to empowering SPS, and 2) Validity of the module based on content validity and feasibility test. This research uses a Research and Development approach (RnD). Research subjects were 135 s1tudents and three teachers at three high schools in Boyolali, Central of Java. Content validity of the module was tested by seven experts using Aiken’s V technique, and the module feasibility was tested to students and teachers in each school. Characteristics of chemistry module can be accessed using the Android device. The result of validation of the module contents got V = 0.89 (Valid), and the results of the feasibility test Obtained 81.63% (by the student) and 73.98% (by the teacher) indicates this module got good criteria.

Teachers' Perceptions of the Role of Evidence in Teaching Controversial Socio-Scientific Issues

ERIC Educational Resources Information Center

Levinson, Ralph

2006-01-01

Eighty-three teachers across the curriculum were interviewed to explain their views on and approaches to, the teaching of socio-scientific controversial issues to 14-19 year olds, particularly with regard to developments in biomedicine and biotechnology. This study focused on teachers' views on the nature of evidence in controversial issues and…

Validation of the Evidence-Based Practice Process Assessment Scale

ERIC Educational Resources Information Center

Rubin, Allen; Parrish, Danielle E.

2011-01-01

Objective: This report describes the reliability, validity, and sensitivity of a scale that assesses practitioners' perceived familiarity with, attitudes of, and implementation of the evidence-based practice (EBP) process. Method: Social work practitioners and second-year master of social works (MSW) students (N = 511) were surveyed in four sites…

Local perceptions of climate change validated by scientific evidence in the Himalayas.

PubMed

Chaudhary, Pashupati; Bawa, Kamaljit S

2011-10-23

The Himalayas are assumed to be undergoing rapid climate change, with serious environmental, social and economic consequences for more than two billion people. However, data on the extent of climate change or its impact on the region are meagre. Based on local knowledge, we report perceived changes in climate and consequences of such changes for biodiversity and agriculture. Our analyses are based on 250 household interviews administered in 18 villages, and focused group discussions conducted in 10 additional villages in Darjeeling Hills, West Bengal, India and Ilam district of Nepal. There is a widespread feeling that weather is getting warmer, the water sources are drying up, the onset of summer and monsoon has advanced during last 10 years and there is less snow on mountains than before. Local perceptions of the impact of climate change on biodiversity included early budburst and flowering, new agricultural pests and weeds and appearance of mosquitoes. People at high altitudes appear more sensitive to climate change than those at low altitudes. Most local perceptions conform to scientific data. Local knowledge can be rapidly and efficiently gathered using systematic tools. Such knowledge can allow scientists to test specific hypotheses, and policy makers to design mitigation and adaptation strategies for climate change, especially in an extraordinarily important part of our world that is experiencing considerable change.

Extending Validity Evidence for Multidimensional Measures of Coaching Competency

ERIC Educational Resources Information Center

Myers, Nicholas D.; Wolfe, Edward W.; Maier, Kimberly S.; Feltz, Deborah L.; Reckase, Mark D.

2006-01-01

This study extended validity evidence for multidimensional measures of coaching competency derived from the Coaching Competency Scale (CCS; Myers, Feltz, Maier, Wolfe, & Reckase, 2006) by examining use of the original rating scale structure and testing how measures related to satisfaction with the head coach within teams and between teams.…

Using scientific evidence to improve information practice.

PubMed

Bradley, J; Marshall, J G

1995-09-01

The recent policy statement of the Medical Library Association (MLA) takes the position that scientific evidence is the basis for improving the quality of library and information sciences now and in the future. Research activity is seen as the foundation of an evolving knowledge base for the profession--a knowledge base that will set health sciences librarians apart from others in an increasingly competitive world of information service providers. The statement represents the culmination of many years of activity by association members, during which the role of research in health information practice has been debated. Over a similar time period, the quality movement, with its increasing demand for the collection and use of data, has been growing. Developments such as total quality management (TQM) and continuous quality improvement (CQI) reinforce the centrality of research with its increasing demand for the collection and use of data, has been growing. Developments such as total quality management (TQM) and continuous quality improvement (CQI) reinforce the centrality of research and its relationship to efficient and effective information practice as envisioned in the MLA policy statement.

Further scientific evidence of the non-poisonous death of Napoleon.

PubMed

Corso, P F; Hindmarsh, T

1996-01-01

Napoleon's death has been historically attributed to cancer of the stomach. This has been documented in numerous writings including those of Antommarchi, Henry, and Shortt, all of whom were present at Napoleon's autopsy in 1821. These documents have been well preserved and have been accepted by historians and scholars worldwide as the probable cause of Napoleon's death. In an earlier presentation, the senior author presented a detailed historical review of Napoleon's death in a paper entitled 'The Last Days and Hours of Napoleon-What Really Happened'. This was given at the famous 'Debate of the Century' at the Napoleonic Society Meeting in Chicago, Illinois, in September of 1994. This paper will concern itself more specifically with new scientific material giving additional support to the cancerous cause of Napoleon's death, and with the lack of evidence of any substance which could cause his death to be attributed to arsenic poisoning. Hairs previously untested and even unknown to exist provide the basis for this new evidence.

Recent Scientific Evidence and Technical Developments in Cardiovascular Computed Tomography.

PubMed

Marcus, Roy; Ruff, Christer; Burgstahler, Christof; Notohamiprodjo, Mike; Nikolaou, Konstantin; Geisler, Tobias; Schroeder, Stephen; Bamberg, Fabian

2016-05-01

In recent years, coronary computed tomography angiography has become an increasingly safe and noninvasive modality for the evaluation of the anatomical structure of the coronary artery tree with diagnostic benefits especially in patients with a low-to-intermediate pretest probability of disease. Currently, increasing evidence from large randomized diagnostic trials is accumulating on the diagnostic impact of computed tomography angiography for the management of patients with acute and stable chest pain syndrome. At the same time, technical advances have substantially reduced adverse effects and limiting factors, such as radiation exposure, the amount of iodinated contrast agent, and scanning time, rendering the technique appropriate for broader clinical applications. In this work, we review the latest developments in computed tomography technology and describe the scientific evidence on the use of cardiac computed tomography angiography to evaluate patients with acute and stable chest pain syndrome. Copyright © 2016 Sociedad Española de Cardiología. Published by Elsevier España, S.L.U. All rights reserved.

Automatically quantifying the scientific quality and sensationalism of news records mentioning pandemics: validating a maximum entropy machine-learning model.

PubMed

Hoffman, Steven J; Justicz, Victoria

2016-07-01

To develop and validate a method for automatically quantifying the scientific quality and sensationalism of individual news records. After retrieving 163,433 news records mentioning the Severe Acute Respiratory Syndrome (SARS) and H1N1 pandemics, a maximum entropy model for inductive machine learning was used to identify relationships among 500 randomly sampled news records that correlated with systematic human assessments of their scientific quality and sensationalism. These relationships were then computationally applied to automatically classify 10,000 additional randomly sampled news records. The model was validated by randomly sampling 200 records and comparing human assessments of them to the computer assessments. The computer model correctly assessed the relevance of 86% of news records, the quality of 65% of records, and the sensationalism of 73% of records, as compared to human assessments. Overall, the scientific quality of SARS and H1N1 news media coverage had potentially important shortcomings, but coverage was not too sensationalizing. Coverage slightly improved between the two pandemics. Automated methods can evaluate news records faster, cheaper, and possibly better than humans. The specific procedure implemented in this study can at the very least identify subsets of news records that are far more likely to have particular scientific and discursive qualities. Copyright © 2016 Elsevier Inc. All rights reserved.

High spatial resolution satellite observations for validation of MODIS land products: IKONOS observations acquired under the NASA scientific data purchase.

Treesearch

Jeffrey T. Morisette; Jaime E. Nickeson; Paul Davis; Yujie Wang; Yuhong Tian; Curtis E. Woodcock; Nikolay Shabanov; Matthew Hansen; Warren B. Cohen; Doug R. Oetter; Robert E. Kennedy

2003-01-01

Phase 1I of the Scientific Data Purchase (SDP) has provided NASA investigators access to data from four different satellite and airborne data sources. The Moderate Resolution Imaging Spectrometer (MODIS) land discipline team (MODLAND) sought to utilize these data in support of land product validation activities with a lbcus on tile EOS Land Validation Core Sites. These...

Scientific evidence of dockworker illness to nursing clinical reasoning.

PubMed

Almeida, Marlise Capa Verde de; Cezar-Vaz, Marta Regina

2016-04-01

To identify scientific evidence of occupational illness of dockworkers published in the literature. systematic review of the literature, developed according to the Cochrane method. The databases searched were: Cochrane, LILACS, MEDLINE/PubMed, CINAHL and SciELO. Studies from 1988 to 2014 were selected. The data were analyzed according to the level of evidence and Strengthening the Reporting of Observational Studies in Epidemiology. We included 14 studies, in which 11 (78.6%) were from international journals. The year of 2012 showed greater number of studies. All studies were classified as: Level of Evidence 4, highlighting lung cancer, musculoskeletal and ischemic diseases, causal link in chemical risks. The development of preventive measures should especially include chemical exposure of workers applying the clinical reasoning of nurses' environmental knowledge to care for illnesses. Identificar evidências científicas de adoecimento ocupacional do trabalhador portuário publicadas na literatura. Revisão sistemática da literatura, construída conforme o método Cochrane. As bases de dados pesquisadas foram Cochrane, LILACS, MEDLINE/PubMed, CINAHL e SciELO. Foram selecionados artigos publicados de 1988 a 2014. Os dados foram analisados conforme o Nível de Evidência e Strengthening the Reporting of Observational Studies in Epidemiology. Foram selecionadas 14 publicações, das quais 11 (78,6%) de revistas internacionais. O ano de 2012 reuniu maior número de publicações no período de estudo. Todas as publicações pertenciam ao Nível de Evidência 4, destacando o câncer pulmonar, doenças osteomusculares e isquêmicas, com nexo causal nos riscos químicos. A elaboração de medidas preventivas deve prever especialmente a exposição química do trabalhador, aplicando ao raciocínio clínico do enfermeiro um conhecimento ambiental para a assistência aos adoecimentos.

[Scientific Evidence on Preventive Interventions in Childhood Obesity].

PubMed

Alba-Martín, Raquel

The increasing prevalence of obesity or overweight at all ages, their associated morbidity and mortality associated, and the increased perception of the problem by the society have generated several hypotheses in response to the scientific and the international community. Investigate the preventive interventions in childhood obesity so far. Integrative review during the study period from April 2013 to November 2014. The MEDLINE international database was used, including PubMed, the Cochrane Library (Issue 4 2002), the national database Isooc (CSIC) national database, as well as the Internet. The review included health articles published in Spanish and English between 1990 and 2014 that focused on or included education, prevention, diagnostic, and treatment of obesity interventions. Of the 726 articles identified, 34 of most relevant (peer reviewed) were selected. It was noted that there is limited generisable evidence on interventions that could be implemented in Primary Care or referral services available, although numerous studies suggest that improvements in the overweight are possible. Despite the abundant literature and that many institutions place childhood obesity as one of the priorities of Public Health, we face the paradox that the evidence on cost-effectiveness of prevention interventions is sparse. Knowing these gaps in knowledge should lead to filling them with rigorous and well-designed studies. Copyright © 2016 Asociación Colombiana de Psiquiatría. Publicado por Elsevier España. All rights reserved.

Evidence of Concurrent Validity of SII Scores for Asian American College Students

ERIC Educational Resources Information Center

Hansen, Jo-Ida C.; Lee, W. Vanessa

2007-01-01

The validity of scores on the Strong Interest Inventory (SII) for Asian American college students has not been thoroughly investigated. This study examined the evidence of validity of the SII Occupational Scale scores for predicting college major choices of Asian American women and men and White women and men. The sample included 186 female and…

Assessing mental health clinicians' intentions to adopt evidence-based treatments: reliability and validity testing of the evidence-based treatment intentions scale.

PubMed

Williams, Nathaniel J

2016-05-05

Intentions play a central role in numerous empirically supported theories of behavior and behavior change and have been identified as a potentially important antecedent to successful evidence-based treatment (EBT) implementation. Despite this, few measures of mental health clinicians' EBT intentions exist and available measures have not been subject to thorough psychometric evaluation or testing. This paper evaluates the psychometric properties of the evidence-based treatment intentions (EBTI) scale, a new measure of mental health clinicians' intentions to adopt EBTs. The study evaluates the reliability and validity of inferences made with the EBTI using multi-method, multi-informant criterion variables collected over 12 months from a sample of 197 mental health clinicians delivering services in 13 mental health agencies. Structural, predictive, and discriminant validity evidence is assessed. Findings support the EBTI's factor structure (χ (2) = 3.96, df = 5, p = .556) and internal consistency reliability (α = .80). Predictive validity evidence was provided by robust and significant associations between EBTI scores and clinicians' observer-reported attendance at a voluntary EBT workshop at a 1-month follow-up (OR = 1.92, p < .05), self-reported EBT adoption at a 12-month follow-up (R (2) = .17, p < .001), and self-reported use of EBTs with clients at a 12-month follow-up (R (2) = .25, p < .001). Discriminant validity evidence was provided by small associations with clinicians' concurrently measured psychological work climate perceptions of functionality (R (2) = .06, p < .05), engagement (R (2) = .06, p < .05), and stress (R (2) = .00, ns). The EBTI is a practical and theoretically grounded measure of mental health clinicians' EBT intentions. Scores on the EBTI provide a basis for valid inferences regarding mental health clinicians' intentions to adopt EBTs. Discussion focuses on research and practice applications.

Correcting Systemic Deficiencies in Our Scientific Infrastructure

PubMed Central

Doss, Mohan

2014-01-01

Scientific method is inherently self-correcting. When different hypotheses are proposed, their study would result in the rejection of the invalid ones. If the study of a competing hypothesis is prevented because of the faith in an unverified one, scientific progress is stalled. This has happened in the study of low dose radiation. Though radiation hormesis was hypothesized to reduce cancers in 1980, it could not be studied in humans because of the faith in the unverified linear no-threshold model hypothesis, likely resulting in over 15 million preventable cancer deaths worldwide during the past two decades, since evidence has accumulated supporting the validity of the phenomenon of radiation hormesis. Since our society has been guided by scientific advisory committees that ostensibly follow the scientific method, the long duration of such large casualties is indicative of systemic deficiencies in the infrastructure that has evolved in our society for the application of science. Some of these deficiencies have been identified in a few elements of the scientific infrastructure, and remedial steps suggested. Identifying and correcting such deficiencies may prevent similar tolls in the future. PMID:24910580

Diverse convergent evidence in the genetic analysis of complex disease: coordinating omic, informatic, and experimental evidence to better identify and validate risk factors

PubMed Central

2014-01-01

In omic research, such as genome wide association studies, researchers seek to repeat their results in other datasets to reduce false positive findings and thus provide evidence for the existence of true associations. Unfortunately this standard validation approach cannot completely eliminate false positive conclusions, and it can also mask many true associations that might otherwise advance our understanding of pathology. These issues beg the question: How can we increase the amount of knowledge gained from high throughput genetic data? To address this challenge, we present an approach that complements standard statistical validation methods by drawing attention to both potential false negative and false positive conclusions, as well as providing broad information for directing future research. The Diverse Convergent Evidence approach (DiCE) we propose integrates information from multiple sources (omics, informatics, and laboratory experiments) to estimate the strength of the available corroborating evidence supporting a given association. This process is designed to yield an evidence metric that has utility when etiologic heterogeneity, variable risk factor frequencies, and a variety of observational data imperfections might lead to false conclusions. We provide proof of principle examples in which DiCE identified strong evidence for associations that have established biological importance, when standard validation methods alone did not provide support. If used as an adjunct to standard validation methods this approach can leverage multiple distinct data types to improve genetic risk factor discovery/validation, promote effective science communication, and guide future research directions. PMID:25071867

What should we mean by empirical validation in hypnotherapy: evidence-based practice in clinical hypnosis.

PubMed

Alladin, Assen; Sabatini, Linda; Amundson, Jon K

2007-04-01

This paper briefly surveys the trend of and controversy surrounding empirical validation in psychotherapy. Empirical validation of hypnotherapy has paralleled the practice of validation in psychotherapy and the professionalization of clinical psychology, in general. This evolution in determining what counts as evidence for bona fide clinical practice has gone from theory-driven clinical approaches in the 1960s and 1970s through critical attempts at categorization of empirically supported therapies in the 1990s on to the concept of evidence-based practice in 2006. Implications of this progression in professional psychology are discussed in the light of hypnosis's current quest for validation and empirical accreditation.

Kale (Brassica oleracea var. acephala) as a superfood: Review of the scientific evidence behind the statement.

PubMed

Šamec, Dunja; Urlić, Branimir; Salopek-Sondi, Branka

2018-03-20

Kale (Brassica oleracea var. acephala) is a cruciferous vegetable, characterized by leaves along the stem, which, in recent years, have gained a great popularity as a ´superfood´. Consequently, in a popular culture it is listed in many ´lists of the healthiest vegetables´. Without the doubt, a scientific evidences support the fact that cruciferous vegetables included in human diet can positively affect health and well-being, but remains unclear why kale is declared superior in comparison with other cruciferous. It is questionable if this statement about kale is triggered by scientific evidence or by some other factors. Our review aims to bring an overview of kale's botanical characteristics, agronomic requirements, contemporary and traditional use, macronutrient and phytochemical content and biological activity, in order to point out the reasons for tremendous kale popularity.

Rendering clinical psychology an evidence-based scientific discipline: a case study.

PubMed

St Stoyanov, Drozdstoj; Machamer, Peter K; Schaffner, Kenneth F

2012-02-01

Both modern neuroscience and clinical psychology taken as separate fields have failed to reveal the explanatory mechanisms underlying mental disorders. The evidence acquired inside the mono-disciplinary matrices of neurobiology, clinical psychology and psychopathology are deeply insufficient in terms of their validity, reliability and utility. Further, no effective trans-disciplinary connections have been developed between them. In this context, our case study aims at illustrating some specific facets of clinical psychology as a crucial discipline for explaining and understanding mental disorder. The methods employed in clinical psychology are scrutinized using the exemplar case of the Minnesota Multiphasic Personality Inventory (MMPI). We demonstrate that a clinical interview and a clinical psychological rating scale consist of the same kind of cognitive content. The provisional difference can be described in terms of its having two comparable complementary cognitive structures. The test is composed of self-evaluation reports (items) formulated as questions or statements. The psychopathological structured interview is formulated in terms of subjective experience indicated as symptoms (these are self-reports recorded by the physician), complemented with the so-called 'signs' or the presumably 'objective' observations of the overt behaviours of the patient. However, the cognitive content of clinical judgment is beyond any doubt as subjective as the narrative of the patient. None of the components of the structured psychopathological interview is independent of the inter-subjective system created in the situation of clinical assessment. Therefore, the protocols from various clinicians that serve to sustain the reliability claim of the 'scientific' Diagnostic Statistical Manual of Mental Disorders cannot be regarded as independent measurements of the cognitive content and value of the psychological rating scales or vice versa. © 2011 Blackwell Publishing Ltd.

Arthroplasty knee registry of Catalonia: What scientific evidence supports the implantation of our prosthesis?

PubMed

Samaniego Alonso, R; Gaviria Parada, E; Pons Cabrafiga, M; Espallargues Carreras, M; Martinez Cruz, O

2018-02-28

In our environment, it is increasingly necessary to perform an activity based on scientific evidence and the field of prosthetic surgery should be governed by the same principles. The national arthroplasty registries allow us to obtain a large amount of data in order to evaluate this technique. The aim of our study is to analyse the scientific evidence that supports the primary total knee arthroplasties implanted in Catalonian public hospitals, based on the Arthoplasty Registry of Catalonia (RACat) MATERIAL AND METHODS: A review of the literature was carried out on knee prostheses (cruciate retaining, posterior stabilized, constricted and rotational) recorded in RACat between the period 2005-2013 in the following databases: Orthopedic Data Evaluation Panel, PubMed, TripDatabase and Google Scholar. The prostheses implanted in fewer than 10 units (1,358 prostheses corresponding to 62 models) were excluded. 41,947 prostheses (96.86%) were analysed out of 43,305 implanted, corresponding to 74 different models. In 13 models (n = 4,715) (11.24%) no clinical evidence to support their use was found. In the remaining 36 models (n = 13,609) (32.45%), level iv studies were the most predominant evidence. There was a significant number of implanted prostheses (11.24%) for which no clinical evidence was found. The number of models should be noted, 36 out of 110, with fewer than 10 units implanted. The use of arthroplasty registries has proved an extremely useful tool that allows us to analyse and draw conclusions in order to improve the efficiency of this surgical technique. Copyright © 2018 SECOT. Publicado por Elsevier España, S.L.U. All rights reserved.

Hybrid regimes of knowledge? Challenges for constructing scientific evidence in the context of the GMO-debate.

PubMed

Böschen, Stefan

2009-07-01

Over the last two decades, there has been a remarkable shift of attention to the scientific and political fundamentals of the precautionary principle. The application of this principle has become a main strategy of coping with the different forms and problems related to non-knowledge. Thus, societies are increasingly confronted with the challenging and hitherto unresolved problem of political and technological decision-making under conditions of diverging framings of non-knowledge. At present, there seems to be no generally accepted scientific or institutional approach. This is why the fundamental question of how different scientific actors define and construct evidence is not answered yet. Hence, this paper is based on the consideration that the conflicts in risk policy concerning genetically modified organisms (GMO) depend on the unresolved conflicts about the diverging scientific strategies and structures of evidence-making between the epistemic cultures involved. Thus, this study investigates two questions: (1) do the epistemic strategies of evidence-making differ systematically with the scientific actors involved in the GMO-debate? (2) What consequences emerge considering institutionalized procedures of decision-making? This article is based on a secondary analysis of findings and perspectives reported in the literature and on the methods of qualitative social empirical research, i.e., interviews with experts. A total number of 34 interviews were conducted to explore the different strategies of handling non-knowledge and constructing evidence. Actors from science, administration, business and NGOs were interviewed. In this way, typical epistemic cultures can be described. An epistemic culture is the constellation of methodological strategies, theoretical assumptions and practical-experimental settings which define in every speciality the ways how we know what we know. There are two main results. Firstly, it was worked out that the epistemic cultures involved

Critical validation studies of neurofeedback.

PubMed

Gruzelier, John; Egner, Tobias

2005-01-01

The field of neurofeedback training has proceeded largely without validation. In this article the authors review studies directed at validating sensory motor rhythm, beta and alpha-theta protocols for improving attention, memory, and music performance in healthy participants. Importantly, benefits were demonstrable with cognitive and neurophysiologic measures that were predicted on the basis of regression models of learning to enhance sensory motor rhythm and beta activity. The first evidence of operant control over the alpha-theta ratio is provided, together with remarkable improvements in artistic aspects of music performance equivalent to two class grades in conservatory students. These are initial steps in providing a much needed scientific basis to neurofeedback.

Expert opinions and scientific evidence for colonoscopy key performance indicators.

PubMed

Rees, Colin J; Bevan, Roisin; Zimmermann-Fraedrich, Katharina; Rutter, Matthew D; Rex, Douglas; Dekker, Evelien; Ponchon, Thierry; Bretthauer, Michael; Regula, Jaroslaw; Saunders, Brian; Hassan, Cesare; Bourke, Michael J; Rösch, Thomas

2016-12-01

Colonoscopy is a widely performed procedure with procedural volumes increasing annually throughout the world. Many procedures are now performed as part of colorectal cancer screening programmes. Colonoscopy should be of high quality and measures of this quality should be evidence based. New UK key performance indicators and quality assurance standards have been developed by a working group with consensus agreement on each standard reached. This paper reviews the scientific basis for each of the quality measures published in the UK standards. Published by the BMJ Publishing Group Limited. For permission to use (where not already granted under a licence) please go to http://www.bmj.com/company/products-services/rights-and-licensing/.

Exploration of Korean Students' Scientific Imagination Using the Scientific Imagination Inventory

NASA Astrophysics Data System (ADS)

Mun, Jiyeong; Mun, Kongju; Kim, Sung-Won

2015-09-01

This article reports on the study of the components of scientific imagination and describes the scales used to measure scientific imagination in Korean elementary and secondary students. In this study, we developed an inventory, which we call the Scientific Imagination Inventory (SII), in order to examine aspects of scientific imagination. We identified three conceptual components of scientific imagination, which were composed of (1) scientific sensitivity, (2) scientific creativity, and (3) scientific productivity. We administered SII to 662 students (4th-8th grades) and confirmed validity and reliability using exploratory factor analysis and Cronbach α coefficient. The characteristics of Korean elementary and secondary students' overall scientific imagination and difference across gender and grade level are discussed in the results section.

Effects of Scaffolds and Scientific Reasoning Ability on Web-Based Scientific Inquiry

ERIC Educational Resources Information Center

Wu, Hui-Ling; Weng, Hsiao-Lan; She, Hsiao-Ching

2016-01-01

This study examined how background knowledge, scientific reasoning ability, and various scaffolding forms influenced students' science knowledge and scientific inquiry achievements. The students participated in an online scientific inquiry program involving such activities as generating scientific questions and drawing evidence-based conclusions,…

Validity Evidence for Games as Assessment Environments. CRESST Report 773

ERIC Educational Resources Information Center

Delacruz, Girlie C.; Chung, Gregory K. W. K.; Baker, Eva L.

2010-01-01

This study provides empirical evidence of a highly specific use of games in education--the assessment of the learner. Linear regressions were used to examine the predictive and convergent validity of a math game as assessment of mathematical understanding. Results indicate that prior knowledge significantly predicts game performance. Results also…

The Online Student Connectedness Survey: Evidence of Initial Construct Validity

ERIC Educational Resources Information Center

Zimmerman, Tekeisha; Nimon, Kim

2017-01-01

The Online Student Connectedness Survey (OSCS) was introduced to the academic community in 2012 as an instrument designed to measure feelings of connectedness between students participating in online degree and certification programs. The purpose of this study was to examine data from the instrument for initial evidence of validity and reliability…

Examination of the "CSI Effect" on Perceptions of Scientific and Testimonial Evidence in a Hong Kong Chinese Sample.

PubMed

Hui, Cora Y T; Lo, T Wing

2017-05-01

Television is a powerful medium through which to convey information and messages to the public. The recent proliferation of forensic science and criminal justice information throughout all forms of media, coupled with raised expectations toward forensic evidence, has led some to suspect that a "CSI effect" ( Crime Scene Investigation effect) is taking place. The present study contributes to the literature addressing the CSI effect in two ways. First, it examines whether the CSI effect exists in the Chinese population of Hong Kong. Second, using a mock-jury paradigm, it empirically examines a more integrative perspective of the CSI effect. It was found that, although the amount of media coverage involving forensic evidence does influence participants' perception of legal evidence to some degree, such a perception does not affect participants' legal decision making. Viewers of forensic dramas were not more likely to convict the defendant when forensic evidence was presented and not less likely to convict when only testimonial evidence was presented. The only significant predictor of the defendant's culpability when scientific evidence was presented was participants' ratings of the reliability of scientific evidence. Results from the present study lend no support to the existence of the CSI effect in Hong Kong.

Quantifying falsifiability of scientific theories

NASA Astrophysics Data System (ADS)

Nemenman, Ilya

I argue that the notion of falsifiability, a key concept in defining a valid scientific theory, can be quantified using Bayesian Model Selection, which is a standard tool in modern statistics. This relates falsifiability to the quantitative version of the statistical Occam's razor, and allows transforming some long-running arguments about validity of scientific theories from philosophical discussions to rigorous mathematical calculations.

Pseudomonas aeruginosa infection in patients with cystic fibrosis: scientific evidence regarding clinical impact, diagnosis, and treatment*

PubMed Central

da Silva, Luiz Vicente Ribeiro Ferreira; Ferreira, Flavia de Aguiar; Reis, Francisco José Caldeira; de Britto, Murilo Carlos Amorim; Levy, Carlos Emilio; Clark, Otavio; Ribeiro, José Dirceu

2013-01-01

Evidence-based techniques have been increasingly used in the creation of clinical guidelines and the development of recommendations for medical practice. The use of levels of evidence allows the reader to identify the quality of scientific information that supports the recommendations made by experts. The objective of this review was to address current concepts related to the clinical impact, diagnosis, and treatment of Pseudomonas aeruginosa infections in patients with cystic fibrosis. For the preparation of this review, the authors defined a group of questions that would be answered in accordance with the principles of PICO–an acronym based on questions regarding the Patients of interest, Intervention being studied, Comparison of the intervention, and Outcome of interest. For each question, a structured review of the literature was performed using the Medline database in order to identify the studies with the methodological design most appropriate to answering the question. The questions were designed so that each of the authors could write a response. A first draft was prepared and discussed by the group. Recommendations were then made on the basis of the level of scientific evidence, in accordance with the classification system devised by the Oxford Centre for Evidence-Based Medicine, as well as the level of agreement among the members of the group. PMID:24068273

Improved classification of evidence for EMF health risks.

PubMed

Leitgeb, Norbert

2012-08-01

Classifying evidence of causality between a risk factor and its potential health effect is challenging, in particular in an already emotional situation. Even the assessment of health risks by designated bodies may still depend on their composition of individuals with their background, bias, and, in worst case, their interests. This may explain opposing conclusions from the same pool of data which, consequently, may undermine credibility if not communicated properly. To overcome existing weakness in classifying and communicating evidence of health risks such as from electromagnetic fields, a new rule-based approach is presented. Developed by the German Commission on Radiological Protection (SSK), it discloses step-by-step the criteria for weighing scientific data and pools partial evidences of different scientific approaches to conclude on the overall evidence of causality between risk factor and effects. The validity of the approach is demonstrated by analyzing evidence of carcinogenicity of ionizing radiation, mobile phone use, and nocturnal exposure to visible light.

[Workplace violence in Latin America: A review of the scientific evidence].

PubMed

Ansoleaga, Elisa; Gómez-Rubio, Constanza; Mauro, Amalia

2015-01-01

Workplace Violence has acquired social relevance given the evidence regarding there its health consequences. Has identified various effects such as mood disorders and sleep disorders, hostility, isolation, insecurity, among others. To describe and analyze scientific evidence published on workplace violence in studies in Latin American countries between 2009 and 2014. A descriptive and quantitative study. A search was made on the basis of Academic Search Complete (EBSCOhost) Academic Source Premier, PSICODOC, Scielo.org, JSTOR and SCOPUS. And indexed empirical studies were considered. We worked with 46 selected articles. The studies showed a higher amount of psychological violence at work, with a potential risk in women and health professionals. Also, the analysis categories were the most reported behaviors that express violence, health implications and facilitators. The literature on the study of workplace violence in Latin America is recent. Items are descriptive, interpretative studies with insufficient or analytical nature. Health personnel, particularly women, have conditions of vulnerability, with relevance with regard to sexual harassment, wage inequality and bullying.

The effect of scientific evidence on conservation practitioners’ management decisions

PubMed Central

Walsh, Jessica C; Dicks, Lynn V; Sutherland, William J

2015-01-01

A major justification of environmental management research is that it helps practitioners, yet previous studies show it is rarely used to inform their decisions. We tested whether conservation practitioners focusing on bird management were willing to use a synopsis of relevant scientific literature to inform their management decisions. This allowed us to examine whether the limited use of scientific information in management is due to a lack of access to the scientific literature or whether it is because practitioners are either not interested or unable to incorporate the research into their decisions. In on-line surveys, we asked 92 conservation managers, predominantly from Australia, New Zealand, and the United Kingdom, to provide opinions on 28 management techniques that could be applied to reduce predation on birds. We asked their opinions before and after giving them a summary of the literature about the interventions’ effectiveness. We scored the overall effectiveness and certainty of evidence for each intervention through an expert elicitation process—the Delphi method. We used the effectiveness scores to assess the practitioners’ level of understanding and awareness of the literature. On average, each survey participant changed their likelihood of using 45.7% of the interventions after reading the synopsis of the evidence. They were more likely to implement effective interventions and avoid ineffective actions, suggesting that their intended future management strategies may be more successful than current practice. More experienced practitioners were less likely to change their management practices than those with less experience, even though they were not more aware of the existing scientific information than less experienced practitioners. The practitioners’ willingness to change their management choices when provided with summarized scientific evidence suggests that improved accessibility to scientific information would benefit conservation

Concussions: What a neurosurgeon should know about current scientific evidence and management strategies.

PubMed

Neal, Matthew T; Wilson, Jonathan L; Hsu, Wesley; Powers, Alexander K

2012-01-01

There has been a tremendous amount of interest focused on the topic of concussions over the past few decades. Neurosurgeons are frequently consulted to manage patients with mild traumatic brain injuries (mTBI) that have radiographic evidence of cerebral injury. These injuries share significant overlap with concussions, injuries that typically do not reveal radiographic evidence of structural injury, in the realms of epidemiology, pathophysiology, outcomes, and management. Further, neurosurgeons often manage patients with extracranial injuries that have concomitant concussions. In these cases, neurosurgeons are often the only "concussion experts" that patients encounter. The literature has been reviewed and data have been synthesized on the topic including sections on historical background, epidemiology, pathophysiology, diagnostic advances, clinical sequelae, and treatment suggestions, with neurosurgeons as the intended target audience. Neurosurgeons should have a fundamental knowledge of the scientific evidence that has developed regarding concussions and be prepared to guide patients with treatment plans.

Design and Validation of a Rubric to Assess the Use of American Psychological Association Style in Scientific Articles

ERIC Educational Resources Information Center

Merma Molina, Gladys; Peña Alfaro, Hilda; Peña Alfaro González, Silvia Rosa

2017-01-01

In this study, the researchers will explore the process of designing and validating a rubric to evaluate the adaptation of scientific articles in the format of the "American Psychological Association" (APA). The rubric will evaluate certain aspects of the APA format that allow authors, editors, and evaluators to decide if the scientific…

Scientific Data and Its Limits: Rethinking the Use of Evidence in Local Climate Change Policy

ERIC Educational Resources Information Center

Pearce, Warren

2014-01-01

Climate policy is typically seen as informed by scientific evidence that anthropogenic carbon emissions require reducing in order to avoid dangerous consequences. However, agreement on these matters has not translated into effective policy. Using interviews with local authority officials in the UK's East Midlands region, this paper argues that the…

A guideline for the validation of likelihood ratio methods used for forensic evidence evaluation.

PubMed

Meuwly, Didier; Ramos, Daniel; Haraksim, Rudolf

2017-07-01

This Guideline proposes a protocol for the validation of forensic evaluation methods at the source level, using the Likelihood Ratio framework as defined within the Bayes' inference model. In the context of the inference of identity of source, the Likelihood Ratio is used to evaluate the strength of the evidence for a trace specimen, e.g. a fingermark, and a reference specimen, e.g. a fingerprint, to originate from common or different sources. Some theoretical aspects of probabilities necessary for this Guideline were discussed prior to its elaboration, which started after a workshop of forensic researchers and practitioners involved in this topic. In the workshop, the following questions were addressed: "which aspects of a forensic evaluation scenario need to be validated?", "what is the role of the LR as part of a decision process?" and "how to deal with uncertainty in the LR calculation?". The questions: "what to validate?" focuses on the validation methods and criteria and "how to validate?" deals with the implementation of the validation protocol. Answers to these questions were deemed necessary with several objectives. First, concepts typical for validation standards [1], such as performance characteristics, performance metrics and validation criteria, will be adapted or applied by analogy to the LR framework. Second, a validation strategy will be defined. Third, validation methods will be described. Finally, a validation protocol and an example of validation report will be proposed, which can be applied to the forensic fields developing and validating LR methods for the evaluation of the strength of evidence at source level under the following propositions. Copyright © 2016. Published by Elsevier B.V.

Racism and Health I: Pathways and Scientific Evidence.

PubMed

Williams, David R; Mohammed, Selina A

2013-08-01

This article reviews the scientific research that indicates that despite marked declines in public support for negative racial attitudes in the United States, racism, in its multiple forms, remains embedded in American society. The focus of the article is on the review of empirical research that suggests that racism adversely affects the health of non-dominant racial populations in multiple ways. First, institutional racism developed policies and procedures that have reduced access to housing, neighborhood and educational quality, employment opportunities and other desirable resources in society. Second, cultural racism, at the societal and individual level, negatively affects economic status and health by creating a policy environment hostile to egalitarian policies, triggering negative stereotypes and discrimination that are pathogenic and fostering health damaging psychological responses such as stereotype threat and internalized racism. Finally, a large and growing body of evidence indicates that experiences of racial discrimination are an important type of psychosocial stressor that can lead to adverse changes in health status and altered behavioural patterns that increase health risks.

Racism and Health I: Pathways and Scientific Evidence

PubMed Central

Williams, David R.; Mohammed, Selina A.

2013-01-01

This article reviews the scientific research that indicates that despite marked declines in public support for negative racial attitudes in the United States, racism, in its multiple forms, remains embedded in American society. The focus of the article is on the review of empirical research that suggests that racism adversely affects the health of non-dominant racial populations in multiple ways. First, institutional racism developed policies and procedures that have reduced access to housing, neighborhood and educational quality, employment opportunities and other desirable resources in society. Second, cultural racism, at the societal and individual level, negatively affects economic status and health by creating a policy environment hostile to egalitarian policies, triggering negative stereotypes and discrimination that are pathogenic and fostering health damaging psychological responses such as stereotype threat and internalized racism. Finally, a large and growing body of evidence indicates that experiences of racial discrimination are an important type of psychosocial stressor that can lead to adverse changes in health status and altered behavioural patterns that increase health risks. PMID:24347666

Reliability and Validity of the Evidence-Based Practice Confidence (EPIC) Scale

ERIC Educational Resources Information Center

Salbach, Nancy M.; Jaglal, Susan B.; Williams, Jack I.

2013-01-01

Introduction: The reliability, minimal detectable change (MDC), and construct validity of the evidence-based practice confidence (EPIC) scale were evaluated among physical therapists (PTs) in clinical practice. Methods: A longitudinal mail survey was conducted. Internal consistency and test-retest reliability were estimated using Cronbach's alpha…

easyCBM® Reading Criterion Related Validity Evidence: Grades K-1. Technical Report #1309

ERIC Educational Resources Information Center

Lai, Cheng-Fei; Alonzo, Julie; Tindal, Gerald

2013-01-01

In this technical report, we present the results of a study to gather criterion-related evidence for Grade K-1 easyCBM® reading measures. We used correlations to examine the relation between the easyCBM® measures and other published measures with known reliability and validity evidence, including the Dynamic Indicators of Basic Early Literacy…

The development of scientific thinking in elementary school: a comprehensive inventory.

PubMed

Koerber, Susanne; Mayer, Daniela; Osterhaus, Christopher; Schwippert, Knut; Sodian, Beate

2015-01-01

The development of scientific thinking was assessed in 1,581 second, third, and fourth graders (8-, 9-, 10-year-olds) based on a conceptual model that posits developmental progression from naïve to more advanced conceptions. Using a 66-item scale, five components of scientific thinking were addressed, including experimental design, data interpretation, and understanding the nature of science. Unidimensional and multidimensional item response theory analyses supported the instrument's reliability and validity and suggested that the multiple components of scientific thinking form a unitary construct, independent of verbal or reasoning skills. A partial credit model gave evidence for a hierarchical developmental progression. Across each grade transition, advanced conceptions increased while naïve conceptions decreased. Independent effects of intelligence, schooling, and parental education on scientific thinking are discussed. © 2014 The Authors. Child Development © 2014 Society for Research in Child Development, Inc.

Concussions: What a neurosurgeon should know about current scientific evidence and management strategies

PubMed Central

Neal, Matthew T.; Wilson, Jonathan L.; Hsu, Wesley; Powers, Alexander K.

2012-01-01

Background: There has been a tremendous amount of interest focused on the topic of concussions over the past few decades. Neurosurgeons are frequently consulted to manage patients with mild traumatic brain injuries (mTBI) that have radiographic evidence of cerebral injury. These injuries share significant overlap with concussions, injuries that typically do not reveal radiographic evidence of structural injury, in the realms of epidemiology, pathophysiology, outcomes, and management. Further, neurosurgeons often manage patients with extracranial injuries that have concomitant concussions. In these cases, neurosurgeons are often the only “concussion experts” that patients encounter. Results: The literature has been reviewed and data have been synthesized on the topic including sections on historical background, epidemiology, pathophysiology, diagnostic advances, clinical sequelae, and treatment suggestions, with neurosurgeons as the intended target audience. Conclusions: Neurosurgeons should have a fundamental knowledge of the scientific evidence that has developed regarding concussions and be prepared to guide patients with treatment plans. PMID:22439107

Cluster analysis of novel isometric strength measures produces a valid and evidence-based classification structure for wheelchair track racing.

PubMed

Connick, Mark J; Beckman, Emma; Vanlandewijck, Yves; Malone, Laurie A; Blomqvist, Sven; Tweedy, Sean M

2017-11-25

The Para athletics wheelchair-racing classification system employs best practice to ensure that classes comprise athletes whose impairments cause a comparable degree of activity limitation. However, decision-making is largely subjective and scientific evidence which reduces this subjectivity is required. To evaluate whether isometric strength tests were valid for the purposes of classifying wheelchair racers and whether cluster analysis of the strength measures produced a valid classification structure. Thirty-two international level, male wheelchair racers from classes T51-54 completed six isometric strength tests evaluating elbow extensors, shoulder flexors, trunk flexors and forearm pronators and two wheelchair performance tests-Top-Speed (0-15 m) and Top-Speed (absolute). Strength tests significantly correlated with wheelchair performance were included in a cluster analysis and the validity of the resulting clusters was assessed. All six strength tests correlated with performance (r=0.54-0.88). Cluster analysis yielded four clusters with reasonable overall structure (mean silhouette coefficient=0.58) and large intercluster strength differences. Six athletes (19%) were allocated to clusters that did not align with their current class. While the mean wheelchair racing performance of the resulting clusters was unequivocally hierarchical, the mean performance of current classes was not, with no difference between current classes T53 and T54. Cluster analysis of isometric strength tests produced classes comprising athletes who experienced a similar degree of activity limitation. The strength tests reported can provide the basis for a new, more transparent, less subjective wheelchair racing classification system, pending replication of these findings in a larger, representative sample. This paper also provides guidance for development of evidence-based systems in other Para sports. © Article author(s) (or their employer(s) unless otherwise stated in the text of

Do short courses in evidence based medicine improve knowledge and skills? Validation of Berlin questionnaire and before and after study of courses in evidence based medicine

PubMed Central

Fritsche, L; Greenhalgh, T; Falck-Ytter, Y; Neumayer, H-H; Kunz, R

2002-01-01

Objective To develop and validate an instrument for measuring knowledge and skills in evidence based medicine and to investigate whether short courses in evidence based medicine lead to a meaningful increase in knowledge and skills. Design Development and validation of an assessment instrument and before and after study. Setting Various postgraduate short courses in evidence based medicine in Germany. Participants The instrument was validated with experts in evidence based medicine, postgraduate doctors, and medical students. The effect of courses was assessed by postgraduate doctors from medical and surgical backgrounds. Intervention Intensive 3 day courses in evidence based medicine delivered through tutor facilitated small groups. Main outcome measure Increase in knowledge and skills. Results The questionnaire distinguished reliably between groups with different expertise in evidence based medicine. Experts attained a threefold higher average score than students. Postgraduates who had not attended a course performed better than students but significantly worse than experts. Knowledge and skills in evidence based medicine increased after the course by 57% (mean score before course 6.3 (SD 2.9) v 9.9 (SD 2.8), P<0.001). No difference was found among experts or students in absence of an intervention. Conclusions The instrument reliably assessed knowledge and skills in evidence based medicine. An intensive 3 day course in evidence based medicine led to a significant increase in knowledge and skills. What is already known on this topicNumerous observational studies have investigated the impact of teaching evidence based medicine to healthcare professionals, with conflicting resultsMost of the studies were of poor methodological qualityWhat this study addsAn instrument assessing basic knowledge and skills required for practising evidence based medicine was developed and validatedAn intensive 3 day course on evidence based medicine for doctors from various backgrounds

Articulating uncertainty as part of scientific argumentation during model-based exoplanet detection tasks

NASA Astrophysics Data System (ADS)

Lee, Hee-Sun; Pallant, Amy; Pryputniewicz, Sarah

2015-08-01

Teaching scientific argumentation has emerged as an important goal for K-12 science education. In scientific argumentation, students are actively involved in coordinating evidence with theory based on their understanding of the scientific content and thinking critically about the strengths and weaknesses of the cited evidence in the context of the investigation. We developed a one-week-long online curriculum module called "Is there life in space?" where students conduct a series of four model-based tasks to learn how scientists detect extrasolar planets through the “wobble” and transit methods. The simulation model allows students to manipulate various parameters of an imaginary star and planet system such as planet size, orbit size, planet-orbiting-plane angle, and sensitivity of telescope equipment, and to adjust the display settings for graphs illustrating the relative velocity and light intensity of the star. Students can use model-based evidence to formulate an argument on whether particular signals in the graphs guarantee the presence of a planet. Students' argumentation is facilitated by the four-part prompts consisting of multiple-choice claim, open-ended explanation, Likert-scale uncertainty rating, and open-ended uncertainty rationale. We analyzed 1,013 scientific arguments formulated by 302 high school student groups taught by 7 teachers. We coded these arguments in terms of the accuracy of their claim, the sophistication of explanation connecting evidence to the established knowledge base, the uncertainty rating, and the scientific validity of uncertainty. We found that (1) only 18% of the students' uncertainty rationale involved critical reflection on limitations inherent in data and concepts, (2) 35% of students' uncertainty rationale reflected their assessment of personal ability and knowledge, rather than scientific sources of uncertainty related to the evidence, and (3) the nature of task such as the use of noisy data or the framing of

Cloud computing and validation of expandable in silico livers

PubMed Central

2010-01-01

Background In Silico Livers (ISLs) are works in progress. They are used to challenge multilevel, multi-attribute, mechanistic hypotheses about the hepatic disposition of xenobiotics coupled with hepatic responses. To enhance ISL-to-liver mappings, we added discrete time metabolism, biliary elimination, and bolus dosing features to a previously validated ISL and initiated re-validated experiments that required scaling experiments to use more simulated lobules than previously, more than could be achieved using the local cluster technology. Rather than dramatically increasing the size of our local cluster we undertook the re-validation experiments using the Amazon EC2 cloud platform. So doing required demonstrating the efficacy of scaling a simulation to use more cluster nodes and assessing the scientific equivalence of local cluster validation experiments with those executed using the cloud platform. Results The local cluster technology was duplicated in the Amazon EC2 cloud platform. Synthetic modeling protocols were followed to identify a successful parameterization. Experiment sample sizes (number of simulated lobules) on both platforms were 49, 70, 84, and 152 (cloud only). Experimental indistinguishability was demonstrated for ISL outflow profiles of diltiazem using both platforms for experiments consisting of 84 or more samples. The process was analogous to demonstration of results equivalency from two different wet-labs. Conclusions The results provide additional evidence that disposition simulations using ISLs can cover the behavior space of liver experiments in distinct experimental contexts (there is in silico-to-wet-lab phenotype similarity). The scientific value of experimenting with multiscale biomedical models has been limited to research groups with access to computer clusters. The availability of cloud technology coupled with the evidence of scientific equivalency has lowered the barrier and will greatly facilitate model sharing as well as provide

Cloud computing and validation of expandable in silico livers.

PubMed

Ropella, Glen E P; Hunt, C Anthony

2010-12-03

In Silico Livers (ISLs) are works in progress. They are used to challenge multilevel, multi-attribute, mechanistic hypotheses about the hepatic disposition of xenobiotics coupled with hepatic responses. To enhance ISL-to-liver mappings, we added discrete time metabolism, biliary elimination, and bolus dosing features to a previously validated ISL and initiated re-validated experiments that required scaling experiments to use more simulated lobules than previously, more than could be achieved using the local cluster technology. Rather than dramatically increasing the size of our local cluster we undertook the re-validation experiments using the Amazon EC2 cloud platform. So doing required demonstrating the efficacy of scaling a simulation to use more cluster nodes and assessing the scientific equivalence of local cluster validation experiments with those executed using the cloud platform. The local cluster technology was duplicated in the Amazon EC2 cloud platform. Synthetic modeling protocols were followed to identify a successful parameterization. Experiment sample sizes (number of simulated lobules) on both platforms were 49, 70, 84, and 152 (cloud only). Experimental indistinguishability was demonstrated for ISL outflow profiles of diltiazem using both platforms for experiments consisting of 84 or more samples. The process was analogous to demonstration of results equivalency from two different wet-labs. The results provide additional evidence that disposition simulations using ISLs can cover the behavior space of liver experiments in distinct experimental contexts (there is in silico-to-wet-lab phenotype similarity). The scientific value of experimenting with multiscale biomedical models has been limited to research groups with access to computer clusters. The availability of cloud technology coupled with the evidence of scientific equivalency has lowered the barrier and will greatly facilitate model sharing as well as provide straightforward tools for scaling

easyCBM® Reading Criterion Related Validity Evidence: Grades 2-5. Technical Report #1310

ERIC Educational Resources Information Center

Lai, Cheng-Fei; Alonzo, Julie; Tindal, Gerald

2013-01-01

In this technical report, we present the results of a study to gather criterion-related evidence for Grade 2-5 easyCBM® reading measures. We used correlations to examine the relation between the easyCBM® measures and other published measures with known reliability and validity evidence, including the Gates-MacGinitie Reading Tests and the Dynamic…

Developing a Test of Scientific Literacy Skills (TOSLS): measuring undergraduates' evaluation of scientific information and arguments.

PubMed

Gormally, Cara; Brickman, Peggy; Lutz, Mary

2012-01-01

Life sciences faculty agree that developing scientific literacy is an integral part of undergraduate education and report that they teach these skills. However, few measures of scientific literacy are available to assess students' proficiency in using scientific literacy skills to solve scenarios in and beyond the undergraduate biology classroom. In this paper, we describe the development, validation, and testing of the Test of Scientific Literacy Skills (TOSLS) in five general education biology classes at three undergraduate institutions. The test measures skills related to major aspects of scientific literacy: recognizing and analyzing the use of methods of inquiry that lead to scientific knowledge and the ability to organize, analyze, and interpret quantitative data and scientific information. Measures of validity included correspondence between items and scientific literacy goals of the National Research Council and Project 2061, findings from a survey of biology faculty, expert biology educator reviews, student interviews, and statistical analyses. Classroom testing contexts varied both in terms of student demographics and pedagogical approaches. We propose that biology instructors can use the TOSLS to evaluate their students' proficiencies in using scientific literacy skills and to document the impacts of curricular reform on students' scientific literacy.

Developing a Test of Scientific Literacy Skills (TOSLS): Measuring Undergraduates’ Evaluation of Scientific Information and Arguments

PubMed Central

Gormally, Cara; Brickman, Peggy; Lutz, Mary

2012-01-01

Life sciences faculty agree that developing scientific literacy is an integral part of undergraduate education and report that they teach these skills. However, few measures of scientific literacy are available to assess students’ proficiency in using scientific literacy skills to solve scenarios in and beyond the undergraduate biology classroom. In this paper, we describe the development, validation, and testing of the Test of Scientific Literacy Skills (TOSLS) in five general education biology classes at three undergraduate institutions. The test measures skills related to major aspects of scientific literacy: recognizing and analyzing the use of methods of inquiry that lead to scientific knowledge and the ability to organize, analyze, and interpret quantitative data and scientific information. Measures of validity included correspondence between items and scientific literacy goals of the National Research Council and Project 2061, findings from a survey of biology faculty, expert biology educator reviews, student interviews, and statistical analyses. Classroom testing contexts varied both in terms of student demographics and pedagogical approaches. We propose that biology instructors can use the TOSLS to evaluate their students’ proficiencies in using scientific literacy skills and to document the impacts of curricular reform on students’ scientific literacy. PMID:23222832

Scientific Evidence-Based Effects of Hydrotherapy on Various Systems of the Body

PubMed Central

Mooventhan, A; Nivethitha, L

2014-01-01

The use of water for various treatments (hydrotherapy) is probably as old as mankind. Hydrotherapy is one of the basic methods of treatment widely used in the system of natural medicine, which is also called as water therapy, aquatic therapy, pool therapy, and balneotherapy. Use of water in various forms and in various temperatures can produce different effects on different system of the body. Many studies/reviews reported the effects of hydrotherapy only on very few systems and there is lack of studies/reviews in reporting the evidence-based effects of hydrotherapy on various systems. We performed PubMed and PubMed central search to review relevant articles in English literature based on “effects of hydrotherapy/balneotherapy” on various systems of the body. Based on the available literature this review suggests that the hydrotherapy has a scientific evidence-based effect on various systems of the body. PMID:24926444

Scientific evidence-based effects of hydrotherapy on various systems of the body.

PubMed

Mooventhan, A; Nivethitha, L

2014-05-01

The use of water for various treatments (hydrotherapy) is probably as old as mankind. Hydrotherapy is one of the basic methods of treatment widely used in the system of natural medicine, which is also called as water therapy, aquatic therapy, pool therapy, and balneotherapy. Use of water in various forms and in various temperatures can produce different effects on different system of the body. Many studies/reviews reported the effects of hydrotherapy only on very few systems and there is lack of studies/reviews in reporting the evidence-based effects of hydrotherapy on various systems. We performed PubMed and PubMed central search to review relevant articles in English literature based on "effects of hydrotherapy/balneotherapy" on various systems of the body. Based on the available literature this review suggests that the hydrotherapy has a scientific evidence-based effect on various systems of the body.

Environmental risk, precaution, and scientific rationality in the context of WTO/NAFTA trade rules.

PubMed

Crawford-Brown, Douglas; Pauwelyn, Joost; Smith, Kelly

2004-04-01

This article considers the role of scientific rationality in understanding statements of risk produced by a scientific community. An argument is advanced that, while scientific rationality does impose constraints on valid scientific justifications for restrictions on products and practices, it also provides flexibility in the judgments needed to both develop and apply characterizations of risk. The implications of this flexibility for the understanding of risk estimates in WTO and NAFTA deliberations are explored, with the goal of finding an intermediate ground between the view that science unambiguously justifies or rejects a policy, and the view that science is yet another cultural tool that can be manipulated in support of any decision. The result is a proposal for a dialogical view of scientific rationality in which risk estimates are depicted as confidence distributions that follow from a structured dialogue of scientific panels focused on judgments of evidence, evidential reasoning, and epistemic analysis.

Teaching argumentation and scientific discourse using the ribosomal peptidyl transferase reaction.

PubMed

Johnson, R Jeremy

2011-01-01

Argumentation and discourse are two integral parts of scientific investigation that are often overlooked in undergraduate science education. To address this limitation, the story of peptide bond formation by the ribosome can be used to illustrate the importance of evidence, claims, arguments, and counterarguments in scientific discourse. With the determination of the first structure of the large ribosomal subunit bound to a transition state inhibitor came an initial hypothesis about the role of the ribosome in peptide bond formation. This initial hypothesis was based on a few central assumptions about the transition state mimic and acid-base catalysis by serine proteases. The initial proposed mechanism started a flurry of scientific discourse in experimental articles and commentaries that tested the validity of the initial proposed mechanism. Using this civil argumentation as a guide, class discussions, assignments, and a debate were designed that allow students to analyze and question the claims and evidence about the mechanism of peptide bond synthesis. In the end, students develop a sense of critical skepticism, and an understanding of scientific discourse, while learning about the current consensus mechanism for peptide bond synthesis. Biochemistry and Molecular Biology Education Vol. 39, No. 3, pp. 185-190, 2011. Copyright © 2011 Wiley Periodicals, Inc.

Logic Brightens My Day: Evidence for Implicit Sensitivity to Logical Validity

ERIC Educational Resources Information Center

Trippas, Dries; Handley, Simon J.; Verde, Michael F.; Morsanyi, Kinga

2016-01-01

A key assumption of dual process theory is that reasoning is an explicit, effortful, deliberative process. The present study offers evidence for an implicit, possibly intuitive component of reasoning. Participants were shown sentences embedded in logically valid or invalid arguments. Participants were not asked to reason but instead rated the…

An Australian Version of the Neighborhood Environment Walkability Scale: Validity Evidence

ERIC Educational Resources Information Center

Cerin, Ester; Leslie, Eva; Owen, Neville; Bauman, Adrian

2008-01-01

This study examined validity evidence for the Australian version of the Neighborhood Environment Walkability Scale (NEWS-AU). A stratified two-stage cluster sampling design was used to recruit 2,650 adults from Adelaide (Australia). The sample was drawn from residential addresses within eight high-walkable and eight low-walkable suburbs matched…

[Handbook for the preparation of evidence-based documents. Tools derived from scientific knowledge].

PubMed

Carrión-Camacho, M R; Martínez-Brocca, M A; Paneque-Sánchez-Toscano, I; Valencia-Martín, R; Palomino-García, A; Muñoz-Durán, C; Tamayo-López, M J; González-Eiris-Delgado, C; Otero-Candelera, R; Ortega-Ruiz, F; Sobrino-Márquez, J M; Jiménez-García-Bóveda, R; Fernández-Quero, M; Campos-Pareja, A M

2013-01-01

This handbook is intended to be an accessible, easy-to-consult guide to help professionals produce or adapt Evidence-Based Documents. Such documents will help standardize both clinical practice and decision-making, the quality always being monitored in such a way that established references are complied with. Evidence-Based Health Care Committee, a member of "Virgen del Rocío" University Hospital quality structure, proposed the preparation of a handbook to produce Evidence-Based Documents including: a description of products, characteristics, qualities, uses, methodology of production, and application scope of every one of them. The handbook consists of seven Evidence-Based tools, one chapter on critical analysis methodology of scientific literature, one chapter with internet resources, and some appendices with different assessment tools. This Handbook provides general practitioners with a great opportunity to improve quality and as a guideline to standardize clinical healthcare, and managers with a strategy to promote and encourage the development of documents in an effort to reduce clinical practice variability, as well as giving patients the opportunity of taking part in planning their own care. Copyright © 2011 SECA. Published by Elsevier Espana. All rights reserved.

Patient-Reported Outcome Measures for Hand and Wrist Trauma: Is There Sufficient Evidence of Reliability, Validity, and Responsiveness?

PubMed

Dacombe, Peter Jonathan; Amirfeyz, Rouin; Davis, Tim

2016-03-01

Patient-reported outcome measures (PROMs) are important tools for assessing outcomes following injuries to the hand and wrist. Many commonly used PROMs have no evidence of reliability, validity, and responsiveness in a hand and wrist trauma population. This systematic review examines the PROMs used in the assessment of hand and wrist trauma patients, and the evidence for reliability, validity, and responsiveness of each measure in this population. A systematic review of Pubmed, Medline, and CINAHL searching for randomized controlled trials of patients with traumatic injuries to the hand and wrist was carried out to identify the PROMs. For each identified PROM, evidence of reliability, validity, and responsiveness was identified using a further systematic review of the Pubmed, Medline, CINAHL, and reverse citation trail audit procedure. The PROM used most often was the Disabilities of the Arm, Shoulder and Hand (DASH) questionnaire; the Patient-Rated Wrist Evaluation (PRWE), Gartland and Werley score, Michigan Hand Outcomes score, Mayo Wrist Score, and Short Form 36 were also commonly used. Only the DASH and PRWE have evidence of reliability, validity, and responsiveness in patients with traumatic injuries to the hand and wrist; other measures either have incomplete evidence or evidence gathered in a nontraumatic population. The DASH and PRWE both have evidence of reliability, validity, and responsiveness in a hand and wrist trauma population. Other PROMs used to assess hand and wrist trauma patients do not. This should be considered when selecting a PROM for patients with traumatic hand and wrist pathology.

Validity-Supporting Evidence of the Self-Efficacy for Teaching Mathematics Instrument

ERIC Educational Resources Information Center

McGee, Jennifer R.; Wang, Chuang

2014-01-01

The purpose of this study is to provide evidence of reliability and validity of the Self-Efficacy for Teaching Mathematics Instrument (SETMI). Self-efficacy, as defined by Bandura, was the theoretical framework for the development of the instrument. The complex belief systems of mathematics teachers, as touted by Ernest provided insights into the…

Screening tool for oropharyngeal dysphagia in stroke - Part I: evidence of validity based on the content and response processes.

PubMed

Almeida, Tatiana Magalhães de; Cola, Paula Cristina; Pernambuco, Leandro de Araújo; Magalhães, Hipólito Virgílio; Magnoni, Carlos Daniel; Silva, Roberta Gonçalves da

2017-08-17

The aim of the present study was to identify the evidence of validity based on the content and response process of the Rastreamento de Disfagia Orofaríngea no Acidente Vascular Encefálico (RADAVE; "Screening Tool for Oropharyngeal Dysphagia in Stroke"). The criteria used to elaborate the questions were based on a literature review. A group of judges consisting of 19 different health professionals evaluated the relevance and representativeness of the questions, and the results were analyzed using the Content Validity Index. In order to evidence validity based on the response processes, 23 health professionals administered the screening tool and analyzed the questions using a structured scale and cognitive interview. The RADAVE structured to be applied in two stages. The first version consisted of 18 questions in stage I and 11 questions in stage II. Eight questions in stage I and four in stage II did not reach the minimum Content Validity Index, requiring reformulation by the authors. The cognitive interview demonstrated some misconceptions. New adjustments were made and the final version was produced with 12 questions in stage I and six questions in stage II. It was possible to develop a screening tool for dysphagia in stroke with adequate evidence of validity based on content and response processes. Both validity evidences obtained so far allowed to adjust the screening tool in relation to its construct. The next studies will analyze the other evidences of validity and the measures of accuracy.

On Coordinating Theory with Evidence: The Role of Epistemic Commitments in Scientific Reasoning among College Students

ERIC Educational Resources Information Center

Zeineddin, Ava; Abd-El-Khalick, Fouad

2008-01-01

This study examined the impact of two epistemic commitments on the quality of college students' scientific reasoning in the domain of hydrostatics. These were the commitment to the consistency of theory with prior knowledge and commitment to the consistency of theory with evidence. Participants were 12 sophomore science majors enrolled in a large…

Cannabis and joints: scientific evidence for the alleviation of osteoarthritis pain by cannabinoids.

PubMed

O'Brien, Melissa; McDougall, Jason J

2018-04-07

Cannabis has been used for millennia to treat a multitude of medical conditions including chronic pain. Osteoarthritis (OA) pain is one of the most common types of pain and patients often turn to medical cannabis to manage their symptoms. While the majority of these reports are anecdotal, there is a growing body of scientific evidence which supports the analgesic potential of cannabinoids to treat OA pain. OA pain manifests as a combination of inflammatory, nociceptive, and neuropathic pain, each requiring modality-specific analgesics. The body's innate endocannabinoid system (ECS) has been shown to ameliorate all of these pain subtypes. This review summarizes the components of the ECS and details the latest research pertaining to plant-based and man-made cannabinoids for the treatment of OA pain. Recent pre-clinical evidence supporting a role for the ECS to control OA pain is described as well as current clinical evidence of the efficacy of cannabinoids for treating OA pain in mixed patient populations. Copyright © 2018 Elsevier Ltd. All rights reserved.

Evidence flow graph methods for validation and verification of expert systems

NASA Technical Reports Server (NTRS)

Becker, Lee A.; Green, Peter G.; Bhatnagar, Jayant

1989-01-01

The results of an investigation into the use of evidence flow graph techniques for performing validation and verification of expert systems are given. A translator to convert horn-clause rule bases into evidence flow graphs, a simulation program, and methods of analysis were developed. These tools were then applied to a simple rule base which contained errors. It was found that the method was capable of identifying a variety of problems, for example that the order of presentation of input data or small changes in critical parameters could affect the output from a set of rules.

Evidence flow graph methods for validation and verification of expert systems

NASA Technical Reports Server (NTRS)

Becker, Lee A.; Green, Peter G.; Bhatnagar, Jayant

1988-01-01

This final report describes the results of an investigation into the use of evidence flow graph techniques for performing validation and verification of expert systems. This was approached by developing a translator to convert horn-clause rule bases into evidence flow graphs, a simulation program, and methods of analysis. These tools were then applied to a simple rule base which contained errors. It was found that the method was capable of identifying a variety of problems, for example that the order of presentation of input data or small changes in critical parameters could effect the output from a set of rules.

Reliability and validity evidence of the Assessment of Language Use in Social Contexts for Adults (ALUSCA).

PubMed

Valente, Ana Rita S; Hall, Andreia; Alvelos, Helena; Leahy, Margaret; Jesus, Luis M T

2018-04-12

The appropriate use of language in context depends on the speaker's pragmatic language competencies. A coding system was used to develop a specific and adult-focused self-administered questionnaire to adults who stutter and adults who do not stutter, The Assessment of Language Use in Social Contexts for Adults, with three categories: precursors, basic exchanges, and extended literal/non-literal discourse. This paper presents the content validity, item analysis, reliability coefficients and evidences of construct validity of the instrument. Content validity analysis was based on a two-stage process: first, 11 pragmatic questionnaires were assessed to identify items that probe each pragmatic competency and to create the first version of the instrument; second, items were assessed qualitatively by an expert panel composed by adults who stutter and controls, and quantitatively and qualitatively by an expert panel composed by clinicians. A pilot study was conducted with five adults who stutter and five controls to analyse items and calculate reliability. Construct validity evidences were obtained using the hypothesized relationships method and factor analysis with 28 adults who stutter and 28 controls. Concerning content validity, the questionnaires assessed up to 13 pragmatic competencies. Qualitative and quantitative analysis revealed ambiguities in items construction. Disagreement between experts was solved through item modification. The pilot study showed that the instrument presented internal consistency and temporal stability. Significant differences between adults who stutter and controls and different response profiles revealed the instrument's underlying construct. The instrument is reliable and presented evidences of construct validity.

European Union research in support of environment and health: Building scientific evidence base for policy.

PubMed

Karjalainen, Tuomo; Hoeveler, Arnd; Draghia-Akli, Ruxandra

2017-06-01

Opinion polls show that the European Union citizens are increasingly concerned about the impact of environmental factors on their health. In order to respond and provide solid scientific evidence for the numerous policies related to the protection of human health and the environment managed at the Union level, the European Union made a substantial investment in research and innovation in the past two decades through its Framework Programmes for Research and Technological Development, including the current programme, Horizon 2020, which started in 2014. This policy review paper analysed the portfolio of forty collaborative projects relevant to environment and health, which received a total amount of around 228 million euros from the EU. It gives details on their contents and general scientific trends observed, the profiles of the participating countries and institutions, and the potential policy implications of the results obtained. The increasing knowledge base is needed to make informed policy decisions in Europe and beyond, and should be useful to many stakeholders including the scientific community and regulatory authorities. Copyright © 2017. Published by Elsevier Ltd.

Validity and reliability of the Diagnostic Adaptive Behaviour Scale.

PubMed

Tassé, M J; Schalock, R L; Balboni, G; Spreat, S; Navas, P

2016-01-01

The Diagnostic Adaptive Behaviour Scale (DABS) is a new standardised adaptive behaviour measure that provides information for evaluating limitations in adaptive behaviour for the purpose of determining a diagnosis of intellectual disability. This article presents validity evidence and reliability data for the DABS. Validity evidence was based on comparing DABS scores with scores obtained on the Vineland Adaptive Behaviour Scale, second edition. The stability of the test scores was measured using a test and retest, and inter-rater reliability was assessed by computing the inter-respondent concordance. The DABS convergent validity coefficients ranged from 0.70 to 0.84, while the test-retest reliability coefficients ranged from 0.78 to 0.95, and the inter-rater concordance as measured by intraclass correlation coefficients ranged from 0.61 to 0.87. All obtained validity and reliability indicators were strong and comparable with the validity and reliability coefficients of the most commonly used adaptive behaviour instruments. These results and the advantages of the DABS for clinician and researcher use are discussed. © 2015 MENCAP and International Association of the Scientific Study of Intellectual and Developmental Disabilities and John Wiley & Sons Ltd.

Ground-water models: Validate or invalidate

USGS Publications Warehouse

Bredehoeft, J.D.; Konikow, Leonard F.

1993-01-01

The word validation has a clear meaning to both the scientific community and the general public. Within the scientific community the validation of scientific theory has been the subject of philosophical debate. The philosopher of science, Karl Popper, argued that scientific theory cannot be validated, only invalidated. Popper’s view is not the only opinion in this debate; however, many scientists today agree with Popper (including the authors). To the general public, proclaiming that a ground-water model is validated carries with it an aura of correctness that we do not believe many of us who model would claim. We can place all the caveats we wish, but the public has its own understanding of what the word implies. Using the word valid with respect to models misleads the public; verification carries with it similar connotations as far as the public is concerned. Our point is this: using the terms validation and verification are misleading, at best. These terms should be abandoned by the ground-water community.

Adaptation and validation of the Evidence-Based Practice Belief and Implementation scales for French-speaking Swiss nurses and allied healthcare providers.

PubMed

Verloo, Henk; Desmedt, Mario; Morin, Diane

2017-09-01

To evaluate two psychometric properties of the French versions of the Evidence-Based Practice Beliefs and Evidence-Based Practice Implementation scales, namely their internal consistency and construct validity. The Evidence-Based Practice Beliefs and Evidence-Based Practice Implementation scales developed by Melnyk et al. are recognised as valid, reliable instruments in English. However, no psychometric validation for their French versions existed. Secondary analysis of a cross sectional survey. Source data came from a cross-sectional descriptive study sample of 382 nurses and other allied healthcare providers. Cronbach's alpha was used to evaluate internal consistency, and principal axis factor analysis and varimax rotation were computed to determine construct validity. The French Evidence-Based Practice Beliefs and Evidence-Based Practice Implementation scales showed excellent reliability, with Cronbach's alphas close to the scores established by Melnyk et al.'s original versions. Principal axis factor analysis showed medium-to-high factor loading scores without obtaining collinearity. Principal axis factor analysis with varimax rotation of the 16-item Evidence-Based Practice Beliefs scale resulted in a four-factor loading structure. Principal axis factor analysis with varimax rotation of the 17-item Evidence-Based Practice Implementation scale revealed a two-factor loading structure. Further research should attempt to understand why the French Evidence-Based Practice Implementation scale showed a two-factor loading structure but Melnyk et al.'s original has only one. The French versions of the Evidence-Based Practice Beliefs and Evidence-Based Practice Implementation scales can both be considered valid and reliable instruments for measuring Evidence-Based Practice beliefs and implementation. The results suggest that the French Evidence-Based Practice Beliefs and Evidence-Based Practice Implementation scales are valid and reliable and can therefore be used to

Increasing scientific confidence in adverse outcome pathways: Application of tailored Bradford-Hill considerations for evaluating weight of evidence

EPA Science Inventory

Systematic consideration of scientific support is a critical element in developing and, ultimately, using adverse outcome pathways (AOPs) for various regulatory applications. Though weight of evidence (WoE) analysis has been proposed as a basis for assessment of the maturity and...

Dietary fats and cardiovascular health: a summary of the scientific evidence and current debate.

PubMed

Fattore, Elena; Massa, Elena

2018-04-04

This narrative review summarises the main studies of the role of the different fatty acids in coronary heart disease (CHD) and cardiovascular disease (CVD) risk and the current scientific debate on dietary recommendations. Reduction and substitution of the saturated fatty acids (SFAs) with the polyunsaturated fatty acids (PUFAs) are still the main dietary recommendation to prevent CHD and CVD. In the last few years, however, the strength of the scientific evidence underlying this dietary advice has been questioned. Recent investigations reappraise the previously declared deleterious role of the SFAs and reduce the positive role of PUFAs, mainly the omega-6, whereas the role of monounsaturated fatty acids (MUFAs) remains unclear. In contrast, the negative effects of trans fatty acids (TFAs) seem stronger than previously thought. Finally, criticisms have emerged from a dietary recommendation approach focussed on individual components rather than on wide food items and eating habits.

Selection of a method to rate the strength of scientific evidence for AORN recommendations.

PubMed

Steelman, Victoria M; Pape, Theresa; King, Cecil A; Graling, Paula; Gaberson, Kathleen B

2011-04-01

The use of scientific evidence to support national recommendations about clinical decisions has become an expectation of multidisciplinary health care organizations. The objectives of this project were to identify the most applicable evidence-rating method for perioperative nursing practice, evaluate the reliability of this method for perioperative nursing recommendations, and identify barriers and facilitators to adoption of this method for AORN recommendations. A panel of perioperative nurse experts evaluated 46 evidence-rating systems for quality, quantity, and consistency. We rated the methods that fully covered all three domains on five aspects of applicability to perioperative nursing practice recommendations. The Oncology Nursing Society's method was rated highest for all five aspects of applicability, and interrater reliability of this method for perioperative recommendations was 100%. Potential barriers to implementation of the rating method include knowledge deficit, staff resources, resistance to change, and fear of showing that lower levels of evidence support some recommendations. Facilitators included education, resource allocation, and starting small. Barriers and facilitators will be considered by the implementation team that will develop a plan to achieve integration of evidence rating into AORN documents. The AORN Board of Directors approved adoption of this method in June 2010. Copyright © 2011 AORN, Inc. Published by Elsevier Inc. All rights reserved.

What Counts as Validity Evidence? Examples and Prevalence in a Systematic Review of Simulation-Based Assessment

ERIC Educational Resources Information Center

Cook, David A.; Zendejas, Benjamin; Hamstra, Stanley J.; Hatala, Rose; Brydges, Ryan

2014-01-01

Ongoing transformations in health professions education underscore the need for valid and reliable assessment. The current standard for assessment validation requires evidence from five sources: content, response process, internal structure, relations with other variables, and consequences. However, researchers remain uncertain regarding the types…

Preliminary evidence for validity of the Bahasa Indonesian version of Study Process Questionnaire.

PubMed

Liem, Arief Darmanegara; Prasetya, Paulus Hidajat

2007-02-01

This study provides preliminary evidence for the validity of the Bahasa Indonesian version of the Study Process Questionnaire (BI-SPQ) from a sample of 147 psychology students (22 men and 125 women; M age = 21.8 yr., SD = 1.3). The internal consistency alpha of the BI-SPQ subscales were found to range from .46 (Surface Strategy) to .77 (Deep Strategy), with a median of .67. Principal component analysis indicated a two-factor solution, where the Deep and Achieving subscales loaded onto Factor 1 and the Surface subscales loaded on Factor 2. Students' GPAs were associated negatively with Surface Motive (r = -.24) and were associated positively with Deep and Achieving Motives (rs = .20). Further studies with larger samples involving students majoring in other disciplines are needed to provide further evidence of the validity of the BI-SPQ.

[The Problems with Domestic Introduction of rTMS from the Three Viewpoints of Scientific Evidence, Specialty and Social Responsibility].

PubMed

Shinosaki, Kazuhiro

2015-01-01

The domestic introduction of rTMS is expected as a new treatment option for treatment-resistant depression. I discussed some problems with the introduction from three viewpoints : scientific evidence, specialty, and social responsibility. I surveyed scientific evidence for rTMS regarding the action mechanism, effectiveness, side effects, and its positioning in the treatment guidelines. To secure the quality of rTMS treatment, I proposed rTMS guidelines, nurturing of the specialists, and a center hospital plan, and pointed out some medium-term problems after its introduction and the consistency of rTMS treatment and standard depression treatment. From the viewpoint of social responsibility, rTMS treatment should be a medical service covered by health insurance to avoid its misuse. We should prepare to overcome the public suspicion of brain stimulation treatment for mental disease.

Connectivity of Streams and Wetlands to Downstream Waters: A Review and Synthesis of the Scientific Evidence (Final Report)

EPA Science Inventory

The U.S. Environmental Protection Agency's (USEPA) Office of Research and Development has finalized the report Connectivity of Streams and Wetlands to Downstream Waters: A Review and Synthesis of the Scientific Evidence. The report reviews more than 1,200 peer-reviewe...

Voices from Test-Takers: Further Evidence for Language Assessment Validation and Use

ERIC Educational Resources Information Center

Cheng, Liying; DeLuca, Christopher

2011-01-01

Test-takers' interpretations of validity as related to test constructs and test use have been widely debated in large-scale language assessment. This study contributes further evidence to this debate by examining 59 test-takers' perspectives in writing large-scale English language tests. Participants wrote about their test-taking experiences in…

A Brazilian Portuguese Survey of School Climate: Evidence of Validity and Reliability

ERIC Educational Resources Information Center

Bear, George G.; Holst, Bruna; Lisboa, Carolina; Chen, Dandan; Yang, Chunyan; Chen, Fang Fang

2016-01-01

This study presents evidence of the validity and reliability of scores for the newly developed Brazilian Portuguese version of the Delaware School Climate Survey-Student (Brazilian DSCS-S). The sample consisted of 378 students, grades 5 through 9, attending four private and three public schools in southern Brazil. Confirmatory factor analyses…

Montreal-Toulouse Language Assessment Battery: evidence of criterion validity from patients with aphasia.

PubMed

Pagliarin, Karina Carlesso; Ortiz, Karin Zazo; Barreto, Simone dos Santos; Pimenta Parente, Maria Alice de Mattos; Nespoulous, Jean-Luc; Joanette, Yves; Fonseca, Rochele Paz

2015-10-15

The Montreal-Toulouse Language Assessment Battery - Brazilian version (MTL-BR) provides a general description of language processing and related components in adults with brain injury. The present study aimed at verifying the criterion-related validity of the Montreal-Toulouse Language Assessment Battery - Brazilian version (MTL-BR) by assessing its ability to discriminate between individuals with unilateral brain damage with and without aphasia. The investigation was carried out in a Brazilian community-based sample of 104 adults, divided into four groups: 26 participants with left hemisphere damage (LHD) with aphasia, 25 participants with right hemisphere damage (RHD), 28 with LHD non-aphasic, and 25 healthy adults. There were significant differences between patients with aphasia and the other groups on most total and subtotal scores on MTL-BR tasks. The results showed strong criterion-related validity evidence for the MTL-BR Battery, and provided important information regarding hemispheric specialization and interhemispheric cooperation. Future research is required to search for additional evidence of sensitivity, specificity and validity of the MTL-BR in samples with different types of aphasia and degrees of language impairment. Copyright © 2015 Elsevier B.V. All rights reserved.

Evidence for the construct validity of self-motivation as a correlate of exercise adherence in French older adults.

PubMed

André, Nathalie; Dishman, Rod K

2012-04-01

Exercise adherence involves a number of sociocognitive factors that influence the adoption and maintenance of regular physical activity. Among trait-like factors, self-motivation is believed to be a unique predictor of persistence during behavior change. The aim of this study was to validate the factor structure of a French version of the Self-Motivation Inventory (SMI) and to provide initial convergent and discriminant evidence for its construct validity as a correlate of exercise adherence. Four hundred seventy-one elderly were recruited and administered the SMI-10. Structural equation modeling tested the relation of SMI-10 scores with exercise adherence in a correlated network that included decisional balance and perceived quality of life. Acceptable evidence was found to support the factor validity and measurement equivalence of the French version of the SMI-10. Moreover, self-motivation was related to exercise adherence independently of decisional balance and perceived quality of life, providing initial evidence for construct validity.

Level of clinical evidence presented at the International Society for Hip Arthroscopy Annual Scientific Meeting over 5 years (2010–2014)

PubMed Central

Kay, Jeffrey; de SA, Darren; Shallow, Scott; Simunovic, Nicole; Safran, Marc R.; Philippon, Marc J.; Ayeni, Olufemi R.

2015-01-01

The International Society for Hip Arthroscopy (ISHA) Annual Scientific Meeting is at the forefront of informing today’s orthopaedic surgeons and society of the rapid advances in the exponentially growing field of hip arthroscopy. The purpose of this study was to evaluate and observe any trends in the level of clinical evidence in the papers and posters presented at the ISHA Annual Scientific Meeting from 2010 to 2014. The online abstracts of the paper and poster presentations presented at the ISHA Annual Scientific Meetings were independently evaluated by two reviewers (582 total resulting presentations). Two reviewers screened these results for clinical studies and graded the quality of evidence from level I (i.e. randomized trials) to IV (i.e. case series) based on the American Academy of Orthopaedic Surgeons classification system. Four hundred and twenty-eight presentations met the inclusion criteria and were evaluated. Overall, 10.1% of the presentations were level I, 12.8% were level II, 30.1% were level III and 47.0% were level IV evidence. Over time, from 2010 to 2014, we observed an increase in the percentage of level II paper presentations, an increase in the proportion of level III poster presentations, and a decrease in the proportion of both level IV paper and poster presentations. Significant non-random improvement in the level of evidence presented was noted for the poster presentations (P = 0.012) but not for the paper presentations (P = 0.61) over the study period. Statistical trends demonstrate ISHA’s increased awareness and commitment to presenting higher quality evidence as the availability of this evidence increases. PMID:27011857

Validity Evidence for the Test of Silent Reading Efficiency and Comprehension (TOSREC)

ERIC Educational Resources Information Center

Johnson, Evelyn S.; Pool, Juli L.; Carter, Deborah R.

2011-01-01

An essential component of a response to intervention (RTI) framework is a screening process that is both accurate and efficient. The purpose of this study was to analyze the validity evidence for the "Test of Silent Reading Efficiency and Comprehension" (TOSREC) to determine its potential for use within a screening process. Participants included…

The Students' Perceptions of School Success Promoting Strategies Inventory (SPSI): development and validity evidence based studies.

PubMed

Moreira, Paulo A S; Oliveira, João Tiago; Dias, Paulo; Vaz, Filipa Machado; Torres-Oliveira, Isabel

2014-08-04

Students' perceptions about school success promotion strategies are of great importance for schools, as they are an indicator of how students perceive the school success promotion strategies. The objective of this study was to develop and analyze the validity evidence based of The Students' Perceptions of School Success Promoting Strategies Inventory (SPSI), which assesses both individual students' perceptions of their school success promoting strategies, and dimensions of school quality. A structure of 7 related factors was found, which showed good adjustment indices in two additional different samples, suggesting that this is a well-fitting multi-group model (p < .001). All scales presented good reliability values. Schools with good academic results registered higher values in Career development, Active learning, Proximity, Educational Technologies and Extra-curricular activities (p < .05). SPSI showed to be adequate to measure within-schools (students within schools) dimensions of school success. In addition, there is preliminary evidence for its adequacy for measuring school success promotion dimensions between schools for 4 dimensions. This study supports the validity evidence based of the SPSI (validity evidence based on test content, on internal structure, on relations to other variables and on consequences of testing). Future studies should test for within- and between-level variance in a bigger sample of schools.

Factor analysis methods and validity evidence: A systematic review of instrument development across the continuum of medical education

NASA Astrophysics Data System (ADS)

Wetzel, Angela Payne

Previous systematic reviews indicate a lack of reporting of reliability and validity evidence in subsets of the medical education literature. Psychology and general education reviews of factor analysis also indicate gaps between current and best practices; yet, a comprehensive review of exploratory factor analysis in instrument development across the continuum of medical education had not been previously identified. Therefore, the purpose for this study was critical review of instrument development articles employing exploratory factor or principal component analysis published in medical education (2006--2010) to describe and assess the reporting of methods and validity evidence based on the Standards for Educational and Psychological Testing and factor analysis best practices. Data extraction of 64 articles measuring a variety of constructs that have been published throughout the peer-reviewed medical education literature indicate significant errors in the translation of exploratory factor analysis best practices to current practice. Further, techniques for establishing validity evidence tend to derive from a limited scope of methods including reliability statistics to support internal structure and support for test content. Instruments reviewed for this study lacked supporting evidence based on relationships with other variables and response process, and evidence based on consequences of testing was not evident. Findings suggest a need for further professional development within the medical education researcher community related to (1) appropriate factor analysis methodology and reporting and (2) the importance of pursuing multiple sources of reliability and validity evidence to construct a well-supported argument for the inferences made from the instrument. Medical education researchers and educators should be cautious in adopting instruments from the literature and carefully review available evidence. Finally, editors and reviewers are encouraged to recognize

Medical marijuana: the conflict between scientific evidence and political ideology. Part one of two.

PubMed

Cohen, Peter J

2009-01-01

Whether "medical marijuana" (Cannabis sativa used to treat a wide variety of pathologic states) should be accorded the status of a legitimate pharmaceutical agent has long been a contentious issue. Is it a truly effective drug that is arbitrarily stigmatized by many and criminalized by the federal government? Or is it without any medical utility, its advocates hiding behind a screen of misplaced (or deliberately misleading) compassion for the ill? Should Congress repeal its declaration that smoked marijuana is without "current medical benefit"? Should cannabis be approved for medical use by a vote of the people as already has been done in 13 states? Or should medical marijuana be scientifically evaluated for safety and efficacy as any other new investigational drug? How do the competing--and sometimes antagonistic--roles of science, politics and prejudice affect society's attempts to answer this question? This article examines the legal, political, policy, and ethical problems raised by the recognition of medical marijuana by over one-fourth of our states although its use remains illegal under federal law. Although draconian punishment can be imposed for the "recreational" use of marijuana, I will not address the contentious question of whether to legalize or decriminalize the use of marijuana solely for its psychotropic effects, a fascinating and important area of law and policy that is outside the scope of this paper. Instead, the specific focus of this article will be on the conflict between the development of policies based on evidence obtained through the use of scientific methods and those grounded on ideological and political considerations that have repeatedly entered the longstanding debate regarding the legal status of medical marijuana. I will address a basic question: Should the approval of medical marijuana be governed by the same statute that applies to all other drugs or pharmaceutical agents, the Food, Drug, and Cosmetic Act (FD&C Act), after the

The behavioral regulation in sport questionnaire (BRSQ): instrument development and initial validity evidence.

PubMed

Lonsdale, Chris; Hodge, Ken; Rose, Elaine A

2008-06-01

The purpose of the four studies described in this article was to develop and test a new measure of competitive sport participants' intrinsic motivation, extrinsic motivation, and amotivation (self-determination theory; Deci & Ryan, 1985). The items for the new measure, named the Behavioral Regulation in Sport Questionnaire (BRSQ), were constructed using interviews, expert review, and pilot testing. Analyses supported the internal consistency, test-retest reliability, and factorial validity of the BRSQ scores. Nomological validity evidence was also supportive, as BRSQ subscale scores were correlated in the expected pattern with scores derived from measures of motivational consequences. When directly compared with scores derived from the Sport Motivation Scale (SMS; Pelletier, Fortier, Vallerand, Tuson, & Blais, 1995) and a revised version of that questionnaire (SMS-6; Mallett, Kawabata, Newcombe, Otero-Forero, & Jackson, 2007), BRSQ scores demonstrated equal or superior reliability and factorial validity as well as better nomological validity.

The Scientific Case against Astrology.

ERIC Educational Resources Information Center

Kelly, Ivan

1980-01-01

Discussed is the lack of a scientific foundation and scientific evidence favoring astrology. Included are several research studies conducted to examine astrological tenets which yield generally negative results. (Author/DS)

Is It Believable When It's Scientific? How Scientific Discourse Style Influences Laypeople's Resolution of Conflicts

ERIC Educational Resources Information Center

Bromme, Rainer; Scharrer, Lisa; Stadtler, Marc; Hömberg, Johanna; Torspecken, Ronja

2015-01-01

Scientific texts are a genre in which adherence to specific discourse conventions allows for conclusions on the scientific integrity of the information and thus on its validity. This study examines whether genre-typical features of scientific discourse influence how laypeople handle conflicting science-based knowledge claims. In two experiments…

Trainees' Perceptions of Feedback: Validity Evidence for Two FEEDME (Feedback in Medical Education) Instruments.

PubMed

Bing-You, Robert; Ramesh, Saradha; Hayes, Victoria; Varaklis, Kalli; Ward, Denham; Blanco, Maria

2018-01-01

Construct: Medical educators consider feedback a core component of the educational process. Effective feedback allows learners to acquire new skills, knowledge, and attitudes. Learners' perceptions of feedback are an important aspect to assess with valid methods in order to improve the feedback skills of educators and the feedback culture. Although guidelines for delivering effective feedback have existed for several decades, medical students and residents often indicate that they receive little feedback. A recent scoping review on feedback in medical education did not reveal any validity evidence on instruments to assess learner's perceptions of feedback. The purpose of our study was to gather validity evidence on two novel FEEDME (Feedback in Medical Education) instruments to assess medical students' and residents' perceptions of the feedback that they receive. After the authors developed an initial instrument with 54 items, cognitive interviews with medical students and residents suggested that 2 separate instruments were needed, one focused on the feedback culture (FEEDME-Culture) and the other on the provider of feedback (FEEDME-Provider). A Delphi study with 17 medical education experts and faculty members assessed content validity. The response process was explored involving 31 medical students and residents at 2 academic institutions. Exploratory factor analysis and reliability analyses were performed on completed instruments. Two Delphi consultation rounds refined the wording of items and eliminated several items. Learners found both instruments easy and quick to answer; it took them less than 5 minutes to complete. Learners preferred an electronic format of the instruments over paper. Factor analysis revealed a two- and three-factor solution for the FEEDME-Culture and FEEDME-Provider instruments, respectively. Cronbach's alpha was greater than 0.80 for all factors. Items on both instruments were moderately to highly correlated (range, r = .3-.7). Our

Standardized description of scientific evidence using the Evidence Ontology (ECO)

PubMed Central

Chibucos, Marcus C.; Mungall, Christopher J.; Balakrishnan, Rama; Christie, Karen R.; Huntley, Rachael P.; White, Owen; Blake, Judith A.; Lewis, Suzanna E.; Giglio, Michelle

2014-01-01

The Evidence Ontology (ECO) is a structured, controlled vocabulary for capturing evidence in biological research. ECO includes diverse terms for categorizing evidence that supports annotation assertions including experimental types, computational methods, author statements and curator inferences. Using ECO, annotation assertions can be distinguished according to the evidence they are based on such as those made by curators versus those automatically computed or those made via high-throughput data review versus single test experiments. Originally created for capturing evidence associated with Gene Ontology annotations, ECO is now used in other capacities by many additional annotation resources including UniProt, Mouse Genome Informatics, Saccharomyces Genome Database, PomBase, the Protein Information Resource and others. Information on the development and use of ECO can be found at http://evidenceontology.org. The ontology is freely available under Creative Commons license (CC BY-SA 3.0), and can be downloaded in both Open Biological Ontologies and Web Ontology Language formats at http://code.google.com/p/evidenceontology. Also at this site is a tracker for user submission of term requests and questions. ECO remains under active development in response to user-requested terms and in collaborations with other ontologies and database resources. Database URL: Evidence Ontology Web site: http://evidenceontology.org PMID:25052702

Health literacy, emotionality, scientific evidence: Elements of an effective communication in public health.

PubMed

Biasio, Luigi Roberto; Carducci, Annalaura; Fara, Gaetano Maria; Giammanco, Giuseppe; Lopalco, Pier Luigi

2018-01-30

The importance of healthcare providers' communication abilities is still underestimated. Informing the population on the basis of documented evidence is essential but not enough to induce a change in the beliefs of who is doubtful or does not accept preventive interventions, such as vaccination. Lining up the offer of prevention to the knowledge of the citizens, also improving Health Literacy skills, is a critical step toward their empowerment and behavior change. The 2017 Erice Declaration was drafted to propose to the Institutions and the scientific community the main goals to improve communication and counteract Vaccine Hesitancy, at a very critical time, when mandatory vaccination was introduced in Italy.

Does Joint Fact-finding work for Water-energy-food Nexus Issues? A Role of Scientific Evidence in Policy Process

NASA Astrophysics Data System (ADS)

Baba, K.

2014-12-01

A quite famous phrase in risk management "How safe is enough safe?" implies there exists a framing gap among experts, the general public and stakeholders. Scientific evidence that experts provide usually contains uncertainty, while the public tends to have the other type of qualitative local knowledge. As there is no zero-risk society, we have to build consensus on acceptable level of risk and trade-offs of risks based on expert knowledge and local knowledge. Therefore having a dialogue among them in the early stage of the policy process such as problem definition and agenda setting is essential to cultivate trust and to integrate their knowledge. To this end, we especially pay attention to Joint Fact-finding (JFF). The tentative definition of JFF is that a promising strategy for experts, decision makers, and key public rights-holders and stakeholders from opposing sides of an issue to work together to resolve or narrow factual disputes over public policy issues. JFF process usually begins with identifying stakeholders and holding interviews with them to determine their interests. We call this step stakeholder analysis. Then we define the scope of the study including the required scientific evidence and the preliminary list of experts. After that, stakeholders jointly select experts to participate in the study, then they work together on what they would like to clear about scientific evidence. They finally get the common understanding and findings through these collaboration. We applied the stakeholder analysis to the issue of groundwater in Obama City and the issues of hot spring water and geothermal power in Beppu City in Japan. We drew conclusions from these case studies to some extent but at the same time we found that the analysis method has a limitation in applying it to multiple nexus issues because the method based on stakeholders' cognition. For example, in Obama case, we identified a lack of cooperation among stakeholders that especially agricultural

The role of prostate-specific antigen in light of new scientific evidence.

PubMed

Hernández, C; Morote, J; Miñana, B; Cózar, J M

2013-06-01

Review the scientific evidence acquired in recent years on Prostate-Specific Antigen (PSA). Analysis of the available evidence on the current role of PSA, according to a panel of experts who recorded their experience on the subject. Currently, PSA cannot be considered solely an indicator of the presence or absence of prostate cancer. Rather, the determination of PSA assists the urologist in indicating the most appropriate treatment for a patient with benign prostatic hypertrophic (BPH), as well as in suspecting a prostatic tumour when the PSA reading increases >0,3 ng/ml, in patients treated with 5-alpha-reductase inhibitor, over the reading achieved at six months of having initiated this treatment. Moreover, PSA is a key factor in the follow-up of patients with prostate adenocarcinoma who undergo surgery, radiation therapy or minimally invasive techniques. PSA helps to define biochemical recurrence, suggest the existence of a local or distal recurrence and propose or rule out adjuvant therapies. New data on the current role of PSA in the management of patients treated for BPH and/or prostate cancer should be taken into account. Copyright © 2013 AEU. Published by Elsevier Espana. All rights reserved.

New Ways of Delivering Marine Scientific Evidence for Policy Needs in the UK

NASA Astrophysics Data System (ADS)

Dorrington, T.

2016-12-01

The UK Department for Environment, Food, and Rural Affairs (Defra) is responsible for safeguarding the natural environment, supporting a world-leading food and farming industry, and sustaining a thriving rural economy. This includes the marine environment which makes a significant contribution to the economy of the UK through fisheries, aquaculture, transport, leisure and recreation, energy (including renewable), coastal tourism, and naval defence. The overall vision for the Defra marine programme is to therefore achieve clean, healthy, safe, productive and biologically diverse oceans and seas. In order to attain this it is essential that the decisions that government makes can be justified and that these decisions use the best available evidence and allow for any uncertainty. However, reductions across the budgets of departments such as Defra means that new ways of delivering evidence for policy needs must be sought. To do this we must consider marine monitoring efficiencies including the use of novel technologies, more integrated monitoring programmes, and greater collaboration with the research councils, industry, and academia. We must also seek to leverage other sources of funding from the European Union and other international partners. This presentation will address the main policy drivers (e.g. EU Marine Strategy Framework Directive) and future needs of the marine programme, the Defra Evidence Action Plan (EAP), and how we plan to use new avenues of gaining high quality marine scientific evidence in an era of declining budgets.

New Ways of Delivering Marine Scientific Evidence for Policy Needs in the UK

NASA Astrophysics Data System (ADS)

Dorrington, T.

2016-02-01

The UK Department for Environment, Food, and Rural Affairs (Defra) is responsible for safeguarding the natural environment, supporting a world-leading food and farming industry, and sustaining a thriving rural economy. This includes the marine environment which makes a significant contribution to the economy of the UK through fisheries, aquaculture, transport, leisure and recreation, energy (including renewable), coastal tourism, and naval defence. The overall vision for the Defra marine programme is to therefore achieve clean, healthy, safe, productive and biologically diverse oceans and seas. In order to attain this it is essential that the decisions that government makes can be justified and that these decisions use the best available evidence and allow for any uncertainty. However, reductions across the budgets of departments such as Defra means that new ways of delivering evidence for policy needs must be sought. To do this we must consider marine monitoring efficiencies including the use of novel technologies, more integrated monitoring programmes, and greater collaboration with the research councils, industry, and academia. We must also seek to leverage other sources of funding from the European Union and other international partners. This presentation will address the main policy drivers (e.g. EU Marine Strategy Framework Directive) and future needs of the marine programme, the Defra Evidence Action Plan (EAP), and how we plan to use new avenues of gaining high quality marine scientific evidence in an era of declining budgets.

Validity Evidence for a Serious Game to Assess Performance on Critical Pediatric Emergency Medicine Scenarios.

PubMed

Gerard, James M; Scalzo, Anthony J; Borgman, Matthew A; Watson, Christopher M; Byrnes, Chelsie E; Chang, Todd P; Auerbach, Marc; Kessler, David O; Feldman, Brian L; Payne, Brian S; Nibras, Sohail; Chokshi, Riti K; Lopreiato, Joseph O

2018-06-01

We developed a first-person serious game, PediatricSim, to teach and assess performances on seven critical pediatric scenarios (anaphylaxis, bronchiolitis, diabetic ketoacidosis, respiratory failure, seizure, septic shock, and supraventricular tachycardia). In the game, players are placed in the role of a code leader and direct patient management by selecting from various assessment and treatment options. The objective of this study was to obtain supportive validity evidence for the PediatricSim game scores. Game content was developed by 11 subject matter experts and followed the American Heart Association's 2011 Pediatric Advanced Life Support Provider Manual and other authoritative references. Sixty subjects with three different levels of experience were enrolled to play the game. Before game play, subjects completed a 40-item written pretest of knowledge. Game scores were compared between subject groups using scoring rubrics developed for the scenarios. Validity evidence was established and interpreted according to Messick's framework. Content validity was supported by a game development process that involved expert experience, focused literature review, and pilot testing. Subjects rated the game favorably for engagement, realism, and educational value. Interrater agreement on game scoring was excellent (intraclass correlation coefficient = 0.91, 95% confidence interval = 0.89-0.9). Game scores were higher for attendings followed by residents then medical students (Pc < 0.01) with large effect sizes (1.6-4.4) for each comparison. There was a very strong, positive correlation between game and written test scores (r = 0.84, P < 0.01). These findings contribute validity evidence for PediatricSim game scores to assess knowledge of pediatric emergency medicine resuscitation.

Development and Validation of the Evidence-Based Practice Process Assessment Scale: Preliminary Findings

ERIC Educational Resources Information Center

Rubin, Allen; Parrish, Danielle E.

2010-01-01

Objective: This report describes the development and preliminary findings regarding the reliability, validity, and sensitivity of a scale that has been developed to assess practitioners' perceived familiarity with, attitudes about, and implementation of the phases of the evidence-based practice (EBP) process. Method: After a panel of national…

Poststroke Fatigue: Emerging Evidence and Approaches to Management: A Scientific Statement for Healthcare Professionals From the American Heart Association.

PubMed

Hinkle, Janice L; Becker, Kyra J; Kim, Jong S; Choi-Kwon, Smi; Saban, Karen L; McNair, Norma; Mead, Gillian E

2017-07-01

At least half of all stroke survivors experience fatigue; thus, it is a common cause of concern for patients, caregivers, and clinicians after stroke. This scientific statement provides an international perspective on the emerging evidence surrounding the incidence, prevalence, quality of life, and complex pathogenesis of poststroke fatigue. Evidence for pharmacological and nonpharmacological interventions for management are reviewed, as well as the effects of poststroke fatigue on both stroke survivors and caregivers. © 2017 American Heart Association, Inc.

The development of scientific literacy assessment to measure student’s scientific literacy skills in energy theme

NASA Astrophysics Data System (ADS)

Rusilowati, A.; Nugroho, S. E.; Susilowati, E. S. M.; Mustika, T.; Harfiyani, N.; Prabowo, H. T.

2018-03-01

The research were aimed to develop and find out of validity, reliability, characteristic of scientific literacy assessment, and find out of the profile of students’ scientific literacy skills in Energy themed. The research is conducted in 7th grade of Secondary School at Demak, Central of Java Indonesia. The research design used R&D (Research and Development). The results of the research showed that the scientific literacy assessment was valid and reliable with 0.68 value in the first try out and 0.73 value in the last try out. The characteristics of the scientific literacy assessment are the difficulty index and the discrimination power. The difficulty index and distinguishing are 56.25% easy, 31.25% medium, and 12.5% very difficult with good discrimination power. The proportion of category of scientific literacy as the body of knowledge, the science as a way of investigating, science as a way of thinking, and the interaction among science, environment, technology, and society was 37.5%:25%:18.75%:18.75%. The highest to the lowest profile of students’ scientific literacy skills at Secondary School Demak was 72% in the category of science as a way of thinking and the lowest was 59% in the category of science as the body of knowledge.

Milk and dairy products: good or bad for human health? An assessment of the totality of scientific evidence

PubMed Central

Thorning, Tanja Kongerslev; Raben, Anne; Tholstrup, Tine; Soedamah-Muthu, Sabita S.; Givens, Ian; Astrup, Arne

2016-01-01

Background There is scepticism about health effects of dairy products in the public, which is reflected in an increasing intake of plant-based drinks, for example, from soy, rice, almond, or oat. Objective This review aimed to assess the scientific evidence mainly from meta-analyses of observational studies and randomised controlled trials, on dairy intake and risk of obesity, type 2 diabetes, cardiovascular disease, osteoporosis, cancer, and all-cause mortality. Results The most recent evidence suggested that intake of milk and dairy products was associated with reduced risk of childhood obesity. In adults, intake of dairy products was shown to improve body composition and facilitate weight loss during energy restriction. In addition, intake of milk and dairy products was associated with a neutral or reduced risk of type 2 diabetes and a reduced risk of cardiovascular disease, particularly stroke. Furthermore, the evidence suggested a beneficial effect of milk and dairy intake on bone mineral density but no association with risk of bone fracture. Among cancers, milk and dairy intake was inversely associated with colorectal cancer, bladder cancer, gastric cancer, and breast cancer, and not associated with risk of pancreatic cancer, ovarian cancer, or lung cancer, while the evidence for prostate cancer risk was inconsistent. Finally, consumption of milk and dairy products was not associated with all-cause mortality. Calcium-fortified plant-based drinks have been included as an alternative to dairy products in the nutrition recommendations in several countries. However, nutritionally, cow's milk and plant-based drinks are completely different foods, and an evidence-based conclusion on the health value of the plant-based drinks requires more studies in humans. Conclusion The totality of available scientific evidence supports that intake of milk and dairy products contribute to meet nutrient recommendations, and may protect against the most prevalent chronic diseases

Milk and dairy products: good or bad for human health? An assessment of the totality of scientific evidence.

PubMed

Thorning, Tanja Kongerslev; Raben, Anne; Tholstrup, Tine; Soedamah-Muthu, Sabita S; Givens, Ian; Astrup, Arne

2016-01-01

There is scepticism about health effects of dairy products in the public, which is reflected in an increasing intake of plant-based drinks, for example, from soy, rice, almond, or oat. This review aimed to assess the scientific evidence mainly from meta-analyses of observational studies and randomised controlled trials, on dairy intake and risk of obesity, type 2 diabetes, cardiovascular disease, osteoporosis, cancer, and all-cause mortality. The most recent evidence suggested that intake of milk and dairy products was associated with reduced risk of childhood obesity. In adults, intake of dairy products was shown to improve body composition and facilitate weight loss during energy restriction. In addition, intake of milk and dairy products was associated with a neutral or reduced risk of type 2 diabetes and a reduced risk of cardiovascular disease, particularly stroke. Furthermore, the evidence suggested a beneficial effect of milk and dairy intake on bone mineral density but no association with risk of bone fracture. Among cancers, milk and dairy intake was inversely associated with colorectal cancer, bladder cancer, gastric cancer, and breast cancer, and not associated with risk of pancreatic cancer, ovarian cancer, or lung cancer, while the evidence for prostate cancer risk was inconsistent. Finally, consumption of milk and dairy products was not associated with all-cause mortality. Calcium-fortified plant-based drinks have been included as an alternative to dairy products in the nutrition recommendations in several countries. However, nutritionally, cow's milk and plant-based drinks are completely different foods, and an evidence-based conclusion on the health value of the plant-based drinks requires more studies in humans. The totality of available scientific evidence supports that intake of milk and dairy products contribute to meet nutrient recommendations, and may protect against the most prevalent chronic diseases, whereas very few adverse effects have

Internal Factor Structure and Convergent Validity Evidence: The Self-Report Version of Self-Regulation Strategy Inventory

ERIC Educational Resources Information Center

Cleary, Timothy J.; Dembitzer, Leah; Kettler, Ryan J.

2015-01-01

Using a sample of 348 middle school students, we gathered evidence regarding the internal consistency of scores, as well as the internal factor structure and convergent validity evidence for inferences from a self-report questionnaire called the Self-Regulation Strategy Inventory-Self Report. Confirmatory factor analysis revealed that the fit…

Construct Validity Evidence for Single-Response Items to Estimate Physical Activity Levels in Large Sample Studies

ERIC Educational Resources Information Center

Jackson, Allen W.; Morrow, James R., Jr.; Bowles, Heather R.; FitzGerald, Shannon J.; Blair, Steven N.

2007-01-01

Valid measurement of physical activity is important for studying the risks for morbidity and mortality. The purpose of this study was to examine evidence of construct validity of two similar single-response items assessing physical activity via self-report. Both items are based on the stages of change model. The sample was 687 participants (men =…

Representation and misrepresentation of scientific evidence in contemporary tobacco regulation: a review of tobacco industry submissions to the UK Government consultation on standardised packaging.

PubMed

Ulucanlar, Selda; Fooks, Gary J; Hatchard, Jenny L; Gilmore, Anna B

2014-03-01

Standardised packaging (SP) of tobacco products is an innovative tobacco control measure opposed by transnational tobacco companies (TTCs) whose responses to the UK government's public consultation on SP argued that evidence was inadequate to support implementing the measure. The government's initial decision, announced 11 months after the consultation closed, was to wait for 'more evidence', but four months later a second 'independent review' was launched. In view of the centrality of evidence to debates over SP and TTCs' history of denying harms and manufacturing uncertainty about scientific evidence, we analysed their submissions to examine how they used evidence to oppose SP. We purposively selected and analysed two TTC submissions using a verification-oriented cross-documentary method to ascertain how published studies were used and interpretive analysis with a constructivist grounded theory approach to examine the conceptual significance of TTC critiques. The companies' overall argument was that the SP evidence base was seriously flawed and did not warrant the introduction of SP. However, this argument was underpinned by three complementary techniques that misrepresented the evidence base. First, published studies were repeatedly misquoted, distorting the main messages. Second, 'mimicked scientific critique' was used to undermine evidence; this form of critique insisted on methodological perfection, rejected methodological pluralism, adopted a litigation (not scientific) model, and was not rigorous. Third, TTCs engaged in 'evidential landscaping', promoting a parallel evidence base to deflect attention from SP and excluding company-held evidence relevant to SP. The study's sample was limited to sub-sections of two out of four submissions, but leaked industry documents suggest at least one other company used a similar approach. The TTCs' claim that SP will not lead to public health benefits is largely without foundation. The tools of Better Regulation

Science Literacy, Critical Thinking, and Scientific Literature: Guidelines for Evaluating Scientific Literature in the Classroom

ERIC Educational Resources Information Center

Jurecki, Karenann; Wander, Matthew C. F.

2012-01-01

In this work, we present an approach for teaching students to evaluate scientific literature and other materials critically. We use four criteria divided into two tiers: original research, authority, objectivity, and validity. The first tier, originality and authority, assesses the quality of the source. The second tier, objectivity and validity,…

Does the scientific evidence support the advertising claims made for products containing Lactobacillus casei and Bifidobacterium lactis? A systematic review.

PubMed

Meléndez-Illanes, Lorena; González-Díaz, Cristina; Chilet-Rosell, Elisa; Álvarez-Dardet, Carlos

2016-09-01

To analyse the scientific evidence that exists for the advertising claims made for two products containing Lactobacillus casei and Bifidobacterium lactis and to conduct a comparison between the published literature and what is presented in the corporate website. Systematic review, using Medline through Pubmed and Embase. We included human clinical trials that exclusively measured the effect of Lactobacillus casei or Bifidobacterium lactis on a healthy population, and where the objective was related to the health claims made for certain products in advertising. We assessed the levels of evidence and the strength of the recommendation according to the classification criteria established by the Oxford Centre for Evidence Based Medicine (CEBM). We also assessed the outcomes of the studies published on the website that did not appear in the search. Of the 440 articles identified, 16 met the inclusion criteria. Only four (25%) of these presented a level of evidence of 1b and a recommendation grade of A, all corresponding to studies on product containing Bifidobacterium lactis, and only 12 of the 16 studies were published on the corporate website (47). There is insufficient scientific evidence to support the health claims made for these products, especially in the case of product containing Lactobacillus casei. © The Author 2015. Published by Oxford University Press on behalf of Faculty of Public Health. All rights reserved. For permissions, please e-mail: journals.permissions@oup.com.

The validation of forensic DNA extraction systems to utilize soil contaminated biological evidence.

PubMed

Kasu, Mohaimin; Shires, Karen

2015-07-01

The production of full DNA profiles from biological evidence found in soil has a high failure rate due largely to the inhibitory substance humic acid (HA). Abundant in various natural soils, HA co-extracts with DNA during extraction and inhibits DNA profiling by binding to the molecular components of the genotyping assay. To successfully utilize traces of soil contaminated evidence, such as that found at many murder and rape crime scenes in South Africa, a reliable HA removal extraction system would often be selected based on previous validation studies. However, for many standard forensic DNA extraction systems, peer-reviewed publications detailing the efficacy on soil evidence is either lacking or is incomplete. Consequently, these sample types are often not collected or fail to yield suitable DNA material due to the use of unsuitable methodology. The aim of this study was to validate the common forensic DNA collection and extraction systems used in South Africa, namely DNA IQ, FTA elute and Nucleosave for processing blood and saliva contaminated with HA. A forensic appropriate volume of biological evidence was spiked with HA (0, 0.5, 1.5 and 2.5 mg/ml) and processed through each extraction protocol for the evaluation of HA removal using QPCR and STR-genotyping. The DNA IQ magnetic bead system effectively removed HA from highly contaminated blood and saliva, and generated consistently acceptable STR profiles from both artificially spiked samples and crude soil samples. This system is highly recommended for use on soil-contaminated evidence over the cellulose card-based systems currently being preferentially used for DNA sample collection. Copyright © 2015 Elsevier Ireland Ltd. All rights reserved.

Validity Evidence for the Measurement of the Strength of Motivation for Medical School

ERIC Educational Resources Information Center

Kusurkar, Rashmi; Croiset, Gerda; Kruitwagen, Cas; ten Cate, Olle

2011-01-01

The Strength of Motivation for Medical School (SMMS) questionnaire is designed to determine the strength of motivation of students particularly for medical study. This research was performed to establish the validity evidence for measuring strength of motivation for medical school. Internal structure and relations to other variables were used as…

Synchronous international scientific mobility in the space of affiliations: evidence from Russia.

PubMed

Markova, Yulia V; Shmatko, Natalia A; Katchanov, Yurij L

2016-01-01

The article presents a survey of Russian researchers' synchronous international scientific mobility as an element of the global system of scientific labor market. Synchronous international scientific mobility is a simultaneous holding of scientific positions in institutions located in different countries. The study explores bibliometric data from the Web of Science Core Collection and socio-economic indicators for 56 countries. In order to examine international scientific mobility, we use a method of affiliations. The paper introduces a model of synchronous international scientific mobility. It enables to specify country's involvement in the international division of scientific labor. Synchronous international scientific mobility is a modern form of the international division of labor in science. It encompasses various forms of part-time, temporary and remote employment of scientists. The analysis reveals the distribution of Russian authors in the space of affiliations, and directions of upward/downward international scientific mobility. The bibliometric characteristics of mobile authors are isomorphic to those of receiver country authors. Synchronous international scientific mobility of Russian authors is determined by differences in scientific impacts between receiver and donor countries.

Validity threats: overcoming interference with proposed interpretations of assessment data.

PubMed

Downing, Steven M; Haladyna, Thomas M

2004-03-01

Factors that interfere with the ability to interpret assessment scores or ratings in the proposed manner threaten validity. To be interpreted in a meaningful manner, all assessments in medical education require sound, scientific evidence of validity. The purpose of this essay is to discuss 2 major threats to validity: construct under-representation (CU) and construct-irrelevant variance (CIV). Examples of each type of threat for written, performance and clinical performance examinations are provided. The CU threat to validity refers to undersampling the content domain. Using too few items, cases or clinical performance observations to adequately generalise to the domain represents CU. Variables that systematically (rather than randomly) interfere with the ability to meaningfully interpret scores or ratings represent CIV. Issues such as flawed test items written at inappropriate reading levels or statistically biased questions represent CIV in written tests. For performance examinations, such as standardised patient examinations, flawed cases or cases that are too difficult for student ability contribute CIV to the assessment. For clinical performance data, systematic rater error, such as halo or central tendency error, represents CIV. The term face validity is rejected as representative of any type of legitimate validity evidence, although the fact that the appearance of the assessment may be an important characteristic other than validity is acknowledged. There are multiple threats to validity in all types of assessment in medical education. Methods to eliminate or control validity threats are suggested.

Actual curriculum development practices instrument: Testing for factorial validity

NASA Astrophysics Data System (ADS)

Foi, Liew Yon; Bakar, Kamariah Abu; Hamzah, Mohd Sahandri Gani; Alwi, Nor Hayati

2014-09-01

The Actual Curriculum Development Practices Instrument (ACDP-I) was developed and the factorial validity of the ACDP-I was tested (n = 107) using exploratory factor analysis procedures in the earlier work of [1]. Despite the ACDP-I appears to be content and construct valid instrument with very high internal reliability qualities for using in Malaysia, the accumulated evidences are still needed to provide a sound scientific basis for the proposed score interpretations. Therefore, the present study addresses this concern by utilising the confirmatory factor analysis to further confirm the theoretical structure of the variable Actual Curriculum Development Practices (ACDP) and enrich the psychometrical properties of ACDP-I. Results of this study have practical implication to both researchers and educators whose concerns focus on teachers' classroom practices and the instrument development and validation process.

Was Hawan Designed to Fight Anxiety-Scientific Evidences?

PubMed

Romana, R K; Sharma, A; Gupta, V; Kaur, R; Kumar, S; Bansal, P

2017-01-06

Anxiety is a psychiatric disorder with unknown neurobiology; however, neurotransmitters like gamma-amino butyric acid, norepinephrine and serotonin (5-HT) play crucial roles in mediating anxiety. Present drug modules pose dependence risk to the patient; hence, there is a great need to develop complementary therapies to fight this disorder. Aromatherapy has also been employed in ancient times for a number of mental disorders. Mahamrituanjay Mantra, Om triambkum yajamahe, sughandhim puushtivardhanam, urvarukmev vandhanaat, mrityu mokshay mamritaat!!!!, the part of veda enlightens that aroma gives rise to good health (sughandhim puushtivardhanam). Hawan is a religious practice recommended for mental peace. Hawan is a process in which special herbs are offered in the fire of medicinal woods ignited in a specially designed fire pit. Analysis of literature demonstrates that the components of Hawan are having a number of volatile oils that are specifically useful for prevention and treatment of anxiety through some mechanism of action. Due to high temperature of fire, the vapors of these oils from herbs enter into the central nervous system through nasal route. As per modern science and ancient texts on medicine, nasal drug delivery systems are the best for the diseases related to brain and head. The routine of performing Hawan might keep the threshold value of the therapeutic components in the body and help in preventing anxiety. In the present manuscript, authors highlight and integrate the modern and ancient concepts for treatment and prevention of anxiety through scientific evidences.

ILSI Brazil International Workshop on Functional Foods: a narrative review of the scientific evidence in the area of carbohydrates, microbiome, and health

PubMed Central

Meheust, Agnès; Augustin, Livia; Benton, David; Berčík, Přemysl; Birkett, Anne; Eldridge, Alison L.; Faintuch, Joel; Hoffmann, Christian; Jones, Julie Miller; Kendall, Cyril; Lajolo, Franco; Perdigon, Gabriela; Prieto, Pedro Antonio; Rastall, Robert A.; Sievenpiper, John L.; Slavin, Joanne; de Menezes, Elizabete Wenzel

2013-01-01

To stimulate discussion around the topic of ‘carbohydrates’ and health, the Brazilian branch of the International Life Sciences Institute held the 11th International Functional Foods Workshop (1–2 December 2011) in which consolidated knowledge and recent scientific advances specific to the relationship between carbohydrates and health were presented. As part of this meeting, several key points related to dietary fiber, glycemic response, fructose, and impacts on satiety, cognition, mood, and gut microbiota were realized: 1) there is a need for global harmonization of a science-based fiber definition; 2) low-glycemic index foods can be used to modulate the postprandial glycemic response and may affect diabetes and cardiovascular outcomes; 3) carbohydrate type may influence satiety and satiation; glycemic load and glycemic index show links to memory, mood, and concentration; 4) validated biomarkers are needed to demonstrate the known prebiotic effect of carbohydrates; 5) negative effects of fructose are not evident when human data are systematically reviewed; 6) new research indicates that diet strongly influences the microbiome; and 7) there is mounting evidence that the intestinal microbiota has the ability to impact the gut–brain axis. Overall, there is much promise for development of functional foods that impact the microbiome and other factors relevant to health, including glycemic response (glycemic index/glycemic load), satiety, mood, cognition, and weight management. PMID:23399638

The Prosocial and Antisocial Behaviour in Sport Scale: further evidence for construct validity and reliability.

PubMed

Kavussanu, Maria; Stanger, Nicholas; Boardley, Ian D

2013-01-01

The purpose of this research was to provide further evidence for the construct validity (i.e., convergent, concurrent, and discriminant validity) of the Prosocial and Antisocial Behaviour in Sport Scale (PABSS), an instrument that has four subscales measuring prosocial and antisocial behaviour toward teammates and opponents. We also investigated test-retest reliability and stability of the PABSS. We conducted three studies using athletes from a variety of team sports. In Study 1, participants (N = 129) completed the PABSS and measures of physical and verbal aggression, hostility, anger, moral identity, and empathy; a sub-sample (n = 111) also completed the PABSS one week later. In Study 2, in addition to the PABSS, participants (N = 89) completed measures of competitive aggressiveness and anger, moral attitudes, moral disengagement, goal orientation, and anxiety. In Study 3, participants (N = 307) completed the PABSS and a measure of social goals. Across the three studies, the four subscales evidenced the hypothesised relationships with a number of variables. Correlations were large between the two antisocial behaviours and small between the two prosocial behaviours. Overall, the findings supported the convergent, concurrent, and discriminant validity of the scale, provided evidence for its test-retest reliability and stability, and suggest that the instrument is a valid and reliable measure of prosocial and antisocial behaviour in sport.

Scientific Reasoning in Early and Middle Childhood: The Development of Domain-General Evidence Evaluation, Experimentation, and Hypothesis Generation Skills

ERIC Educational Resources Information Center

Piekny, Jeanette; Maehler, Claudia

2013-01-01

According to Klahr's (2000, 2005; Klahr & Dunbar, 1988) Scientific Discovery as Dual Search model, inquiry processes require three cognitive components: hypothesis generation, experimentation, and evidence evaluation. The aim of the present study was to investigate (a) when the ability to evaluate perfect covariation, imperfect covariation,…

Measuring Students' Motivation: Validity Evidence for the MUSIC Model of Academic Motivation Inventory

ERIC Educational Resources Information Center

Jones, Brett D.; Skaggs, Gary

2016-01-01

This study provides validity evidence for the MUSIC Model of Academic Motivation Inventory (MUSIC Inventory; Jones, 2012), which measures college students' beliefs related to the five components of the MUSIC Model of Motivation (MUSIC model; Jones, 2009). The MUSIC model is a conceptual framework for five categories of teaching strategies (i.e.,…

Scientists and Scientific Thinking: Understanding Scientific Thinking through an Investigation of Scientists Views about Superstitions and Religious Beliefs

ERIC Educational Resources Information Center

Coll, Richard K.; Lay, Mark C.; Taylor, Neil

2008-01-01

Scientific literacy is explored in this paper which describes two studies that seek to understand a particular feature of the nature of science; namely scientists' habits of mind. The research investigated scientists' views of scientific evidence and how scientists judge evidence claims. The first study is concerned with scientists' views of what…

Validation methodology in publications describing epidemiological registration methods of dental caries: a systematic review.

PubMed

Sjögren, P; Ordell, S; Halling, A

2003-12-01

The aim was to describe and systematically review the methodology and reporting of validation in publications describing epidemiological registration methods for dental caries. BASIC RESEARCH METHODOLOGY: Literature searches were conducted in six scientific databases. All publications fulfilling the predetermined inclusion criteria were assessed for methodology and reporting of validation using a checklist including items described previously as well as new items. The frequency of endorsement of the assessed items was analysed. Moreover, the type and strength of evidence, was evaluated. Reporting of predetermined items relating to methodology of validation and the frequency of endorsement of the assessed items were of primary interest. Initially 588 publications were located. 74 eligible publications were obtained, 23 of which fulfilled the inclusion criteria and remained throughout the analyses. A majority of the studies reported the methodology of validation. The reported methodology of validation was generally inadequate, according to the recommendations of evidence-based medicine. The frequencies of reporting the assessed items (frequencies of endorsement) ranged from four to 84 per cent. A majority of the publications contributed to a low strength of evidence. There seems to be a need to improve the methodology and the reporting of validation in publications describing professionally registered caries epidemiology. Four of the items assessed in this study are potentially discriminative for quality assessments of reported validation.

Validation of the Portuguese version of the Evidence-Based Practice Questionnaire

PubMed Central

Pereira, Rui Pedro Gomes; Guerra, Ana Cristina Pinheiro; Cardoso, Maria José da Silva Peixoto de Oliveira; dos Santos, Alzira Teresa Vieira Martins Ferreira; de Figueiredo, Maria do Céu Aguiar Barbieri; Carneiro, António Cândido Vaz

2015-01-01

OBJECTIVES: to describe the process of translation and linguistic and cultural validation of the Evidence Based Practice Questionnaire for the Portuguese context: Questionário de Eficácia Clínica e Prática Baseada em Evidências (QECPBE). METHOD: a methodological and cross-sectional study was developed. The translation and back translation was performed according to traditional standards. Principal Components Analysis with orthogonal rotation according to the Varimax method was used to verify the QECPBE's psychometric characteristics, followed by confirmatory factor analysis. Internal consistency was determined by Cronbach's alpha. Data were collected between December 2013 and February 2014. RESULTS: 358 nurses delivering care in a hospital facility in North of Portugal participated in the study. QECPBE contains 20 items and three subscales: Practice (α=0.74); Attitudes (α=0.75); Knowledge/Skills and Competencies (α=0.95), presenting an overall internal consistency of α=0.74. The tested model explained 55.86% of the variance and presented good fit: χ2(167)=520.009; p = 0.0001; χ2df=3.114; CFI=0.908; GFI=0.865; PCFI=0.798; PGFI=0.678; RMSEA=0.077 (CI90%=0.07-0.08). CONCLUSION: confirmatory factor analysis revealed the questionnaire is valid and appropriate to be used in the studied context. PMID:26039307

The Inadmissibility of What We Eat in America and NHANES Dietary Data in Nutrition and Obesity Research and the Scientific Formulation of National Dietary Guidelines.

PubMed

Archer, Edward; Pavela, Gregory; Lavie, Carl J

2015-07-01

The Scientific Report of the 2015 Dietary Guidelines Advisory Committee was primarily informed by memory-based dietary assessment methods (M-BMs) (eg, interviews and surveys). The reliance on M-BMs to inform dietary policy continues despite decades of unequivocal evidence that M-BM data bear little relation to actual energy and nutrient consumption. Data from M-BMs are defended as valid and valuable despite no empirical support and no examination of the foundational assumptions regarding the validity of human memory and retrospective recall in dietary assessment. We assert that uncritical faith in the validity and value of M-BMs has wasted substantial resources and constitutes the greatest impediment to scientific progress in obesity and nutrition research. Herein, we present evidence that M-BMs are fundamentally and fatally flawed owing to well-established scientific facts and analytic truths. First, the assumption that human memory can provide accurate or precise reproductions of past ingestive behavior is indisputably false. Second, M-BMs require participants to submit to protocols that mimic procedures known to induce false recall. Third, the subjective (ie, not publicly accessible) mental phenomena (ie, memories) from which M-BM data are derived cannot be independently observed, quantified, or falsified; as such, these data are pseudoscientific and inadmissible in scientific research. Fourth, the failure to objectively measure physical activity in analyses renders inferences regarding diet-health relationships equivocal. Given the overwhelming evidence in support of our position, we conclude that M-BM data cannot be used to inform national dietary guidelines and that the continued funding of M-BMs constitutes an unscientific and major misuse of research resources. Copyright © 2015 Mayo Foundation for Medical Education and Research. Published by Elsevier Inc. All rights reserved.

Examining validity evidence for a simulation-based assessment tool for basic robotic surgical skills.

PubMed

Havemann, Maria Cecilie; Dalsgaard, Torur; Sørensen, Jette Led; Røssaak, Kristin; Brisling, Steffen; Mosgaard, Berit Jul; Høgdall, Claus; Bjerrum, Flemming

2018-05-14

Increasing focus on patient safety makes it important to ensure surgical competency among surgeons before operating on patients. The objective was to gather validity evidence for a virtual-reality simulator test for robotic surgical skills and evaluate its potential as a training tool. Surgeons with varying experience in robotic surgery were recruited: novices (zero procedures), intermediates (1-50), experienced (> 50). Five experienced surgeons rated five exercises on the da Vinci Skills Simulator. Participants were tested using the five exercises. Participants were invited back 3 times and completed a total of 10 attempts per exercise. The outcome was the average simulator performance score for the 5 exercises. 32 participants from 5 surgical specialties were included. 38 participants completed all 4 sessions. A moderate correlation between the average total score and robotic experience was identified for the first attempt (Spearman r = 0.58; p = 0.0004). A difference in average total score was observed between novices and intermediates [median score 61% (IQR 52-66) vs. 83% (IQR 75-91), adjusted p < 0.0001], as well as novices and experienced [median score 61% (IQR 52-66) vs. 80 (IQR 69-85), adjusted p = 0.002]. All three groups improved their performance between the 1st and 10th attempts (p < 0.00). This study describes validity evidence for a virtual-reality simulator for basic robotic surgical skills, which can be used for assessment of basic competency and as a training tool. However, more validity evidence is needed before it can be used for certification or high-stakes assessment.

Ethics in scientific communication: study of a problem case.

PubMed

Berger, R L

1994-12-01

The hypothermia experiments performed on humans during the Second World War at the German concentration camp in Dachau have been regarded as crimes against humanity, disguised as medical research. For almost 50 years, scientists maintained that the study produced valuable, even if not totally reliable, information. In recent years, the results from the Dachau hypothermia project were glamorized with life-saving potential and a heated ethical dialogue was activated about the use of life-saving but tainted scientific information. In the wake of the debate, an in-depth examination of the scientific rigour of the project was performed and revealed that neither the science nor the scientists from Dachau could be trusted and that the data were worthless. The body of medical opinion accepted the unfavourable determination but a few scientists and ethicists have continued to endorse the validity, of at least parts, of the Dachau hypothermia data. The conduct of the scientific communications about the Dachau hypothermia experiments by the scientific and ethical communities invites serious consideration of a possible ethical misadventure. It appears that for almost 50 years, the results of the study had been endorsed without careful examination of the scientific base of the experiments and that secondary citation of relevant original material may have been commonly employed. These infractions contributed to a myth that good science was practised by the Nazis at Dachau. The more recent emphasis on the life-saving potential of the Dachau data, without citation of credible supporting evidence, has also been misleading. Similarly, acceptance of a determination by an in-depth examination that the 'whole' Dachau project if flawed with simultaneous endorsement of the validity of 'parts' of the results, poses an ethical problem. It is advisable that before seeking ethical consultation about the use of unethically obtained data, scientists should examine the quality of science behind

Ethics in scientific communication: study of a problem case.

PubMed Central

Berger, R L

1994-01-01

The hypothermia experiments performed on humans during the Second World War at the German concentration camp in Dachau have been regarded as crimes against humanity, disguised as medical research. For almost 50 years, scientists maintained that the study produced valuable, even if not totally reliable, information. In recent years, the results from the Dachau hypothermia project were glamorized with life-saving potential and a heated ethical dialogue was activated about the use of life-saving but tainted scientific information. In the wake of the debate, an in-depth examination of the scientific rigour of the project was performed and revealed that neither the science nor the scientists from Dachau could be trusted and that the data were worthless. The body of medical opinion accepted the unfavourable determination but a few scientists and ethicists have continued to endorse the validity, of at least parts, of the Dachau hypothermia data. The conduct of the scientific communications about the Dachau hypothermia experiments by the scientific and ethical communities invites serious consideration of a possible ethical misadventure. It appears that for almost 50 years, the results of the study had been endorsed without careful examination of the scientific base of the experiments and that secondary citation of relevant original material may have been commonly employed. These infractions contributed to a myth that good science was practised by the Nazis at Dachau. The more recent emphasis on the life-saving potential of the Dachau data, without citation of credible supporting evidence, has also been misleading. Similarly, acceptance of a determination by an in-depth examination that the 'whole' Dachau project if flawed with simultaneous endorsement of the validity of 'parts' of the results, poses an ethical problem. It is advisable that before seeking ethical consultation about the use of unethically obtained data, scientists should examine the quality of science behind

Construct Validity Evidence for Bracken School Readiness Assessment, Third Edition, Spanish Form Scores

ERIC Educational Resources Information Center

Ortiz, Arlene; Clinton, Amanda; Schaefer, Barbara A.

2015-01-01

Convergent and discriminant validity evidence was examined for scores on the Spanish Record Form of the Bracken School Readiness Assessment, Third Edition (BSRA-3). Participants included a sample of 68 Hispanic, Spanish-speaking children ages 4 to 5 years enrolled in preschool programs in Puerto Rico. Scores obtained from the BSRA-3 Spanish Record…

Validity evidence of non-technical skills assessment instruments in simulated anaesthesia crisis management.

PubMed

Jirativanont, T; Raksamani, K; Aroonpruksakul, N; Apidechakul, P; Suraseranivongse, S

2017-07-01

We sought to evaluate the validity of two non-technical skills evaluation instruments, the Anaesthetists' Non-Technical Skills (ANTS) behavioural marker system and the Ottawa Global Rating Scale (GRS), to apply them to anaesthesia training. The content validity, response process, internal structure, relations with other variables and consequences were described for validity evidence. Simulated crisis management sessions were initiated during which two trained raters evaluated the performance of postgraduate first-, second- and third-year (PGY-1, PGY-2 and PGY-3) anaesthesia residents. The study included 70 participants, composed of 24 PGY-1, 24 PGY-2 and 22 PGY-3 residents. Both instruments differentiated the non-technical skills of PGY-1 from PGY-3 residents ( P <0.05). Inter-rater agreement was measured using the intraclass correlation coefficient (ICC). For the ANTS instrument, the intraclass correlation coefficients for task management, team-working, situation awareness and decision-making were 0.79, 0.34, 0.81 and 0.70, respectively. For the Ottawa GRS, the intraclass correlation coefficients for overall performance, leadership, problem-solving, situation awareness, resource utilisation and communication skills were 0.86, 0.83, 0.84, 0.87, 0.80 and 0.86, respectively. The Cronbach's alpha for internal consistency of the ANTS instrument was 0.93, and was 0.96 for the Ottawa GRS. There was a high correlation between the ANTS and Ottawa GRS. The raters reported the ease of use of the Ottawa GRS compared to the ANTS. We found sufficient evidence of validity in the ANTS instrument and the Ottawa GRS for the evaluation of non-technical skills in a simulated anaesthesia setting, but the Ottawa GRS was more practical and had higher reliability.

Evaluating an Instrument to Measure Mental Load and Mental Effort Considering Different Sources of Validity Evidence

ERIC Educational Resources Information Center

Krell, Moritz

2017-01-01

This study evaluates a 12-item instrument for subjective measurement of mental load (ML) and mental effort (ME) by analysing different sources of validity evidence. The findings of an expert judgement (N = 8) provide "evidence based on test content" that the formulation of the items corresponds to the meaning of ML and ME. An empirical…

Scientific Inquiry: A Model for Online Searching.

ERIC Educational Resources Information Center

Harter, Stephen P.

1984-01-01

Explores scientific inquiry as philosophical and behavioral model for online search specialist and information retrieval process. Nature of scientific research is described and online analogs to research concepts of variable, hypothesis formulation and testing, operational definition, validity, reliability, assumption, and cyclical nature of…

Medicinal plants used to treat snakebite in Central America: Review and assessment of scientific evidence.

PubMed

Giovannini, Peter; Howes, Melanie-Jayne R

2017-03-06

Every year between 1.2 and 5.5 million people worldwide are victims of snakebites, with about 400,000 left permanently injured. In Central America an estimated 5500 snakebite cases are reported by health centres, but this is likely to be an underestimate due to unreported cases in rural regions. The aim of this study is to review the medicinal plants used traditionally to treat snakebites in seven Central American countries: Belize, Costa Rica, El Salvador, Guatemala, Honduras, Nicaragua and Panama. A literature search was performed on published primary data on medicinal plants of Central America and those specifically pertaining to use against snakebites. Plant use reports for traditional snakebite remedies identified in primary sources were extracted and entered in a database, with data analysed in terms of the most frequent numbers of use reports. The scientific evidence that might support the local uses of the most frequently reported species was also examined. A total of 260 independent plant use reports were recorded in the 34 sources included in this review, encompassing 208 species used to treat snakebite in Central America. Only nine species were reported in at least three studies: Cissampelos pareira L., Piper amalago L., Aristolochia trilobata L., Sansevieria hyacinthoides (L.) Druce, Strychnos panamensis Seem., Dorstenia contrajerva L., Scoparia dulcis L., Hamelia patens Jacq., and Simaba cedron Planch. Genera with the highest number of species used to treat snakebite were Piper, Aristolochia, Hamelia, Ipomoea, Passiflora and Peperomia. The extent of the scientific evidence available to understand any pharmacological basis for their use against snakebites varied between different plant species. At least 208 plant species are traditionally used to treat snakebite in Central America but there is a lack of clinical research to evaluate their efficacy and safety. Available pharmacological data suggest different plant species may target different symptoms of

Evidence based vaccinology.

PubMed

Nalin, David R

2002-02-22

Evidence based vaccinology (EBV) is the identification and use of the best evidence in making and implementing decisions during all of the stages of the life of a vaccine, including pre-licensure vaccine development and post-licensure manufacture and research, and utilization of the vaccine for disease control. Vaccines, unlike most pharmaceuticals, are in a continuous process of development both before and after licensure. Changes in biologics manufacturing technology and changes that vaccines induce in population and disease biology lead to periodic review of regimens (and sometimes dosage) based on changing immunologic data or public perceptions relevant to vaccine safety and effectiveness. EBV includes the use of evidence based medicine (EBM) both in clinical trials and in national disease containment programs. The rationale for EBV is that the highest evidentiary standards are required to maintain a rigorous scientific basis of vaccine quality control in manufacture and to ensure valid determination of vaccine efficacy, field effectiveness and safety profiles (including post-licensure safety monitoring), cost-benefit analyses, and risk:benefit ratios. EBV is increasingly based on statistically validated, clearly defined laboratory, manufacturing, clinical and epidemiological research methods and procedures, codified as good laboratory practices (GLP), good manufacturing practices (GMP), good clinical research practices (GCRP) and in clinical and public health practice (good vaccination practices, GVP). Implementation demands many data-driven decisions made by a spectrum of specialists pre- and post-licensure, and is essential to maintaining public confidence in vaccines.

Are the claims made in orthopaedic print advertisements valid?

PubMed

Davidson, Donald J; Rankin, Kenneth S; Jensen, Cyrus D; Moverley, Robert; Reed, Mike R; Sprowson, Andrew P

2014-05-01

Advertisements are commonplace in orthopaedic journals and may influence the readership with claims of clinical and scientific fact. Since the last assessment of the claims made in orthopaedic print advertisements ten years ago, there have been legislative changes and media scrutiny which have shaped this practice. The purpose of this study is to re-evaluate these claims. Fifty claims from 50 advertisements were chosen randomly from six highly respected peer-reviewed orthopaedic journals (published July-December 2011). The evidence supporting each claim was assessed and validated by three orthopaedic surgeons. The assessors, blinded to product and company, rated the evidence and answered the following questions: Does the evidence as presented support the claim made in the advertisement and what is the quality of that evidence? Is the claim supported by enough evidence to influence your own clinical practice? Twenty-eight claims cited evidence from published literature, four from public presentations, 11 from manufacturer "data held on file" and seven had no supporting evidence. Only 12 claims were considered to have high-quality evidence and only 11 were considered well supported. A strong correlation was seen between the quality of evidence and strength of support (Spearman r = 0.945, p < 0.0001). The average ICC between the assessors' ratings was strong (r = 0.85) giving validity to the results. Orthopaedic surgeons must remain sceptical about the claims made in print advertisements. High-quality evidence is required by orthopaedic surgeons to influence clinical practice and this evidence should be sought by manufacturers wishing to market a successful product.

Teaching Urban High School Students Global Climate Change Information and Graph Interpretation Skills Using Evidence from the Scientific Literature

ERIC Educational Resources Information Center

Rule, Audrey C.; Meyer, Mary A.

2009-01-01

Curriculum materials designed to provide students with practice interpreting plotted evidence of global climate change were developed using graphs from the scientific literature and tested with one hundred urban high school students from a high-poverty school in a major northern city in the US. The graph interpretation lessons followed a…

A motor speech assessment for children with severe speech disorders: reliability and validity evidence.

PubMed

Strand, Edythe A; McCauley, Rebecca J; Weigand, Stephen D; Stoeckel, Ruth E; Baas, Becky S

2013-04-01

In this article, the authors report reliability and validity evidence for the Dynamic Evaluation of Motor Speech Skill (DEMSS), a new test that uses dynamic assessment to aid in the differential diagnosis of childhood apraxia of speech (CAS). Participants were 81 children between 36 and 79 months of age who were referred to the Mayo Clinic for diagnosis of speech sound disorders. Children were given the DEMSS and a standard speech and language test battery as part of routine evaluations. Subsequently, intrajudge, interjudge, and test-retest reliability were evaluated for a subset of participants. Construct validity was explored for all 81 participants through the use of agglomerative cluster analysis, sensitivity measures, and likelihood ratios. The mean percentage of agreement for 171 judgments was 89% for test-retest reliability, 89% for intrajudge reliability, and 91% for interjudge reliability. Agglomerative hierarchical cluster analysis showed that total DEMSS scores largely differentiated clusters of children with CAS vs. mild CAS vs. other speech disorders. Positive and negative likelihood ratios and measures of sensitivity and specificity suggested that the DEMSS does not overdiagnose CAS but sometimes fails to identify children with CAS. The value of the DEMSS in differential diagnosis of severe speech impairments was supported on the basis of evidence of reliability and validity.

Annual review of selected scientific literature: Report of the committee on scientific investigation of the American Academy of Restorative Dentistry.

PubMed

Donovan, Terence E; Marzola, Riccardo; Murphy, Kevin R; Cagna, David R; Eichmiller, Frederick; McKee, James R; Metz, James E; Albouy, Jean-Pierre

2016-11-01

It is clear the contemporary dentist is confronted with a blizzard of information regarding materials and techniques from journal articles, advertisements, newsletters, the internet, and continuing education events. While some of that information is sound and helpful, much of it is misleading at best. This review identifies and discusses the most important scientific findings regarding outcomes of dental treatment to assist the practitioner in making evidence-based choices. This review was conducted to assist the busy dentist in keeping abreast of the latest scientific information regarding the clinical practice of dentistry. Each of the authors, who are considered experts in their disciplines, was asked to peruse the scientific literature published in 2015 in their discipline and review the articles for important information that may have an impact on treatment decisions. Comments on experimental methodology, statistical evaluation, and overall validity of the conclusions are included in many of the reviews. The reviews are not meant to stand alone but are intended to inform the interested reader about what has been discovered in the past year. The readers are then invited to go to the source if they wish more detail. Analysis of the scientific literature published in 2015 is divided into 7 sections, dental materials, periodontics, prosthodontics, occlusion and temporomandibular disorders, sleep-disordered breathing, cariology, and implant dentistry. Copyright © 2016 Editorial Council for the Journal of Prosthetic Dentistry. Published by Elsevier Inc. All rights reserved.

The Importance of Multi-Group Validity Evidence in Gifted and Talented Identification and Research

ERIC Educational Resources Information Center

Peters, Scott J.

2011-01-01

Practitioners and researchers often review the validity evidence of an instrument before using it for student assessment or in the practice of diagnosing or identifying children with exceptionalities. However, few test manuals present data on instrument measurement equivalence/ invariance or differential item functioning. This information is…

Application of evidence-based dentistry: from research to clinical periodontal practice.

PubMed

Kwok, Vivien; Caton, Jack G; Polson, Alan M; Hunter, Paul G

2012-06-01

Dentists need to make daily decisions regarding patient care, and these decisions should essentially be scientifically sound. Evidence-based dentistry is meant to empower clinicians to provide the most contemporary treatment. The benefits of applying the evidence-based method in clinical practice include application of the most updated treatment and stronger reasoning to justify the treatment. A vast amount of information is readily accessible with today's digital technology, and a standardized search protocol can be developed to ensure that a literature search is valid, specific and repeatable. It involves developing a preset question (population, intervention, comparison and outcome; PICO) and search protocol. It is usually used academically to perform commissioned reviews, but it can also be applied to answer simple clinical queries. The scientific evidence thus obtained can then be considered along with patient preferences and values, clinical patient circumstances and the practitioner's experience and judgment in order to make the treatment decision. This paper describes how clinicians can incorporate evidence-based methods into patient care and presents a clinical example to illustrate the process. © 2012 John Wiley & Sons A/S.

Validation and Use of a Predictive Modeling Tool: Employing Scientific Findings to Improve Responsible Conduct of Research Education.

PubMed

Mulhearn, Tyler J; Watts, Logan L; Todd, E Michelle; Medeiros, Kelsey E; Connelly, Shane; Mumford, Michael D

2017-01-01

Although recent evidence suggests ethics education can be effective, the nature of specific training programs, and their effectiveness, varies considerably. Building on a recent path modeling effort, the present study developed and validated a predictive modeling tool for responsible conduct of research education. The predictive modeling tool allows users to enter ratings in relation to a given ethics training program and receive instantaneous evaluative information for course refinement. Validation work suggests the tool's predicted outcomes correlate strongly (r = 0.46) with objective course outcomes. Implications for training program development and refinement are discussed.

Convergent validity evidence for the Pain and Discomfort Scale (PADS) for pain assessment among adults with intellectual disability

PubMed Central

Shinde, Satomi K.; Danov, Stacy; Chen, Chin-Chih; Clary, Jamie; Harper, Vicki; Bodfish, James W.; Symons, Frank J.

2014-01-01

Objectives The main aim of the study was to generate initial convergent validity evidence for the Pain and Discomfort Scale (PADS) for use with non-verbal adults with intellectual disabilities (ID). Methods Forty-four adults with intellectual disability (mean age = 46, 52 % male) were evaluated using a standardized sham-controlled and blinded sensory testing protocol, from which FACS and PADS scores were tested for (1) sensitivity to an array of calibrated sensory stimuli, (2) specificity (active vs. sham trials), and (3) concordance. Results The primary findings were that participants were reliably coded using both FACS and PADS approaches as being reactive to the sensory stimuli (FACS: F[2, 86] = 4.71, P < .05, PADS: F[2, 86] = 21.49, P < .05) (sensitivity evidence), not reactive during the sham stimulus trials (FACS: F[1, 43]= 3.77, p = .06, PADS: F[1, 43] = 5.87, p = .02) (specificity evidence), and there were significant (r = .41 – .51, p < .01) correlations between PADS and FACS (convergent validity evidence). Discussion FACS is an objective coding platform for facial expression. It requires intensive training and resources for scoring. As such it may be limited for clinical application. PADS was designed for clinical application. PADS scores were comparable to FACS scores under controlled evaluation conditions providing partial convergent validity evidence for its use. PMID:24135902

LTDNA Evidence on Trial

PubMed Central

Roberts, Paul

2016-01-01

Adopting the interpretative/hermeneutical method typical of much legal scholarship, this article considers two sets of issues pertaining to LTDNA profiles as evidence in criminal proceedings. The section titled Expert Evidence as Forensic Epistemic Warrant addresses some rather large questions about the epistemic status and probative value of expert testimony in general. It sketches a theoretical model of expert evidence, highlighting five essential criteria: (1) expert competence; (2) disciplinary domain; (3) methodological validity; (4) materiality; and (5) legal admissibility. This generic model of expert authority, highlighting law's fundamentally normative character, applies to all modern forms of criminal adjudication, across Europe and farther afield. The section titled LTDNA Evidence in UK Criminal Trials then examines English and Northern Irish courts' attempts to get to grips with LTDNA evidence in recent cases. Better appreciating the ways in which UK courts have addressed the challenges of LTDNA evidence may offer some insights into parallel developments in other legal systems. Appellate court rulings follow a predictable judicial logic, which might usefully be studied and reflected upon by any forensic scientist or statistician seeking to operate effectively in criminal proceedings. Whilst each legal jurisdiction has its own unique blend of jurisprudence, institutions, cultures and historical traditions, there is considerable scope for comparative analysis and cross-jurisdictional borrowing and instruction. In the spirit of promoting more nuanced and sophisticated international interdisciplinary dialogue, this article examines UK judicial approaches to LTDNA evidence and begins to elucidate their underlying institutional logic. Legal argument and broader policy debates are not confined to considerations of scientific validity, contamination risks and evidential integrity, or associated judgments of legal admissibility or exclusion. They also crucially

LTDNA Evidence on Trial.

PubMed

Roberts, Paul

2016-01-01

Adopting the interpretative/hermeneutical method typical of much legal scholarship, this article considers two sets of issues pertaining to LTDNA profiles as evidence in criminal proceedings. The section titled Expert Evidence as Forensic Epistemic Warrant addresses some rather large questions about the epistemic status and probative value of expert testimony in general. It sketches a theoretical model of expert evidence, highlighting five essential criteria: (1) expert competence; (2) disciplinary domain; (3) methodological validity; (4) materiality; and (5) legal admissibility. This generic model of expert authority, highlighting law's fundamentally normative character, applies to all modern forms of criminal adjudication, across Europe and farther afield. The section titled LTDNA Evidence in UK Criminal Trials then examines English and Northern Irish courts' attempts to get to grips with LTDNA evidence in recent cases. Better appreciating the ways in which UK courts have addressed the challenges of LTDNA evidence may offer some insights into parallel developments in other legal systems. Appellate court rulings follow a predictable judicial logic, which might usefully be studied and reflected upon by any forensic scientist or statistician seeking to operate effectively in criminal proceedings. Whilst each legal jurisdiction has its own unique blend of jurisprudence, institutions, cultures and historical traditions, there is considerable scope for comparative analysis and cross-jurisdictional borrowing and instruction. In the spirit of promoting more nuanced and sophisticated international interdisciplinary dialogue, this article examines UK judicial approaches to LTDNA evidence and begins to elucidate their underlying institutional logic. Legal argument and broader policy debates are not confined to considerations of scientific validity, contamination risks and evidential integrity, or associated judgments of legal admissibility or exclusion. They also crucially

Validity of CBCL-derived PTSD and dissociation scales: further evidence in a sample of neglected children and adolescents.

PubMed

Milot, Tristan; Plamondon, André; Ethier, Louise S; Lemelin, Jean-Pascal; St-Laurent, Diane; Rousseau, Michel

2013-05-01

There is growing evidence that child neglect is an important risk factor for posttraumatic stress disorder (PTSD) and dissociation. Considering that the Child Behavior Checklist (CBCL) is a widely used measure, the possibility of using validated CBCL-derived trauma symptoms scales could be particularly useful to better understand how trauma symptoms develop among neglected children and adolescents. This study examined the factor structure of three CBCL-derived measures of PTSD and dissociation (namely, PTSD scale, Dissociation scale, and PTSD/Dissociation scale) in a sample of 239 neglected children and adolescents aged 6 to 18 years using the latest version of CBCL (CBCL 6-18). Evidence of convergent validity of these scales was also examined for participants aged 12 and under using two well-validated measures of PTSD and Dissociation: the Trauma Symptoms Checklist for Young Children and the Child Dissociation Checklist. Findings suggest that CBCL-derived measures of trauma symptoms, especially PTSD and Dissociations scales, may be of heuristic value in the study of trauma symptomatology in neglected samples. Factor structure and evidence of convergent validity were supported for these two scales. Results also provide further support to the well-established assumption that PTSD and dissociation are two related but different constructs.

Is there scientific evidence favoring the substitution of commercially pure titanium with titanium alloys for the manufacture of dental implants?

PubMed

Cordeiro, Jairo M; Barão, Valentim A R

2017-02-01

The development of Ti alloys to manufacture dental implants has emerged in recent years due to the increased failure of commercially pure titanium (cpTi) implants. Thus, this study reviews existing information about the mechanical, chemical, electrochemical, and biological properties of the main Ti alloys developed over the past few years to provide scientific evidence in favor of using Ti-based alloys as alternative to cpTi. Ti alloys may be considered viable substitutes in the fabrication of dental implants. Such evidence is given by the enhanced properties of alloys, such as a low elastic modulus, high tensile strength, satisfactory biocompatibility, and good corrosion and wear resistances. In addition, Ti alloys may be modified at the structural, chemical, and thermomechanical levels, which allows the development of materials in accordance with the demands of several situations encountered in clinical practice. Although several in vitro studies have established the superiority of Ti alloys over cpTi, mainly in terms of their mechanical properties, there is no scientific evidence that supports the total replacement of this material in vivo. This review demonstrates the superiority of β-type alloys. However, it is evident that in vivo studies are encouraged to test new alloys to consolidate their use as substitutes for cpTi. Copyright © 2016 Elsevier B.V. All rights reserved.

Variation, certainty, evidence, and change in dental education: employing evidence-based dentistry in dental education.

PubMed

Marinho, V C; Richards, D; Niederman, R

2001-05-01

Variation in health care, and more particularly in dental care, was recently chronicled in a Readers Digest investigative report. The conclusions of this report are consistent with sound scientific studies conducted in various areas of health care, including dental care, which demonstrate substantial variation in the care provided to patients. This variation in care parallels the certainty with which clinicians and faculty members often articulate strongly held, but very different opinions. Using a case-based dental scenario, we present systematic evidence-based methods for accessing dental health care information, evaluating this information for validity and importance, and using this information to make informed curricular and clinical decisions. We also discuss barriers inhibiting these systematic approaches to evidence-based clinical decision making and methods for effectively promoting behavior change in health care professionals.

Accumulation of Content Validation Evidence for the Critical Thinking Self-Assessment Scale.

PubMed

Nair, Girija Gopinathan; Hellsten, Laurie-Ann M; Stamler, Lynnette Leeseberg

2017-04-01

Critical thinking skills (CTS) are essential for nurses; assessing students' acquisition of these skills is a mandate of nursing curricula. This study aimed to develop a self-assessment instrument of critical thinking skills (Critical Thinking Self-Assessment Scale [CTSAS]) for students' self-monitoring. An initial pool of 196 items across 6 core cognitive skills and 16 subskills were generated using the American Philosophical Association definition of CTS. Experts' content review of the items and their ratings provided evidence of content relevance using the item-level content validity index (I-CVI) and Aiken's content validity coefficient (VIk). 115 items were retained (range of I-CVI values = .70 to .94 and range of VIk values = .69-.95; significant at p< .05). The CTSAS is the first CTS instrument designed specifically for self-assessment purposes.

Electronic self-monitoring of mood using IT platforms in adult patients with bipolar disorder: A systematic review of the validity and evidence.

PubMed

Faurholt-Jepsen, Maria; Munkholm, Klaus; Frost, Mads; Bardram, Jakob E; Kessing, Lars Vedel

2016-01-15

Various paper-based mood charting instruments are used in the monitoring of symptoms in bipolar disorder. During recent years an increasing number of electronic self-monitoring tools have been developed. The objectives of this systematic review were 1) to evaluate the validity of electronic self-monitoring tools as a method of evaluating mood compared to clinical rating scales for depression and mania and 2) to investigate the effect of electronic self-monitoring tools on clinically relevant outcomes in bipolar disorder. A systematic review of the scientific literature, reported according to the Preferred Reporting items for Systematic Reviews and Meta-Analysis (PRISMA) guidelines was conducted. MEDLINE, Embase, PsycINFO and The Cochrane Library were searched and supplemented by hand search of reference lists. Databases were searched for 1) studies on electronic self-monitoring tools in patients with bipolar disorder reporting on validity of electronically self-reported mood ratings compared to clinical rating scales for depression and mania and 2) randomized controlled trials (RCT) evaluating electronic mood self-monitoring tools in patients with bipolar disorder. A total of 13 published articles were included. Seven articles were RCTs and six were longitudinal studies. Electronic self-monitoring of mood was considered valid compared to clinical rating scales for depression in six out of six studies, and in two out of seven studies compared to clinical rating scales for mania. The included RCTs primarily investigated the effect of heterogeneous electronically delivered interventions; none of the RCTs investigated the sole effect of electronic mood self-monitoring tools. Methodological issues with risk of bias at different levels limited the evidence in the majority of studies. Electronic self-monitoring of mood in depression appears to be a valid measure of mood in contrast to self-monitoring of mood in mania. There are yet few studies on the effect of electronic

Evidence of validity of the Stress-Producing Life Events (SPLE) instrument.

PubMed

Rizzini, Marta; Santos, Alcione Miranda Dos; Silva, Antônio Augusto Moura da

2018-01-01

OBJECTIVE Evaluate the construct validity of a list of eight Stressful Life Events in pregnant women. METHODS A cross-sectional study was conducted with 1,446 pregnant women in São Luís, MA, and 1,364 pregnant women in Ribeirão Preto, SP (BRISA cohort), from February 2010 to June 2011. In the exploratory factorial analysis, the promax oblique rotation was used and for the calculation of the internal consistency, we used the compound reliability. The construct validity was determined by means of the confirmatory factorial analysis with the method of estimation of weighted least squares adjusted by the mean and variance. RESULTS The model with the best fit in the exploratory analysis was the one that retained three factors with a cumulative variance of 61.1%. The one-factor model did not obtain a good fit in both samples in the confirmatory analysis. The three-factor model called Stress-Producing Life Events presented a good fit (RMSEA < 0.05; CFI/TLI > 0.90) for both samples. CONCLUSIONS The Stress-Producing Life Events constitute a second order construct with three dimensions related to health, personal and financial aspects and violence. This study found evidence that confirms the construct validity of a list of stressor events, entitled Stress-Producing Life Events Inventory.

Representation and Misrepresentation of Scientific Evidence in Contemporary Tobacco Regulation: A Review of Tobacco Industry Submissions to the UK Government Consultation on Standardised Packaging

PubMed Central

Ulucanlar, Selda; Fooks, Gary J.; Hatchard, Jenny L.; Gilmore, Anna B.

2014-01-01

Background Standardised packaging (SP) of tobacco products is an innovative tobacco control measure opposed by transnational tobacco companies (TTCs) whose responses to the UK government's public consultation on SP argued that evidence was inadequate to support implementing the measure. The government's initial decision, announced 11 months after the consultation closed, was to wait for ‘more evidence’, but four months later a second ‘independent review’ was launched. In view of the centrality of evidence to debates over SP and TTCs' history of denying harms and manufacturing uncertainty about scientific evidence, we analysed their submissions to examine how they used evidence to oppose SP. Methods and Findings We purposively selected and analysed two TTC submissions using a verification-oriented cross-documentary method to ascertain how published studies were used and interpretive analysis with a constructivist grounded theory approach to examine the conceptual significance of TTC critiques. The companies' overall argument was that the SP evidence base was seriously flawed and did not warrant the introduction of SP. However, this argument was underpinned by three complementary techniques that misrepresented the evidence base. First, published studies were repeatedly misquoted, distorting the main messages. Second, ‘mimicked scientific critique’ was used to undermine evidence; this form of critique insisted on methodological perfection, rejected methodological pluralism, adopted a litigation (not scientific) model, and was not rigorous. Third, TTCs engaged in ‘evidential landscaping’, promoting a parallel evidence base to deflect attention from SP and excluding company-held evidence relevant to SP. The study's sample was limited to sub-sections of two out of four submissions, but leaked industry documents suggest at least one other company used a similar approach. Conclusions The TTCs' claim that SP will not lead to public health benefits is largely

The predictive validity of quality of evidence grades for the stability of effect estimates was low: a meta-epidemiological study.

PubMed

Gartlehner, Gerald; Dobrescu, Andreea; Evans, Tammeka Swinson; Bann, Carla; Robinson, Karen A; Reston, James; Thaler, Kylie; Skelly, Andrea; Glechner, Anna; Peterson, Kimberly; Kien, Christina; Lohr, Kathleen N

2016-02-01

To determine the predictive validity of the U.S. Evidence-based Practice Center (EPC) approach to GRADE (Grading of Recommendations Assessment, Development and Evaluation). Based on Cochrane reports with outcomes graded as high quality of evidence (QOE), we prepared 160 documents which represented different levels of QOE. Professional systematic reviewers dually graded the QOE. For each document, we determined whether estimates were concordant with high QOE estimates of the Cochrane reports. We compared the observed proportion of concordant estimates with the expected proportion from an international survey. To determine the predictive validity, we used the Hosmer-Lemeshow test to assess calibration and the C (concordance) index to assess discrimination. The predictive validity of the EPC approach to GRADE was limited. Estimates graded as high QOE were less likely, estimates graded as low or insufficient QOE more likely to remain stable than expected. The EPC approach to GRADE could not reliably predict the likelihood that individual bodies of evidence remain stable as new evidence becomes available. C-indices ranged between 0.56 (95% CI, 0.47 to 0.66) and 0.58 (95% CI, 0.50 to 0.67) indicating a low discriminatory ability. The limited predictive validity of the EPC approach to GRADE seems to reflect a mismatch between expected and observed changes in treatment effects as bodies of evidence advance from insufficient to high QOE. Copyright © 2016 Elsevier Inc. All rights reserved.

Shared scientific thinking in everyday parent-child activity

NASA Astrophysics Data System (ADS)

Crowley, Kevin; Callanan, Maureen A.; Jipson, Jennifer L.; Galco, Jodi; Topping, Karen; Shrager, Jeff

2001-11-01

Current accounts of the development of scientific reasoning focus on individual children's ability to coordinate the collection and evaluation of evidence with the creation of theories to explain the evidence. This observational study of parent-child interactions in a children's museum demonstrated that parents shape and support children's scientific thinking in everyday, nonobligatory activity. When children engaged an exhibit with parents, their exploration of evidence was observed to be longer, broader, and more focused on relevant comparisons than children who engaged the exhibit without their parents. Parents were observed to talk to children about how to select and encode appropriate evidence and how to make direct comparisons between the most informative kinds of evidence. Parents also sometimes assumed the role of explainer by casting children's experience in causal terms, connecting the experience to prior knowledge, or introducing abstract principles. We discuss these findings with respect to two dimensions of children's scientific thinking: developments in evidence collection and developments in theory construction.

Validity Evidence in Scale Development: The Application of Cross Validation and Classification-Sequencing Validation

ERIC Educational Resources Information Center

Acar, Tu¨lin

2014-01-01

In literature, it has been observed that many enhanced criteria are limited by factor analysis techniques. Besides examinations of statistical structure and/or psychological structure, such validity studies as cross validation and classification-sequencing studies should be performed frequently. The purpose of this study is to examine cross…

Masturbation: Scientific Evidence and Islam's View.

PubMed

Hoseini, Sayed Shahabuddin

2017-12-01

Masturbation is the stimulation of sexual organs usually to the point of orgasm with an essential autoerotic component. Due to the high prevalence of this sexual behavior, it was and still is a matter of debate if masturbation is a normal action without any side effects and even if it is advantageous or it is associated with side effects necessitating public education how to avoid it. In addition, it is a common question if masturbation is religiously lawful or not. In this study, I assess the results of scientific studies about this sexual behavior and also shed some light on the Islam's view about it.

Validation in the clinical process: four settings for objectification of the subjectivity of understanding.

PubMed

Beland, H

1994-12-01

Clinical material is presented for discussion with the aim of exemplifying the author's conceptions of validation in a number of sessions and in psychoanalytic research and of making them verifiable, susceptible to consensus and/or falsifiable. Since Freud's postscript to the Dora case, the first clinical validation in the history of psychoanalysis, validation has been group-related and society-related, that is to say, it combines the evidence of subjectivity with the consensus of the research community (the scientific community). Validation verifies the conformity of the unconscious transference meaning with the analyst's understanding. The deciding criterion is the patient's reaction to the interpretation. In terms of the theory of science, validation in the clinical process corresponds to experimental testing of truth in the sphere of inanimate nature. Four settings of validation can be distinguished: the analyst's self-supervision during the process of understanding, which goes from incomprehension to comprehension (container-contained, PS-->D, selected fact); the patient's reaction to the interpretation (insight) and the analyst's assessment of the reaction; supervision and second thoughts; and discussion in groups and publications leading to consensus. It is a peculiarity of psychoanalytic research that in the event of positive validation the three criteria of truth (evidence, consensus and utility) coincide.

The importance of scientific evaluation of biological evidence--data from eight years of case review.

PubMed

Coyle, Heather Miller

2012-12-01

In 2009, the National Research Council published a report stating that the addition of more science and technology into the field of forensic science in the United States would be of great benefit to the judicial system. As a starting point to address this NRC report, one needs to make an assessment of the system. One factor that is continuously requested is an estimate of an error rate. In any given scientific area of forensics that is difficult to quantitate except by external review and audits. After eight years of requested defense review of cases with biological and DNA evidence, most cases appear to be scientifically sound in test methods and procedures. However, there were some cases where errors in the forensic science process did occur. This article takes information compiled from those eight years of defense review and summarizes the cases where errors have been discovered and discusses the scientific implications of these errors. The scope of this article is limited to crime scene collection and forensic science laboratory testing of biological materials for body fluid identification and DNA individualization to a source. The greatest value of defense review comes from (a) providing effective balance and independent oversight to the judicial process and (b) collecting data into a format that can be useful as a guide in training programs. Copyright © 2012 Forensic Science Society. Published by Elsevier Ireland Ltd. All rights reserved.

The Educational Validity and Utility of Single-Case Design Research in Building Evidence-Based Practices in Education

ERIC Educational Resources Information Center

Kourea, Lefki; Lo, Ya-yu

2016-01-01

Improving academic, behavioural, and social outcomes of students through empirical research has been a firm commitment among researchers, policy-makers, and other professionals in education across Europe and the United States (U.S.). To assist in building scientific evidences, executive bodies such as the European Commission and the Institute for…

Analytic Validation of Immunohistochemical Assays: A Comparison of Laboratory Practices Before and After Introduction of an Evidence-Based Guideline.

PubMed

Fitzgibbons, Patrick L; Goldsmith, Jeffrey D; Souers, Rhona J; Fatheree, Lisa A; Volmar, Keith E; Stuart, Lauren N; Nowak, Jan A; Astles, J Rex; Nakhleh, Raouf E

2017-09-01

- Laboratories must demonstrate analytic validity before any test can be used clinically, but studies have shown inconsistent practices in immunohistochemical assay validation. - To assess changes in immunohistochemistry analytic validation practices after publication of an evidence-based laboratory practice guideline. - A survey on current immunohistochemistry assay validation practices and on the awareness and adoption of a recently published guideline was sent to subscribers enrolled in one of 3 relevant College of American Pathologists proficiency testing programs and to additional nonsubscribing laboratories that perform immunohistochemical testing. The results were compared with an earlier survey of validation practices. - Analysis was based on responses from 1085 laboratories that perform immunohistochemical staining. Of 1057 responses, 65.4% (691) were aware of the guideline recommendations before this survey was sent and 79.9% (550 of 688) of those have already adopted some or all of the recommendations. Compared with the 2010 survey, a significant number of laboratories now have written validation procedures for both predictive and nonpredictive marker assays and specifications for the minimum numbers of cases needed for validation. There was also significant improvement in compliance with validation requirements, with 99% (100 of 102) having validated their most recently introduced predictive marker assay, compared with 74.9% (326 of 435) in 2010. The difficulty in finding validation cases for rare antigens and resource limitations were cited as the biggest challenges in implementing the guideline. - Dissemination of the 2014 evidence-based guideline validation practices had a positive impact on laboratory performance; some or all of the recommendations have been adopted by nearly 80% of respondents.

Sudden Cardiac Risk Stratification with Electrocardiographic Indices - A Review on Computational Processing, Technology Transfer, and Scientific Evidence

PubMed Central

Gimeno-Blanes, Francisco J.; Blanco-Velasco, Manuel; Barquero-Pérez, Óscar; García-Alberola, Arcadi; Rojo-Álvarez, José L.

2016-01-01

Great effort has been devoted in recent years to the development of sudden cardiac risk predictors as a function of electric cardiac signals, mainly obtained from the electrocardiogram (ECG) analysis. But these prediction techniques are still seldom used in clinical practice, partly due to its limited diagnostic accuracy and to the lack of consensus about the appropriate computational signal processing implementation. This paper addresses a three-fold approach, based on ECG indices, to structure this review on sudden cardiac risk stratification. First, throughout the computational techniques that had been widely proposed for obtaining these indices in technical literature. Second, over the scientific evidence, that although is supported by observational clinical studies, they are not always representative enough. And third, via the limited technology transfer of academy-accepted algorithms, requiring further meditation for future systems. We focus on three families of ECG derived indices which are tackled from the aforementioned viewpoints, namely, heart rate turbulence (HRT), heart rate variability (HRV), and T-wave alternans. In terms of computational algorithms, we still need clearer scientific evidence, standardizing, and benchmarking, siting on advanced algorithms applied over large and representative datasets. New scenarios like electronic health recordings, big data, long-term monitoring, and cloud databases, will eventually open new frameworks to foresee suitable new paradigms in the near future. PMID:27014083

A Motor Speech Assessment for Children with Severe Speech Disorders: Reliability and Validity Evidence

ERIC Educational Resources Information Center

Strand, Edythe A.; McCauley, Rebecca J.; Weigand, Stephen D.; Stoeckel, Ruth E.; Baas, Becky S.

2013-01-01

Purpose: In this article, the authors report reliability and validity evidence for the Dynamic Evaluation of Motor Speech Skill (DEMSS), a new test that uses dynamic assessment to aid in the differential diagnosis of childhood apraxia of speech (CAS). Method: Participants were 81 children between 36 and 79 months of age who were referred to the…

Nine Criteria for a Measure of Scientific Output

PubMed Central

Kreiman, Gabriel; Maunsell, John H. R.

2011-01-01

Scientific research produces new knowledge, technologies, and clinical treatments that can lead to enormous returns. Often, the path from basic research to new paradigms and direct impact on society takes time. Precise quantification of scientific output in the short-term is not an easy task but is critical for evaluating scientists, laboratories, departments, and institutions. While there have been attempts to quantifying scientific output, we argue that current methods are not ideal and suffer from solvable difficulties. Here we propose criteria that a metric should have to be considered a good index of scientific output. Specifically, we argue that such an index should be quantitative, based on robust data, rapidly updated and retrospective, presented with confidence intervals, normalized by number of contributors, career stage and discipline, impractical to manipulate, and focused on quality over quantity. Such an index should be validated through empirical testing. The purpose of quantitatively evaluating scientific output is not to replace careful, rigorous review by experts but rather to complement those efforts. Because it has the potential to greatly influence the efficiency of scientific research, we have a duty to reflect upon and implement novel and rigorous ways of evaluating scientific output. The criteria proposed here provide initial steps toward the systematic development and validation of a metric to evaluate scientific output. PMID:22102840

Evidence of Convergent and Discriminant Validity of Child, Teacher, and Peer Reports of Teacher-Student Support

PubMed Central

Li, Yan; Hughes, Jan N.; Kwok, Oi-man; Hsu, Hsien-Yuan

2012-01-01

This study investigated the construct validity of measures of teacher-student support in a sample of 709 ethnically diverse second and third grade academically at-risk students. Confirmatory factor analysis investigated the convergent and discriminant validities of teacher, child, and peer reports of teacher-student support and child conduct problems. Results supported the convergent and discriminant validity of scores on the measures. Peer reports accounted for the largest proportion of trait variance and non-significant method variance. Child reports accounted for the smallest proportion of trait variance and the largest method variance. A model with two latent factors provided a better fit to the data than a model with one factor, providing further evidence of the discriminant validity of measures of teacher-student support. Implications for research, policy, and practice are discussed. PMID:21767024

Appearance motives to tan and not tan: evidence for validity and reliability of a new scale.

PubMed

Cafri, Guy; Thompson, J Kevin; Roehrig, Megan; Rojas, Ariz; Sperry, Steffanie; Jacobsen, Paul B; Hillhouse, Joel

2008-04-01

Risk for skin cancer is increased by UV exposure and decreased by sun protection. Appearance reasons to tan and not tan have consistently been shown to be related to intentions and behaviors to UV exposure and protection. This study was designed to determine the factor structure of appearance motives to tan and not tan, evaluate the extent to which this factor structure is gender invariant, test for mean differences in the identified factors, and evaluate internal consistency, temporal stability, and criterion-related validity. Five-hundred eighty-nine females and 335 male college students were used to test confirmatory factor analysis models within and across gender groups, estimate latent mean differences, and use the correlation coefficient and Cronbach's alpha to further evaluate the reliability and validity of the identified factors. A measurement invariant (i.e., factor-loading invariant) model was identified with three higher-order factors: sociocultural influences to tan (lower order factors: media, friends, family, significant others), appearance reasons to tan (general, acne, body shape), and appearance reasons not to tan (skin aging, immediate skin damage). Females had significantly higher means than males on all higher-order factors. All subscales had evidence of internal consistency, temporal stability, and criterion-related validity. This study offers a framework and measurement instrument that has evidence of validity and reliability for evaluating appearance-based motives to tan and not tan.

[Evidence-based medicine - the current self-reflection of an individualised approach to medicine as an action science].

PubMed

Behrens, Johann

2010-01-01

Evidence-based Medicine (EbM) is the ongoing self-reflection of an individualised approach to medicine in terms of a science that originates from and focuses on clinical decision-making (pragmatic science="Handlungswissenschaft"). EbM is particularly suitable for self-reflecting individualised medicine on the basis of decision-oriented pragmatic science because it consistently distinguishes between external evidence (i.e., other subjects' experience gained through "qualitative" and "quantitative" scientific methods) and internal evidence, i.e., the individual user's, or patient's, own experience manifesting and developing in the individual contact between therapist and patient. Therefore, internal evidence is completely different from the individual clinical experience, expertise, and conviction which therapists contribute to the encounter with clients. A deeper understanding of internal evidence as a result of this encounter has emerged only in the past 15 years. However, it is an integral part of the logic of evidence-based professional decision-making. Scientifically justified beneficial and effective treatment in the individual case cannot be deduced from external evidence but can only be gathered from internal evidence for which the best external evidence available has been utilised. In the past 15 years nursing science has not only carved out the decision-oriented scientific core of evidence-based practice but has also tried to increase the validity of studies on external evidence by employing a combination of 'qualitative' social science studies and clinical epidemiological methods. Copyright © 2010. Published by Elsevier GmbH.

Examining Evidence for the Validity of PISA Learning Strategy Scales Based on Student Response Processes

ERIC Educational Resources Information Center

Hopfenbeck, Therese N.; Maul, Andrew

2011-01-01

The aim of this study was to investigate response-process based evidence for the validity of the Programme for International Student Assessment's (PISA) self-report questionnaire scales as measures of specific psychological constructs, with a focus on scales meant to measure inclination toward specific learning strategies. Cognitive interviews (N…

Learning Crude Oil by Using Scientific Literacy Comics

NASA Astrophysics Data System (ADS)

Aisyah, R.; Zakiyah, I. A.; Farida, I.; Ramdhani, M. A.

2017-09-01

A research has been conducted to create a crude oil learning media in the form of scientific literacy-oriented comic. The research included some phases, namely: concept analysis, material transformation to concept map, indicator identification and science literacy aspect. The product was made based on flowcharts and storyboards that have been validated by expert validators. The product has characteristics namely; 1) Develops indicators and aspects of science literacy, 2) presents the materials in form of story of science fiction genre, 3) has characters adopting levels of scientific literacy, 4) has optional stories, because it depends on questions asked to develop scientific literacy in terms of content, context, process and attitude. Based on feasibility test, the product is feasible to be used as learning media. It is suggested to do an expanded experiment to examine its affectivity in improving scientific literacy and growing students’ awareness about the issues of energy crisis and the impacts of fossil fuel use on the environment.

The Scientific Foundation for Personal Genomics: Recommendations from a National Institutes of Health–Centers for Disease Control and Prevention Multidisciplinary Workshop

PubMed Central

Khoury, Muin J.; McBride, Colleen M.; Schully, Sheri D.; Ioannidis, John P. A.; Feero, W. Gregory; Janssens, A. Cecile J. W.; Gwinn, Marta; Simons-Morton, Denise G.; Bernhardt, Jay M.; Cargill, Michele; Chanock, Stephen J.; Church, George M.; Coates, Ralph J.; Collins, Francis S.; Croyle, Robert T.; Davis, Barry R.; Downing, Gregory J.; DuRoss, Amy; Friedman, Susan; Gail, Mitchell H.; Ginsburg, Geoffrey S.; Green, Robert C.; Greene, Mark H.; Greenland, Philip; Gulcher, Jeffrey R.; Hsu, Andro; Hudson, Kathy L.; Kardia, Sharon L. R.; Kimmel, Paul L.; Lauer, Michael S.; Miller, Amy M.; Offit, Kenneth; Ransohoff, David F.; Roberts, J. Scott; Rasooly, Rebekah S.; Stefansson, Kari; Terry, Sharon F.; Teutsch, Steven M.; Trepanier, Angela; Wanke, Kay L.; Witte, John S.; Xu, Jianfeng

2010-01-01

The increasing availability of personal genomic tests has led to discussions about the validity and utility of such tests and the balance of benefits and harms. A multidisciplinary workshop was convened by the National Institutes of Health and the Centers for Disease Control and Prevention to review the scientific foundation for using personal genomics in risk assessment and disease prevention and to develop recommendations for targeted research. The clinical validity and utility of personal genomics is a moving target with rapidly developing discoveries but little translation research to close the gap between discoveries and health impact. Workshop participants made recommendations in five domains: (1) developing and applying scientific standards for assessing personal genomic tests; (2) developing and applying a multidisciplinary research agenda, including observational studies and clinical trials to fill knowledge gaps in clinical validity and utility; (3) enhancing credible knowledge synthesis and information dissemination to clinicians and consumers; (4) linking scientific findings to evidence-based recommendations for use of personal genomics; and (5) assessing how the concept of personal utility can affect health benefits, costs, and risks by developing appropriate metrics for evaluation. To fulfill the promise of personal genomics, a rigorous multidisciplinary research agenda is needed. PMID:19617843

Law's Dilemma: Validating Complementary and Alternative Medicine and the Clash of Evidential Paradigms

PubMed Central

Iyioha, Ireh

2011-01-01

This paper examines the (in)compatibility between the diagnostic and therapeutic theories of complementary and alternative medicine (CAM) and a science-based regulatory framework. Specifically, the paper investigates the nexus between statutory legitimacy and scientific validation of health systems, with an examination of its impact on the development of complementary and alternative therapies. The paper evaluates competing theories for validating CAM ranging from the RCT methodology to anthropological perspectives and contends that while the RCT method might be beneficial in the regulation of many CAM therapies, yet dogmatic adherence to this paradigm as the exclusive method for legitimizing CAM will be adverse to the independent development of many CAM therapies whose philosophies and mechanisms of action are not scientifically interpretable. Drawing on history and research evidence to support this argument, the paper sues for a regulatory model that is accommodative of different evidential paradigms in support of a pluralistic healthcare system that balances the imperative of quality assurance with the need to ensure access. PMID:20953428

Translations of Developmental Screening Instruments: An Evidence Map of Available Research.

PubMed

El-Behadli, Ana F; Neger, Emily N; Perrin, Ellen C; Sheldrick, R Christopher

2015-01-01

Children whose parents do not speak English experience significant disparities in the identification of developmental delays and disorders; however, little is known about the availability and validity of translations of developmental screeners. The goal was to create a map of the scientific evidence regarding translations of the 9 Academy of Pediatrics-recommended screening instruments into languages other than English. The authors conducted a systematic search of Medline and PsycINFO, references of identified articles, publishers' Web sites, and official manuals. Through evidence mapping, a new methodology supported by AHRQ and the Cochrane Collaboration, the authors documented the extent and distribution of published evidence supporting translations of developmental screeners. Data extraction focused on 3 steps of the translation and validation process: (1) translation methods used, (2) collection of normative data in the target language, and (3) evidence for reliability and validity. The authors identified 63 distinct translations among the 9 screeners, of which 44 had supporting evidence published in peer-reviewed sources. Of the 63 translations, 35 had at least some published evidence regarding translation methods used, 28 involving normative data, and 32 regarding reliability and/or construct validity. One-third of the translations found were of the Denver Developmental Screening Test. Specific methods used varied greatly across screeners, as did the level of detail with which results were reported. Few developmental screeners have been translated into many languages. Evidence map of the authors demonstrates considerable variation in both the amount and the comprehensiveness of information available about translated instruments. Informal guidelines exist for conducting translation of psychometric instruments but not for documentation of this process. The authors propose that uniform guidelines be established for reporting translation research in peer

Scientific Versus Experiential Evidence: Discourse Analysis of the Chronic Cerebrospinal Venous Insufficiency Debate in a Multiple Sclerosis Forum.

PubMed

Koschack, Janka; Weibezahl, Lara; Friede, Tim; Himmel, Wolfgang; Makedonski, Philip; Grabowski, Jens

2015-07-01

into the dimensions "trust in evidence-based knowledge," "trust in experience-based knowledge," and "subjectivity" (ie, the emotional character of contributions manifested by the use of popular rhetoric that seemed to mask a deep personal involvement). By critical discourse analysis of the CCSVI discussion in a patient online forum, we reconstruct a lay discourse about the evidentiary value of knowledge. We detected evidence criteria in this lay discourse that are different from those in the expert discourse. But we should be cautious to interpret this dissociation as a sign of an intellectual incapability to understand scientific evidence or a naïve trust in experiential knowledge. Instead, it might be an indication of cognitive dissonance reduction to protect oneself against contradictory information.

Scientific Versus Experiential Evidence: Discourse Analysis of the Chronic Cerebrospinal Venous Insufficiency Debate in a Multiple Sclerosis Forum

PubMed Central

Weibezahl, Lara; Friede, Tim; Himmel, Wolfgang; Makedonski, Philip; Grabowski, Jens

2015-01-01

positions could be identified by arranging them into the dimensions “trust in evidence-based knowledge,” “trust in experience-based knowledge,” and “subjectivity” (ie, the emotional character of contributions manifested by the use of popular rhetoric that seemed to mask a deep personal involvement). Conclusions By critical discourse analysis of the CCSVI discussion in a patient online forum, we reconstruct a lay discourse about the evidentiary value of knowledge. We detected evidence criteria in this lay discourse that are different from those in the expert discourse. But we should be cautious to interpret this dissociation as a sign of an intellectual incapability to understand scientific evidence or a naïve trust in experiential knowledge. Instead, it might be an indication of cognitive dissonance reduction to protect oneself against contradictory information. PMID:26133525

Measuring Scientific Reasoning--A Review of Test Instruments

ERIC Educational Resources Information Center

Opitz, Ansgar; Heene, Moritz; Fischer, Frank

2017-01-01

Education systems increasingly emphasize the importance of scientific reasoning skills such as "generating hypotheses" and "evaluating evidence." Despite this importance, we do not know which tests of scientific reasoning exist, which skills they emphasize, how they conceptualize scientific reasoning, and how well they are…

Evidence-Based Practice in the social sciences? A scale of causality, interventions, and possibilities for scientific proof

PubMed Central

Tellings, Agnes

2017-01-01

This article discusses Evidence-Based Practice (EBP) in the social sciences. After a brief outline of the discussion, the work of William Herbert Dray (1921–2009) is examined. Dray, partly following Collingwood, worked on different forms of causality and methodology in historical explanation (in comparison to the social sciences), based on a distinction between causes and reasons. Dray’s ladder of rational understanding is also explored here. Taking his argumentation further and sometimes turning it upside-down, a scale of forms of causality is developed with accompanying types of interventions and possibilities for scientific proof of their effectivity. This scale makes it possible to weigh interventions regarding the degree to which “hard” scientific proof is possible for them. The article concludes with a brief discussion of how interventions in psychology and education should be chosen and can be justified, both those that do and those that don’t lend themselves to empirical research. PMID:28989240

Evidence-based dental practice: part I. Formulating clinical questions and searching for answers.

PubMed

Adeyemo, W L; Akinwande, J A; Bamgbose, B O

2007-01-01

Evidence-based dentistry (EBD) is an approach to oral health care that requires the judicious integration of systematic assessments of clinically relevant scientific evidence, relating to the patient's oral and medical condition and history, with the dentist's clinical expertise and the patient's treatment needs and preferences. Evidence-based care is now regarded as the "gold standard" in health care delivery worldwide. EBD involves tracking down the available evidence, assessing its validity and relevance, and then using the "best" evidence to inform decisions regarding care. Although, the concept of evidence-based dentistry is not new, however, anecdotal evidence suggests that the awareness of this concept among Nigerian dental practitioners is low. This first of three articles on evidence-based dental practice discusses the historical background of evidence-based medicine/evidence-based dentistry, how to formulate clear clinical questions and how to track down (search) the available evidence in the literature databases.

Fostering Scientific Reasoning in Education--Meta-Analytic Evidence from Intervention Studies

ERIC Educational Resources Information Center

Engelmann, Katharina; Neuhaus, Birgit J.; Fischer, Frank

2016-01-01

Scientific reasoning skills are not just for researchers, they are also increasingly relevant for making informed decisions in our everyday lives. How can these skills be facilitated? The current state of research on supporting scientific reasoning includes intervention studies but lacks an integrated analysis of the approaches to foster…

A brief review of current scientific evidence involving aromatherapy use for nausea and vomiting.

PubMed

Lua, Pei Lin; Zakaria, Noor Salihah

2012-06-01

The objective of this study was to compile existing scientific evidence regarding the effects of essential oils (EOs) administered via inhalation for the alleviation of nausea and vomiting. CINAHL, PubMed, and EBSCO Host and Science Direct databases were searched for articles related to the use of EOs and/or aromatherapy for nausea and vomiting. Only articles using English as a language of publication were included. Eligible articles included all forms of evidence (nonexperimental, experimental, case report). Interventions were limited to the use of EOs by inhalation of their vapors to treat symptoms of nausea and vomiting in various conditions regardless of age group. Studies where the intervention did not utilize EOs or were concerned with only alcohol inhalation and trials that combined the use of aromatherapy with other treatments (massage, relaxations, or acupressure) were excluded. Five (5) articles met the inclusion criteria encompassing trials with 328 respondents. Their results suggest that the inhaled vapor of peppermint or ginger essential oils not only reduced the incidence and severity of nausea and vomiting but also decreased antiemetic requirements and consequently improved patient satisfaction. However, a definitive conclusion could not be drawn due to methodological flaws in the existing research articles and an acute lack of additional research in this area. The existing evidence is encouraging but yet not compelling. Hence, further well-designed large trials are needed before confirmation of EOs effectiveness in treating nausea and vomiting can be strongly substantiated.

Science and Pseudoscience in Medicine: Evidence-Based vs. Evidence-Biased Medicine.

PubMed

Jakovljević, Miro; Ostojić, Ljerka

2016-12-01

The concept of evidence-based medicine (EBM), as the highest standard of health care, came into existence in 1990s to promote a systematic approach to helping clinicians in their practice to be guided by the best available scientific evidence. However, there has been an increasing number of warning reports that in modern research, misrepresented, false and unuseful findings may be the majority or even the vast majority of published research claims In spite of the huge scientific progress, pseudoscience and associated evidence biased medicine represent a serious threat to the concept of the EBM. Effective education in medicine, proper research motivation, sound systems and creative thinking and culture of scientific dialogue may significantly contribute to better science and evidence-based medicine. The seven key words of good science, research and publishing are: integrity, motivation, capacity, understanding, knowledge, experience, and creativity.

Mismatches between 'scientific' and 'non-scientific' ways of knowing and their contributions to public understanding of science.

PubMed

Mikulak, Anna

2011-06-01

As differentiation within scientific disciplines increases, so does differentiation between the sciences and other ways of knowing. This distancing between 'scientific' and 'non-scientific' cultures reflects differences in what are considered valid and reliable approaches to acquiring knowledge and has played a major role in recent science-oriented controversies. Scientists' reluctance to actively engage in science communication, coupled with journalists' reliance on the norms of balance, conflict, and human interest in covering scientific issues, have combined to exacerbate public mistrust of science on issues like the measles-mumps-rubella (MMR) vaccine. The failure of effective communications between scientists and non-scientists has hindered the progress of both effective science and effective policy. In order to better bridge the gap between the 'scientific' and 'non-scientific' cultures, renewed efforts must be made to encourage substantive public engagement, with the ultimate goal of facilitating an open, democratic policy-making process.

[Summary: Scientific evaluation of EMDR psychotherapy].

PubMed

Haour, F; de Beaurepaire, C

2016-06-01

The evaluation of psychotherapy methods is made difficult by their practical and theoretical diversities as well as the increasing number of available therapies. Evaluation based on scientific criteria in randomized control trials is providing the highest level of proof and recognition by Health Agencies. A recently described integrative psychotherapy, eye movement desensitization and reprocessing (EMDR), developed by F. Shapiro since 1989, has been confronted with the validation procedure used in pharmacological treatment. It was of interest to review the scientific validation steps carried out for this EMDR psychotherapy and for its mechanisms of action. The practical and methodological protocol of the EMDR psychotherapy for trauma integration is reviewed as well as clinical results and mechanisms. This EMDR therapy, focused on the resolutions of traumas, was started by treating patients with post-traumatic stress disorders (PTSD). The integrative EMDR protocol obtained the highest level of efficiency, for PTSD treatment, twenty years after its first publication. The efficiency of the protocol is now under study and scientific evaluation for troubles in which the trauma experiences are triggers or factors of maintenance of the troubles: anxiety, depression, phobia, sexual troubles, schizophrenia, etc. This new integrative psychotherapy follows the pathways and the timing observed for the evaluation and the validation of other therapies. Copyright © 2016 L'Encéphale, Paris. Published by Elsevier Masson SAS. All rights reserved.

[Controversies about instrumented surgery and pain relief in degenerative lumbar spine pain. Results of scientific evidence].

PubMed

Robaina-Padrón, F J

2007-10-01

Investigation and development of new techniques for intrumented surgery of the spine is not free of conflicts of interest. The influence of financial forces in the development of new technologies an its immediately application to spine surgery, shows the relationship between the published results and the industry support. Even authors who have defend eagerly fusion techniques, it have been demonstrated that them are very much involved in the revision of new articles to be published and in the approval process of new spinal technologies. When we analyze the published results of spine surgery, we must bear in mind what have been call in the "American Stock and Exchange" as "the bubble of spine surgery". The scientific literature doesn't show clear evidence in the cost-benefit studies of most instrumented surgical interventions of the spine compare with the conservative treatments. It has not been yet demonstrated that fusion surgery and disc replacement are better options than the conservative treatment. It's necessary to point out that at present "there are relationships between the industry and back pain, and there is also an industry of the back pain". Nonetheless, the "market of the spine surgery" is growing up because patients are demanding solutions for their back problems. The tide of scientific evidence seams to go against the spinal fusions in the degenerative disc disease, discogenic pain and inespecific back pain. After decades of advances in this field, the results of spinal fusions are mediocre. New epidemiological studies show that "spinal fusion must be accepted as a non proved or experimental method for the treatment of back pain". The surgical literature on spinal fusion published in the last 20 years following the Cochrane's method establish that: 1- this is at least incomplete, not reliable and careless; 2- the instrumentation seems to slightly increase the fusion rate; 3- the instrumentation doesn't improve the clinical results in general, lacking

Validation of Alternative In Vitro Methods to Animal Testing: Concepts, Challenges, Processes and Tools.

PubMed

Griesinger, Claudius; Desprez, Bertrand; Coecke, Sandra; Casey, Warren; Zuang, Valérie

This chapter explores the concepts, processes, tools and challenges relating to the validation of alternative methods for toxicity and safety testing. In general terms, validation is the process of assessing the appropriateness and usefulness of a tool for its intended purpose. Validation is routinely used in various contexts in science, technology, the manufacturing and services sectors. It serves to assess the fitness-for-purpose of devices, systems, software up to entire methodologies. In the area of toxicity testing, validation plays an indispensable role: "alternative approaches" are increasingly replacing animal models as predictive tools and it needs to be demonstrated that these novel methods are fit for purpose. Alternative approaches include in vitro test methods, non-testing approaches such as predictive computer models up to entire testing and assessment strategies composed of method suites, data sources and decision-aiding tools. Data generated with alternative approaches are ultimately used for decision-making on public health and the protection of the environment. It is therefore essential that the underlying methods and methodologies are thoroughly characterised, assessed and transparently documented through validation studies involving impartial actors. Importantly, validation serves as a filter to ensure that only test methods able to produce data that help to address legislative requirements (e.g. EU's REACH legislation) are accepted as official testing tools and, owing to the globalisation of markets, recognised on international level (e.g. through inclusion in OECD test guidelines). Since validation creates a credible and transparent evidence base on test methods, it provides a quality stamp, supporting companies developing and marketing alternative methods and creating considerable business opportunities. Validation of alternative methods is conducted through scientific studies assessing two key hypotheses, reliability and relevance of the

Validation of Automated Scoring for a Formative Assessment That Employs Scientific Argumentation

ERIC Educational Resources Information Center

Mao, Liyang; Liu, Ou Lydia; Roohr, Katrina; Belur, Vinetha; Mulholland, Matthew; Lee, Hee-Sun; Pallant, Amy

2018-01-01

Scientific argumentation is one of the core practices for teachers to implement in science classrooms. We developed a computer-based formative assessment to support students' construction and revision of scientific arguments. The assessment is built upon automated scoring of students' arguments and provides feedback to students and teachers.…

Medical marijuana: the conflict between scientific evidence and political ideology. Part two of two.

PubMed

Cohen, Peter J

2009-01-01

In Part I of this article, I examined the role of the Food and Drug Administration (FDA) in drug approval and then detailed the known risks of medical marijuana (any form of Cannabis sativa used--usually by smoking--to treat a wide variety of pathologic states and diseases). Part II of the article will begin by reviewing the benefits of Cannabis sativa as documented by well designed scientific studies that have been published in the peer-reviewed literature. I will then propose that ability of scientists to conduct impartial studies designed to answer the question of marijuana's role in medical therapy has been greatly hampered by political considerations. I will posit that in spite of the considerable efforts of policymakers, it is becoming apparent that marijuana's benefits should be weighed against its well-described risks. I will conclude that political advocacy is a poor substitute for dispassionate analysis and that neither popular votes nor congressional "findings" should be permitted to trump scientific evidence in deciding whether or not marijuana is an appropriate pharmaceutical agent to use in modern medical practice. Whether or not marijuana is accepted as a legitimate medical therapy should remain in the hands of the usual drug-approval process and that the statutory role of the Food and Drug Administration should be dispositive.

Procedure-specific assessment tool for flexible pharyngo-laryngoscopy: gathering validity evidence and setting pass-fail standards.

PubMed

Melchiors, Jacob; Petersen, K; Todsen, T; Bohr, A; Konge, Lars; von Buchwald, Christian

2018-06-01

The attainment of specific identifiable competencies is the primary measure of progress in the modern medical education system. The system, therefore, requires a method for accurately assessing competence to be feasible. Evidence of validity needs to be gathered before an assessment tool can be implemented in the training and assessment of physicians. This evidence of validity must according to the contemporary theory on validity be gathered from specific sources in a structured and rigorous manner. The flexible pharyngo-laryngoscopy (FPL) is central to the otorhinolaryngologist. We aim to evaluate the flexible pharyngo-laryngoscopy assessment tool (FLEXPAT) created in a previous study and to establish a pass-fail level for proficiency. Eighteen physicians with different levels of experience (novices, intermediates, and experienced) were recruited to the study. Each performed an FPL on two patients. These procedures were video recorded, blinded, and assessed by two specialists. The score was expressed as the percentage of a possible max score. Cronbach's α was used to analyze internal consistency of the data, and a generalizability analysis was performed. The scores of the three different groups were explored, and a pass-fail level was determined using the contrasting groups' standard setting method. Internal consistency was strong with a Cronbach's α of 0.86. We found a generalizability coefficient of 0.72 sufficient for moderate stakes assessment. We found a significant difference between the novice and experienced groups (p < 0.001) and strong correlation between experience and score (Pearson's r = 0.75). The pass/fail level was established at 72% of the maximum score. Applying this pass-fail level in the test population resulted in half of the intermediary group receiving a failing score. We gathered validity evidence for the FLEXPAT according to the contemporary framework as described by Messick. Our results support a claim of validity and are

Dose-response relationships in multifunctional food design: assembling the evidence.

PubMed

Aggett, Peter J

2012-03-01

Demonstrating single and multiple functions attributable to foods or specific food components is a challenge. The International Life Sciences Institute Europe co-ordinated EU concerted actions, Functional Food Science in Europe (FUFOSE) and the Process for the Assessment of Scientific Support for Claims on Food (PASSCLAIM), respectively, addressed the soundness of the evidence and its coherence with a mechanistic schema comprising valid markers of exposure, intermediate and final outcomes and the quality and integrity of the evidence overall. Demonstrating causality often relies on randomized controlled trials (RCTs). However, in public health and biomedical science there is concern about the suitability of RCTs as sole standards of evidence-based approaches. Alternative and complementary approaches using updated Hill's viewpoints for appraising the evidence can be used in conjunction with evidence-based mechanistic reasoning and the quality criteria proposed in FUFOSE and PASSCLAIM to design studies and to assemble evidence exploring single or multiple benefits from food components and foods.

A rule-based named-entity recognition method for knowledge extraction of evidence-based dietary recommendations

PubMed Central

2017-01-01

Evidence-based dietary information represented as unstructured text is a crucial information that needs to be accessed in order to help dietitians follow the new knowledge arrives daily with newly published scientific reports. Different named-entity recognition (NER) methods have been introduced previously to extract useful information from the biomedical literature. They are focused on, for example extracting gene mentions, proteins mentions, relationships between genes and proteins, chemical concepts and relationships between drugs and diseases. In this paper, we present a novel NER method, called drNER, for knowledge extraction of evidence-based dietary information. To the best of our knowledge this is the first attempt at extracting dietary concepts. DrNER is a rule-based NER that consists of two phases. The first one involves the detection and determination of the entities mention, and the second one involves the selection and extraction of the entities. We evaluate the method by using text corpora from heterogeneous sources, including text from several scientifically validated web sites and text from scientific publications. Evaluation of the method showed that drNER gives good results and can be used for knowledge extraction of evidence-based dietary recommendations. PMID:28644863

Assessing Perceived Emotional Intelligence in Adolescents: New Validity Evidence of Trait Meta-Mood Scale-24

ERIC Educational Resources Information Center

Pedrosa, Ignacio; Suárez-Álvarez, Javier; Lozano, Luis M.; Muñiz, José; García-Cueto, Eduardo

2014-01-01

Adolescence is a critical period of life during which significant psychosocial adjustment occurs and in which emotional intelligence plays an essential role. This article provides validity evidence for the Trait Meta-Mood Scale-24 (TMMS-24) scores based on an item response theory (IRT) approach. A sample of 2,693 Spanish adolescents (M = 16.52…

Contemporary Test Validity in Theory and Practice: A Primer for Discipline-Based Education Researchers

PubMed Central

Reeves, Todd D.; Marbach-Ad, Gili

2016-01-01

Most discipline-based education researchers (DBERs) were formally trained in the methods of scientific disciplines such as biology, chemistry, and physics, rather than social science disciplines such as psychology and education. As a result, DBERs may have never taken specific courses in the social science research methodology—either quantitative or qualitative—on which their scholarship often relies so heavily. One particular aspect of (quantitative) social science research that differs markedly from disciplines such as biology and chemistry is the instrumentation used to quantify phenomena. In response, this Research Methods essay offers a contemporary social science perspective on test validity and the validation process. The instructional piece explores the concepts of test validity, the validation process, validity evidence, and key threats to validity. The essay also includes an in-depth example of a validity argument and validation approach for a test of student argument analysis. In addition to DBERs, this essay should benefit practitioners (e.g., lab directors, faculty members) in the development, evaluation, and/or selection of instruments for their work assessing students or evaluating pedagogical innovations. PMID:26903498

Reviving Cochrane's contribution to evidence-based medicine: bridging the gap between evidence of efficacy and evidence of effectiveness and cost-effectiveness.

PubMed

James, Jack E

2017-09-01

Throughout the quarter century since the advent of evidence-based medicine (EBM), medical research has prioritized 'efficacy' (i.e. internal validity) using randomized controlled trials. EBM has consistently neglected 'effectiveness' and 'cost-effectiveness', identified in the pioneering work of Archie Cochrane as essential for establishing the external (i.e. clinical) validity of health care interventions. Neither Cochrane nor other early pioneers appear to have foreseen the extent to which EBM would be appropriated by the pharmaceutical and medical devices industries, which are responsible for extensive biases in clinical research due to selective reporting, exaggeration of benefits, minimization of risks, and misrepresentation of data. The promise of EBM to effect transformational change in health care will remain unfulfilled until (i) studies of effectiveness and cost-effectiveness are pursued with some of the same fervour that previously succeeded in elevating the status of the randomized controlled trial, and (ii) ways are found to defeat threats to scientific integrity posed by commercial conflicts of interest. © 2017 Stichting European Society for Clinical Investigation Journal Foundation.

Development and validation of the Evidence Based Medicine Questionnaire (EBMQ) to assess doctors' knowledge, practice and barriers regarding the implementation of evidence-based medicine in primary care.

PubMed

Hisham, Ranita; Ng, Chirk Jenn; Liew, Su May; Lai, Pauline Siew Mei; Chia, Yook Chin; Khoo, Ee Ming; Hanafi, Nik Sherina; Othman, Sajaratulnisah; Lee, Ping Yein; Abdullah, Khatijah Lim; Chinna, Karuthan

2018-06-23

Evidence-Based Medicine (EBM) integrates best available evidence from literature and patients' values, which then informs clinical decision making. However, there is a lack of validated instruments to assess the knowledge, practice and barriers of primary care physicians in the implementation of EBM. This study aimed to develop and validate an Evidence-Based Medicine Questionnaire (EBMQ) in Malaysia. The EBMQ was developed based on a qualitative study, literature review and an expert panel. Face and content validity was verified by the expert panel and piloted among 10 participants. Primary care physicians with or without EBM training who could understand English were recruited from December 2015 to January 2016. The EBMQ was administered at baseline and two weeks later. A higher score indicates better knowledge, better practice of EBM and less barriers towards the implementation of EBM. We hypothesized that the EBMQ would have three domains: knowledge, practice and barriers. The final version of the EBMQ consists of 80 items: 62 items were measured on a nominal scale, 22 items were measured on a 5 point Likert-scale. Flesch reading ease was 61.2. A total of 343 participants were approached; of whom 320 agreed to participate (response rate = 93.2%). Factor analysis revealed that the EBMQ had eight domains after 13 items were removed: "EBM websites", "evidence-based journals", "types of studies", "terms related to EBM", "practice", "access", "patient preferences" and "support". Cronbach alpha for the overall EBMQ was 0.909, whilst the Cronbach alpha for the individual domain ranged from 0.657-0.940. The EBMQ was able to discriminate between doctors with and without EBM training for 24 out of 42 items. At test-retest, kappa values ranged from 0.155 to 0.620. The EBMQ was found to be a valid and reliable instrument to assess the knowledge, practice and barriers towards the implementation of EBM among primary care physicians in Malaysia.

Whose Consensus Is It Anyway? Scientific versus Legalistic Conceptions of Validity

ERIC Educational Resources Information Center

Borsboom, Denny

2012-01-01

Paul E. Newton provides an insightful and scholarly overview of central issues in validity theory. As he notes, many of the conceptual problems in validity theory derive from the fact that the word "validity" has two meanings. First, it indicates "whether a test measures what it purports to measure." This is a factual claim about the psychometric…

Developing Traditional Chinese Medicine in the Era of Evidence-Based Medicine: Current Evidences and Challenges

PubMed Central

Fung, Foon Yin; Linn, Yeh Ching

2015-01-01

Evidence-based medicine (EBM), by integrating individual clinical expertise with the best available clinical evidence from systematic research, has in recent years been established as the standard of modern medical practice for greater treatment efficacy and safety. Traditional Chinese Medicine (TCM), on the other hand, evolved as a system of medical practice from ancient China more than 2000 years ago based on empirical knowledge as well as theories and concepts which are yet to be mapped by scientific equivalents. Despite the expanding TCM usage and the recognition of its therapeutic benefits worldwide, the lack of robust evidence from the EBM perspective is hindering acceptance of TCM by the Western medicine community and its integration into mainstream healthcare. For TCM to become an integral component of the healthcare system so that its benefits can be rationally harnessed in the best interests of patients, it is essential for TCM to demonstrate its efficacy and safety by high-level evidence in accordance with EBM, though much debate remains on the validity and feasibility of applying the EBM model on this traditional practice. This review aims to discuss the current status of research in TCM, explore the evidences available on its efficacy and safety, and highlight the issues and challenges faced in applying EBM to TCM. PMID:25949261

Construction and validation of clinical contents for development of learning objects.

PubMed

Hortense, Flávia Tatiana Pedrolo; Bergerot, Cristiane Decat; Domenico, Edvane Birelo Lopes de

2018-01-01

to describe the process of construction and validation of clinical contents for health learning objects, aimed at patients in the treatment of head and neck cancer. descriptive, methodological study. The development of the script and the storyboard were based on scientific evidence and submitted to the appreciation of specialists for validation of content. The agreement index was checked quantitatively and the suggestions were qualitatively evaluated. The items described in the roadmap were approved by 99% of expert experts. The suggestions for adjustments were inserted in their entirety in the final version. The free-marginal kappa statistical test, for multiple evaluators, presented value equal to 0.68%, granting a substantial agreement. The steps taken in the construction and validation of the content for the production of educational material for patients with head and neck cancer were adequate, relevant and suitable for use in other subjects.

Scientific misconduct: also an issue in nursing science?

PubMed

Fierz, Katharina; Gennaro, Susan; Dierickx, Kris; Van Achterberg, Theo; Morin, Karen H; De Geest, Sabina

2014-07-01

Scientific misconduct (SMC) is an increasing concern in nursing science. This article discusses the prevalence of SMC, risk factors and correlates of scientific misconduct in nursing science, and highlights interventional approaches to foster good scientific conduct. Using the "Fostering Research Integrity in Europe" report of the European Science Foundation as a framework, we reviewed the literature in research integrity promotion. Although little empirical data exist regarding prevalence of scientific misconduct in the field of nursing science, available evidence suggests a similar prevalence as elsewhere. In studies of prospective graduate nurses, 4% to 17% admit data falsification or fabrication, while 8.8% to 26.4% report plagiarizing material. Risk factors for SMC exist at the macro, meso, and micro levels of the research system. Intervention research on preventing scientific misconduct in nursing is limited, yet findings from the wider field of medicine and allied health professions suggest that honor codes, training programs, and clearly communicated misconduct control mechanisms and misconduct consequences improve ethical behavior. Scientific misconduct is a multilevel phenomenon. Interventions to decrease scientific misconduct must therefore target every level of the nursing research systems. Scientific misconduct not only compromises scientific integrity by distorting empirical evidence, but it might endanger patients. Because nurses are involved in clinical research, raising their awareness of scientifically inappropriate behavior is essential. © 2014 Sigma Theta Tau International.

The bottom-up approach to integrative validity: a new perspective for program evaluation.

PubMed

Chen, Huey T

2010-08-01

The Campbellian validity model and the traditional top-down approach to validity have had a profound influence on research and evaluation. That model includes the concepts of internal and external validity and within that model, the preeminence of internal validity as demonstrated in the top-down approach. Evaluators and researchers have, however, increasingly recognized that in an evaluation, the over-emphasis on internal validity reduces that evaluation's usefulness and contributes to the gulf between academic and practical communities regarding interventions. This article examines the limitations of the Campbellian validity model and the top-down approach and provides a comprehensive, alternative model, known as the integrative validity model for program evaluation. The integrative validity model includes the concept of viable validity, which is predicated on a bottom-up approach to validity. This approach better reflects stakeholders' evaluation views and concerns, makes external validity workable, and becomes therefore a preferable alternative for evaluation of health promotion/social betterment programs. The integrative validity model and the bottom-up approach enable evaluators to meet scientific and practical requirements, facilitate in advancing external validity, and gain a new perspective on methods. The new perspective also furnishes a balanced view of credible evidence, and offers an alternative perspective for funding. Copyright (c) 2009 Elsevier Ltd. All rights reserved.

[Therapeutic potential of Hibiscus sabdariffa: a review of the scientific evidence].

PubMed

Guardiola, Soledad; Mach, Núria

2014-05-01

Infusion of Hibiscus sabdariffa (H. sabdariffa) is a very popular drink in many parts of the world. Its phytochemical composition is associated to antioxidant, hypotensive, and antiatherosclerotic effects. However, the molecular mechanisms involved in these processes are not well known. The aim of this review was to report the scientific evidence supporting that regular use of H. sabdariffa decreases oxidative stress, atherosclerosis, lipid profile, and blood pressure. A search of recent publications was made in the following specialized electronic databases: Elsevier Journal, SciELO, FSTA, Science Direct, Springer Link, and NCBI. Results of research conducted in clinical trials in humans and in animal models and cell cultures were recorded. Keywords used included Hibiscus sabdariffa, oxidative stress, polyphenols, hypertension, atherosclerosis, and lipid profile. Results of the different articles suggested a possible therapeutic effect of H. sabdariffa extracts on oxidative stress, lipid profile, hypertension, and atherosclerosis thanks to its composition rich in phenolic compounds. Anthocyanins significantly decrease LDL oxidation, inhibit adipogenesis by regulating adipogenic signaling pathways and transcription factors, and modulate gene expression of certain microRNAs. No adverse events or side effects were reported. Further more homogeneous, placebo-controlled studies in humans are needed to state that H. sabdariffa has therapeutic efficacy in humans. Copyright © 2013 SEEN. Published by Elsevier Espana. All rights reserved.

Validation of an instrument to assess evidence-based practice knowledge, attitudes, access, and confidence in the dental environment.

PubMed

Hendricson, William D; Rugh, John D; Hatch, John P; Stark, Debra L; Deahl, Thomas; Wallmann, Elizabeth R

2011-02-01

This article reports the validation of an assessment instrument designed to measure the outcomes of training in evidence-based practice (EBP) in the context of dentistry. Four EBP dimensions are measured by this instrument: 1) understanding of EBP concepts, 2) attitudes about EBP, 3) evidence-accessing methods, and 4) confidence in critical appraisal. The instrument-the Knowledge, Attitudes, Access, and Confidence Evaluation (KACE)-has four scales, with a total of thirty-five items: EBP knowledge (ten items), EBP attitudes (ten), accessing evidence (nine), and confidence (six). Four elements of validity were assessed: consistency of items within the KACE scales (extent to which items within a scale measure the same dimension), discrimination (capacity to detect differences between individuals with different training or experience), responsiveness (capacity to detect the effects of education on trainees), and test-retest reliability. Internal consistency of scales was assessed by analyzing responses of second-year dental students, dental residents, and dental faculty members using Cronbach coefficient alpha, a statistical measure of reliability. Discriminative validity was assessed by comparing KACE scores for the three groups. Responsiveness was assessed by comparing pre- and post-training responses for dental students and residents. To measure test-retest reliability, the full KACE was completed twice by a class of freshman dental students seventeen days apart, and the knowledge scale was completed twice by sixteen faculty members fourteen days apart. Item-to-scale consistency ranged from 0.21 to 0.78 for knowledge, 0.57 to 0.83 for attitude, 0.70 to 0.84 for accessing evidence, and 0.87 to 0.94 for confidence. For discrimination, ANOVA and post hoc testing by the Tukey-Kramer method revealed significant score differences among students, residents, and faculty members consistent with education and experience levels. For responsiveness to training, dental students

Developing an Instrument of Scientific Literacy Assessment on the Cycle Theme

ERIC Educational Resources Information Center

Rusilowati, Ani; Kurniawati, Lina; Nugroho, Sunyoto E.; Widiyatmoko, Arif

2016-01-01

The purpose of this study is to develop scientific literacy evaluation instrument that tested its validity, reliability, and characteristics to measure the skill of student's scientific literacy used four scientific literacy, categories as follow:science as a body of knowledge (category A), science as a way of thinking (category B), science as a…

Milk and acid-base balance: proposed hypothesis versus scientific evidence.

PubMed

Fenton, Tanis R; Lyon, Andrew W

2011-10-01

Recently the lay press has claimed a hypothetical association among dairy product consumption, generation of dietary acid, and harm to human health. This theoretical association is based on the idea that the protein and phosphate in milk and dairy products make them acid-producing foods, which cause our bodies to become acidified, promoting diseases of modern civilization. Some authors have suggested that dairy products are not helpful and perhaps detrimental to bone health because higher osteoporotic fracture incidence is observed in countries with higher dairy product consumption. However, scientific evidence does not support any of these claims. Milk and dairy products neither produce acid upon metabolism nor cause metabolic acidosis, and systemic pH is not influenced by diet. Observations of higher dairy product intake in countries with prevalent osteoporosis do not hold when urban environments are compared, likely due to physical labor in rural locations. Milk and other dairy products continue to be a good source of dietary protein and other nutrients. Key teaching points: Measurement of an acidic pH urine does not reflect metabolic acidosis or an adverse health condition. The modern diet, and dairy product consumption, does not make the body acidic. Alkaline diets alter urine pH but do not change systemic pH. Net acid excretion is not an important influence of calcium metabolism. Milk is not acid producing. Dietary phosphate does not have a negative impact on calcium metabolism, which is contrary to the acid-ash hypothesis.

Scientific Reporting: Raising the Standards

ERIC Educational Resources Information Center

McLeroy, Kenneth R.; Garney, Whitney; Mayo-Wilson, Evan; Grant, Sean

2016-01-01

This article is based on a presentation that was made at the 2014 annual meeting of the editorial board of "Health Education & Behavior." The article addresses critical issues related to standards of scientific reporting in journals, including concerns about external and internal validity and reporting bias. It reviews current…

Assessing the Culture of Residency Using the C - Change Resident Survey: Validity Evidence in 34 U.S. Residency Programs.

PubMed

Pololi, Linda H; Evans, Arthur T; Civian, Janet T; Shea, Sandy; Brennan, Robert T

2017-07-01

A practical instrument is needed to reliably measure the clinical learning environment and professionalism for residents. To develop and present evidence of validity of an instrument to assess the culture of residency programs and the clinical learning environment. During 2014-2015, we surveyed residents using the C - Change Resident Survey to assess residents' perceptions of the culture in their programs. Residents in all years of training in 34 programs in internal medicine, pediatrics, and general surgery in 14 geographically diverse public and private academic health systems. The C - Change Resident Survey assessed residents' perceptions of 13 dimensions of the culture: Vitality, Self-Efficacy, Institutional Support, Relationships/Inclusion, Values Alignment, Ethical/Moral Distress, Respect, Mentoring, Work-Life Integration, Gender Equity, Racial/Ethnic Minority Equity, and self-assessed Competencies. We measured the internal reliability of each of the 13 dimensions and evaluated response process, content validity, and construct-related evidence validity by assessing relationships predicted by our conceptual model and prior research. We also assessed whether the measurements were sensitive to differences in specialty and across institutions. A total of 1708 residents completed the survey [internal medicine: n = 956, pediatrics: n = 411, general surgery: n = 311 (51% women; 16% underrepresented in medicine minority)], with a response rate of 70% (range across programs, 51-87%). Internal consistency of each dimension was high (Cronbach α: 0.73-0.90). The instrument was able to detect significant differences in the learning environment across programs and sites. Evidence of validity was supported by a good response process and the demonstration of several relationships predicted by our conceptual model. The C - Change Resident Survey assesses the clinical learning environment for residents, and we encourage further study of validity in different

Validation of a short measure of effort-reward imbalance in the workplace: evidence from China.

PubMed

Li, Jian; Loerbroks, Adrian; Shang, Li; Wege, Natalia; Wahrendorf, Morten; Siegrist, Johannes

2012-01-01

Work stress is an emergent risk in occupational health in China, and its measurement is still a critical issue. The aim of this study was to examine the reliability and validity of a short version of the effort-reward imbalance (ERI) questionnaire in a sample of Chinese workers. A community-based survey was conducted in 1,916 subjects aged 30-65 years with paid employment (971 men and 945 women). Acceptable internal consistencies of the three scales, effort, reward and overcommitment, were obtained. Confirmatory factor analysis showed a good model fit of the data with the theoretical structure (goodness-of-fit index = 0.95). Evidence of criterion validity was demonstrated, as all three scales were independently associated with elevated odds ratios of both poor physical and mental health. Based on the findings of our study, this short version of the ERI questionnaire is considered to be a reliable and valid tool for measuring psychosocial work environment in Chinese working populations.

[Evidence-based medicine and 'The Cochrane Collaboration'].

PubMed

Kawamura, T; Tamakoshi, A; Wakai, K; Ohno, Y

1999-06-01

In Evidence-Based Medicine (EBM), a clinical decision is based neither on pathophysiological theories nor personal experience but on the results derived from scientifically designed clinical epidemiological studies (i.e., evidence). EBM is used in various clinical applications, such as therapy, diagnosis, and prognosis prediction. The process includes (1) asking a clinical question consisting of the three elements of "patient", "exposure", and "outcome"; (2) searching for the best evidence using MEDLINE or Cochrane Library; (3) appraising critically the validity of the method and the magnitude and probability of the result; and finally (4) applying the evidence of the patient. In actual clinical practice, clinical expertise and patient preferences should be as much regarded as research evidence. 'The Cochrane Collaboration' supplies systematic reviews of clinical trials carried out all over the world to its consumers. Its fruit, 'The Cochrane Library (CD-ROM),' is a highly valuable resource. 'The Cochrane Collaboration' serves as the infrastructure for EBM. EBM, which was originally developed for the individual patient care, can also be applicable to community- or workplace-healthcare and policy making by governments. Thus, EBM is both a philosophy and a method to provide people with the most appropriate medical practice.

Ethical and scientific issues surrounding solid organ transplantation in HIV-positive patients: Absence of evidence is not evidence of absence.

PubMed

Christie, Timothy; Jiwani, Bashir; Asrat, Getnet; Montessori, Valentina; Mathias, Richard; Montaner, Julio

2006-01-01

End-stage liver disease is emerging as a leading cause of death among HIV-positive patients. Historically, an HIV diagnosis was a contraindication for a liver transplant; however, because of the efficacy of highly active antiretroviral therapy (HAART), HIV-positive patients have one-year, two-year, and three-year post-transplantation survival rates similar to that of HIV-negative patients. Based on this evidence, HIV-positive patients are now considered eligible for transplantation. However, newly emerging guidelines include the stipulation that HIV-positive patients must be on HAART to be placed on a waiting list for transplantation. The purpose of the present paper is to evaluate the scientific and ethical probity of requiring HIV-positive patients to be on HAART as a condition for being on a liver transplant waiting list. It is argued that the emphasis should be placed on the probability of post-transplantation HAART tolerance, and that concerns about pretransplantation HAART tolerance are of secondary importance.

Ethical and scientific issues surrounding solid organ transplantation in HIV-positive patients: Absence of evidence is not evidence of absence

PubMed Central

Christie, Timothy; Jiwani, Bashir; Asrat, Getnet; Montessori, Valentina; Mathias, Richard; Montaner, Julio

2006-01-01

End-stage liver disease is emerging as a leading cause of death among HIV-positive patients. Historically, an HIV diagnosis was a contraindication for a liver transplant; however, because of the efficacy of highly active antiretroviral therapy (HAART), HIV-positive patients have one-year, two-year, and three-year post-transplantation survival rates similar to that of HIV-negative patients. Based on this evidence, HIV-positive patients are now considered eligible for transplantation. However, newly emerging guidelines include the stipulation that HIV-positive patients must be on HAART to be placed on a waiting list for transplantation. The purpose of the present paper is to evaluate the scientific and ethical probity of requiring HIV-positive patients to be on HAART as a condition for being on a liver transplant waiting list. It is argued that the emphasis should be placed on the probability of post-transplantation HAART tolerance, and that concerns about pretransplantation HAART tolerance are of secondary importance. PMID:18418478

Claiming the validity of scientific evidence in post-truth times.

PubMed

Martino, Diego J; Samamé, Cecilia; Strejilevich, Sergio A

2017-12-01

This letter is written in response to a review recently published in the journal. The aim is to highlight a potential methodological limitation common to many studies comparing bipolar patients with few previous episodes versus those with multiple episodes, and in which the results are interpreted as indicating the longitudinal course of the illness.

The Earth expansion theory and its transition from scientific hypothesis to pseudoscientific belief

NASA Astrophysics Data System (ADS)

Sudiro, P.

2014-06-01

During the first half of 20th century, the dominant global tectonics model based on Earth contraction had increasing problems accommodating new geological evidence, with the result that alternative geodynamic theories were investigated. Due to the level of scientific knowledge and the limited amount of data available in many scientific disciplines at the time, not only was contractionism considered a valid scientific theory but the debate also included expansionism, mobilism on a fixed-dimension planet, or various combinations of these geodynamic hypotheses. Geologists and physicists generally accepted that planets could change their dimensions, although the change of volume was generally believed to happen because of a contraction, not an expansion. Constant generation of new matter in the universe was a possibility accepted by science, as it was the variation in the cosmological constants. Continental drift, instead, was a more heterodox theory, requiring a larger effort from the geoscientists to be accepted. The new geological data collected in the following decades, an improved knowledge of the physical processes, the increased resolution and penetration of geophysical tools, and the sensitivity of measurements in physics decreased the uncertainty level in many fields of science. Theorists now had less freedom for speculation because their theories had to accommodate more data, and more limiting conditions to respect. This explains the rapid replacement of contracting Earth, expanding Earth, and continental drift theories by plate tectonics once the symmetrical oceanic magnetic striping was discovered, because none of the previous models could explain and incorporate the new oceanographic and geophysical data. Expansionism could survive after the introduction of plate tectonics because its proponents have increasingly detached their theory from reality by systematically rejecting or overlooking any contrary evidence, and selectively picking only the data that

Validation of the Spanish Version of the School Engagement Measure (SEM).

PubMed

Ramos-Díaz, Estibaliz; Rodríguez-Fernández, Arantzazu; Revuelta, Lorena

2016-11-24

The scientific study of school engagement has recently been the subject of considerable interest in the field of educational psychology, and significant advances have been made in our knowledge of this construct. For instance, there is currently consensus in the scientific community that it is multifaceted, and has three dimensions: behavioral engagement, emotional engagement, and cognitive engagement. However, more advanced statistical analyses are needed to validate Spanish-language measures of school engagement, which this study proposes to do. The sample was comprised of 1,250 adolescents from Basque Country (49% boys, 51% girls) aged 12 to 15 years old (M = 13.72, SD = 1.09). The results of confirmatory factor analysis on the School Engagement Measure (Fredricks, Blumenfeld, Friedel, & Paris, 2005) supported a three-dimensional structure of school engagement (χ2 (100) = 676.93, p < .001; GFI = .931; CFI = .906; IFI = .907; SRMR = .058; RMSEA = .068). Reliability indexes were satisfactory, ranging from .83 to .94. Adequate evidence of concurrent validity was found for the variable perceived school performance (p < .01). The results are discussed from an educational perspective, and with an eye to future research.

Are validated outcome measures used in distal radial fractures truly valid?

PubMed Central

Nienhuis, R. W.; Bhandari, M.; Goslings, J. C.; Poolman, R. W.; Scholtes, V. A. B.

2016-01-01

Objectives Patient-reported outcome measures (PROMs) are often used to evaluate the outcome of treatment in patients with distal radial fractures. Which PROM to select is often based on assessment of measurement properties, such as validity and reliability. Measurement properties are assessed in clinimetric studies, and results are often reviewed without considering the methodological quality of these studies. Our aim was to systematically review the methodological quality of clinimetric studies that evaluated measurement properties of PROMs used in patients with distal radial fractures, and to make recommendations for the selection of PROMs based on the level of evidence of each individual measurement property. Methods A systematic literature search was performed in PubMed, EMbase, CINAHL and PsycINFO databases to identify relevant clinimetric studies. Two reviewers independently assessed the methodological quality of the studies on measurement properties, using the COnsensus-based Standards for the selection of health Measurement INstruments (COSMIN) checklist. Level of evidence (strong / moderate / limited / lacking) for each measurement property per PROM was determined by combining the methodological quality and the results of the different clinimetric studies. Results In all, 19 out of 1508 identified unique studies were included, in which 12 PROMs were rated. The Patient-rated wrist evaluation (PRWE) and the Disabilities of Arm, Shoulder and Hand questionnaire (DASH) were evaluated on most measurement properties. The evidence for the PRWE is moderate that its reliability, validity (content and hypothesis testing), and responsiveness are good. The evidence is limited that its internal consistency and cross-cultural validity are good, and its measurement error is acceptable. There is no evidence for its structural and criterion validity. The evidence for the DASH is moderate that its responsiveness is good. The evidence is limited that its reliability and the

Scientific reasoning profile of junior secondary school students on the concept of static fluid

NASA Astrophysics Data System (ADS)

Mariana, N.; Siahaan, P.; Utari, S.

2018-05-01

Scientific reasoning is one of the most important ability. This study aims to determine the profile of scientific reasoning of junior high school students about the concept of static fluid. This research uses a descriptive method with a quantitative approach to get an idea about the scientific reasoning of One Roof Junior Secondary School Student Kotabaru Reteh in Riau. The technique of collecting data is done by test of scientific reasoning. Scientific reasoning capability refers to Furtak’s EBR (Evidence Based Reasoning) scientific reasoning indicator that contains the components of claims, data, evidence, and rules. The result obtained on each element of scientific reasoning is 35% claim, 23% data, 21% evidence and 17% rule. The conclusions of this research that scientific reasoning of Satu Atap Junior Secondary School student Kotabaru Reteh, Riau Province still in the low category.

[Strengthening the methodology of study designs in scientific researches].

PubMed

Ren, Ze-qin

2010-06-01

Many problems in study designs have affected the validity of scientific researches seriously. We must understand the methodology of research, especially clinical epidemiology and biostatistics, and recognize the urgency in selection and implement of right study design. Thereafter we can promote the research capability and improve the overall quality of scientific researches.

Guiding Development Based Approach Practicum Vertebrates Taxonomy Scientific Study Program for Students of Biology Education

NASA Astrophysics Data System (ADS)

Arieska, M.; Syamsurizal, S.; Sumarmin, R.

2018-04-01

Students having difficulty in identifying and describing the vertebrate animals as well as less skilled in science process as practical. Increased expertise in scientific skills, one of which is through practical activities using practical guidance based on scientific approach. This study aims to produce practical guidance vertebrate taxonomy for biology education students PGRI STKIP West Sumatra valid. This study uses a model of Plomp development consisting of three phases: the initial investigation, floating or prototype stage, and the stage of assessment. Data collection instruments used in this study is a validation sheet guiding practicum. Data were analyzed descriptively based on data obtained from the field. The result of the development of practical guidance vertebrate taxonomic validity value of 3.22 is obtained with very valid category. Research and development has produced a practical guide based vertebrate taxonomic scientific approach very valid.

What Determines Student Acceptance of Politically Controversial Scientific Conclusions?

ERIC Educational Resources Information Center

Walker, J. D.; Wassenberg, Deena; Franta, Gabriel; Cotner, Sehoya

2017-01-01

Certain scientific conclusions are controversial, in that they are rejected by a substantial proportion of nonscientists despite an overwhelming scientific consensus. Science educators are motivated to help students understand the evidence behind the scientific consensus on these matters and to move students' views into alignment with those held…

Making sense scientific claims in advertising. A study of scientifically aware consumers.

PubMed

Dodds, Rachel E; Tseëlon, Efrat; Weitkamp, Emma L C

2008-04-01

Evidence that science is becoming increasingly embedded in culture comes from the proliferation of discourses of ethical consumption, sustainability, and environmental awareness. Al Gore's recent award, along with UN's Inter-governmental Panel on Climate Change (IPCC) of the Nobel peace prize-- provided a recent high profile linking of consumption and science. It is not clear to what extent the public at large engages in evaluating the scientific merits of the arguments about the link between human consumption and global environmental catastrophes. But on a local scale, we are routinely required to evaluate, scientific and pseudoscientific claims in advertising. Since advertising is used to sell products, the discourse of scientifically framed claims is being used to persuade consumers of the benefits of these products. In the case of functional foods and cosmetics, such statements are deployed to promote the health benefits and effectiveness of their products. This exploratory study examines the views of British consumers about the scientific and pseudoscientific claims made in advertisements for foods, with particular reference to functional foods, and cosmetics. The participants in the study all worked in scientific environments, though they were not all scientists. The study found that scientific arguments that were congruent with existing health knowledge tended to be accepted while pseudoscientific knowledge was regarded skeptically and concerns were raised over the accuracy and believability of the pseudoscientific claims. It appears that scientific awareness may play a part in consumers' ability to critically examine scientifically and pseudoscientifically based advertising claims.

An evidence-based systematic review of elderberry and elderflower (Sambucus nigra) by the Natural Standard Research Collaboration.

PubMed

Ulbricht, Catherine; Basch, Ethan; Cheung, Lisa; Goldberg, Harley; Hammerness, Paul; Isaac, Richard; Khalsa, Karta Purkh Singh; Romm, Aviva; Rychlik, Idalia; Varghese, Minney; Weissner, Wendy; Windsor, Regina C; Wortley, Jayme

2014-03-01

An evidence-based systematic review of elderberry and elderflower (Sambucus nigra) by the Natural Standard Research Collaboration consolidates the safety and efficacy data available in the scientific literature using a validated, reproducible grading rationale. This article includes written and statistical analysis of clinical trials, plus a compilation of expert opinion, folkloric precedent, history, pharmacology, kinetics/dynamics, interactions, adverse effects, toxicology, and dosing.

The gender identity/gender dysphoria questionnaire for adolescents and adults: further validity evidence.

PubMed

Singh, Devita; Deogracias, Joseph J; Johnson, Laurel L; Bradley, Susan J; Kibblewhite, Sarah J; Owen-Anderson, Allison; Peterson-Badali, Michele; Meyer-Bahlburg, Heino F L; Zucker, Kenneth J

2010-01-01

This study aimed to provide further validity evidence for the dimensional measurement of gender identity and gender dysphoria in both adolescents and adults. Adolescents and adults with gender identity disorder (GID) were compared to clinical control (CC) adolescents and adults on the Gender Identity/Gender Dysphoria Questionnaire for Adolescents and Adults (GIDYQ-AA), a 27-item scale originally developed by Deogracias et al. (2007). In Study 1, adolescents with GID (n = 44) were compared to CC adolescents (n = 98); and in Study 2, adults with GID (n = 41) were compared to CC adults (n = 94). In both studies, clients with GID self-reported significantly more gender dysphoria than did the CCs, with excellent sensitivity and specificity rates. In both studies, degree of self-reported gender dysphoria was significantly correlated with recall of cross-gender behavior in childhood-a test of convergent validity. The research and clinical utility of the GIDYQ-AA is discussed, including directions for further research in distinct clinical populations.

Scale of attitudes toward alcohol - Spanish version: evidences of validity and reliability 1

PubMed Central

Ramírez, Erika Gisseth León; de Vargas, Divane

2017-01-01

ABSTRACT Objective: validate the Scale of attitudes toward alcohol, alcoholism and individuals with alcohol use disorders in its Spanish version. Method: methodological study, involving 300 Colombian nurses. Adopting the classical theory, confirmatory factor analysis was applied without prior examination, based on the strong historical evidence of the factorial structure of the original scale to determine the construct validity of this Spanish version. To assess the reliability, Cronbach’s Alpha and Mc Donalid’s Omega coefficients were used. Results: the confirmatory factor analysis indicated the good fit of the scale model in a four-factor distribution, with a cut-off point at 3.2, demonstrating 66.7% of sensitivity. Conclusions: the Scale of attitudes toward alcohol, alcoholism and individuals with alcohol use disorders in Spanish presented robust psychometric qualities, affirming that the instrument possesses a solid factorial structure and reliability and is capable of precisely measuring the nurses’ atittudes towards the phenomenon proposed. PMID:28793126

Validity evidence for an OSCE to assess competency in systems-based practice and practice-based learning and improvement: a preliminary investigation.

PubMed

Varkey, Prathibha; Natt, Neena; Lesnick, Timothy; Downing, Steven; Yudkowsky, Rachel

2008-08-01

To determine the psychometric properties and validity of an OSCE to assess the competencies of Practice-Based Learning and Improvement (PBLI) and Systems-Based Practice (SBP) in graduate medical education. An eight-station OSCE was piloted at the end of a three-week Quality Improvement elective for nine preventive medicine and endocrinology fellows at Mayo Clinic. The stations assessed performance in quality measurement, root cause analysis, evidence-based medicine, insurance systems, team collaboration, prescription errors, Nolan's model, and negotiation. Fellows' performance in each of the stations was assessed by three faculty experts using checklists and a five-point global competency scale. A modified Angoff procedure was used to set standards. Evidence for the OSCE's validity, feasibility, and acceptability was gathered. Evidence for content and response process validity was judged as excellent by institutional content experts. Interrater reliability of scores ranged from 0.85 to 1 for most stations. Interstation correlation coefficients ranged from -0.62 to 0.99, reflecting case specificity. Implementation cost was approximately $255 per fellow. All faculty members agreed that the OSCE was realistic and capable of providing accurate assessments. The OSCE provides an opportunity to systematically sample the different subdomains of Quality Improvement. Furthermore, the OSCE provides an opportunity for the demonstration of skills rather than the testing of knowledge alone, thus making it a potentially powerful assessment tool for SBP and PBLI. The study OSCE was well suited to assess SBP and PBLI. The evidence gathered through this study lays the foundation for future validation work.

Crafting practice guidelines in the world of evidence-based medicine.

PubMed

Chung, Kevin C; Shauver, Melissa J

2009-10-01

In the era of exponential increase in the medical literature, physicians and health policy-makers are relying on well-constructed, evidence-based practice guidelines to help ensure that the care given to patients is based on valid, scientific data. The construction of practice guidelines, however, may not always adhere to accepted research protocol. In this article, the authors detail the steps required to produce effective, evidence-based practice guidelines. The seven essential steps in crafting a practice guideline are presented: (1) defining a topic, (2) selecting a work group, (3) performing a literature review, (4) writing the guideline, (5) peer review, (6) making plans for review and revision, and (7) dissemination. Given the importance of practice guidelines in supporting everyday practice, this article strives to provide a practical guide in the development of this key component of evidence-based medicine.

Implementing assessments of robot-assisted technical skill in urological education: a systematic review and synthesis of the validity evidence.

PubMed

Goldenberg, Mitchell G; Lee, Jason Y; Kwong, Jethro C C; Grantcharov, Teodor P; Costello, Anthony

2018-03-31

To systematically review and synthesise the validity evidence supporting intraoperative and simulation-based assessments of technical skill in urological robot-assisted surgery (RAS), and make evidence-based recommendations for the implementation of these assessments in urological training. A literature search of the Medline, PsycINFO and Embase databases was performed. Articles using technical skill and simulation-based assessments in RAS were abstracted. Only studies involving urology trainees or faculty were included in the final analysis. Multiple tools for the assessment of technical robotic skill have been published, with mixed sources of validity evidence to support their use. These evaluations have been used in both the ex vivo and in vivo settings. Performance evaluations range from global rating scales to psychometrics, and assessments are carried out through automation, expert analysts, and crowdsourcing. There have been rapid expansions in approaches to RAS technical skills assessment, both in simulated and clinical settings. Alternative approaches to assessment in RAS, such as crowdsourcing and psychometrics, remain under investigation. Evidence to support the use of these metrics in high-stakes decisions is likely insufficient at present. © 2018 The Authors BJU International © 2018 BJU International Published by John Wiley & Sons Ltd.

Learners' Epistemic Criteria for Good Scientific Models

ERIC Educational Resources Information Center

Pluta, William J.; Chinn, Clark A.; Duncan, Ravit Golan

2011-01-01

Epistemic criteria are the standards used to evaluate scientific products (e.g., models, evidence, arguments). In this study, we analyzed epistemic criteria for good models generated by 324 middle-school students. After evaluating a range of scientific models, but before extensive instruction or experience with model-based reasoning practices,…

Reliability and Validity Evidence of Multiple Balance Assessments in Athletes With a Concussion

PubMed Central

Murray, Nicholas; Salvatore, Anthony; Powell, Douglas; Reed-Jones, Rebecca

2014-01-01

Context: An estimated 300 000 sport-related concussion injuries occur in the United States annually. Approximately 30% of individuals with concussions experience balance disturbances. Common methods of balance assessment include the Clinical Test of Sensory Organization and Balance (CTSIB), the Sensory Organization Test (SOT), the Balance Error Scoring System (BESS), and the Romberg test; however, the National Collegiate Athletic Association recommended the Wii Fit as an alternative measure of balance in athletes with a concussion. A central concern regarding the implementation of the Wii Fit is whether it is reliable and valid for measuring balance disturbance in athletes with concussion. Objective: To examine the reliability and validity evidence for the CTSIB, SOT, BESS, Romberg test, and Wii Fit for detecting balance disturbance in athletes with a concussion. Data Sources: Literature considered for review included publications with reliability and validity data for the assessments of balance (CTSIB, SOT, BESS, Romberg test, and Wii Fit) from PubMed, PsycINFO, and CINAHL. Data Extraction: We identified 63 relevant articles for consideration in the review. Of the 63 articles, 28 were considered appropriate for inclusion and 35 were excluded. Data Synthesis: No current reliability or validity information supports the use of the CTSIB, SOT, Romberg test, or Wii Fit for balance assessment in athletes with a concussion. The BESS demonstrated moderate to high reliability (interclass correlation coefficient = 0.87) and low to moderate validity (sensitivity = 34%, specificity = 87%). However, the Romberg test and Wii Fit have been shown to be reliable tools in the assessment of balance in Parkinson patients. Conclusions: The BESS can evaluate balance problems after a concussion. However, it lacks the ability to detect balance problems after the third day of recovery. Further investigation is needed to establish the use of the CTSIB, SOT, Romberg test, and Wii Fit for

A Delphi Technology Foresight Study: Mapping Social Construction of Scientific Evidence on Metagenomics Tests for Water Safety

PubMed Central

Birko, Stanislav; Dove, Edward S.; Özdemir, Vural

2015-01-01

Access to clean water is a grand challenge in the 21st century. Water safety testing for pathogens currently depends on surrogate measures such as fecal indicator bacteria (e.g., E. coli). Metagenomics concerns high-throughput, culture-independent, unbiased shotgun sequencing of DNA from environmental samples that might transform water safety by detecting waterborne pathogens directly instead of their surrogates. Yet emerging innovations such as metagenomics are often fiercely contested. Innovations are subject to shaping/construction not only by technology but also social systems/values in which they are embedded, such as experts’ attitudes towards new scientific evidence. We conducted a classic three-round Delphi survey, comprised of 107 questions. A multidisciplinary expert panel (n = 24) representing the continuum of discovery scientists and policymakers evaluated the emergence of metagenomics tests. To the best of our knowledge, we report here the first Delphi foresight study of experts’ attitudes on (1) the top 10 priority evidentiary criteria for adoption of metagenomics tests for water safety, (2) the specific issues critical to governance of metagenomics innovation trajectory where there is consensus or dissensus among experts, (3) the anticipated time lapse from discovery to practice of metagenomics tests, and (4) the role and timing of public engagement in development of metagenomics tests. The ability of a test to distinguish between harmful and benign waterborne organisms, analytical/clinical sensitivity, and reproducibility were the top three evidentiary criteria for adoption of metagenomics. Experts agree that metagenomic testing will provide novel information but there is dissensus on whether metagenomics will replace the current water safety testing methods or impact the public health end points (e.g., reduction in boil water advisories). Interestingly, experts view the publics relevant in a “downstream capacity” for adoption of

Students' Positions and Considerations of Scientific Evidence about a Controversial Socioscientific Issue

ERIC Educational Resources Information Center

Albe, Virginie

2008-01-01

Efforts have been devoted to introduce in science curricula direct instruction for evaluating scientific reports on socioscientific issues. In this study, students' opinions on the SSI of mobile telephones effects have been investigated before and after a classroom activity designed to enable students to assess scientific data. Aspects of the…

System verification and validation: a fundamental systems engineering task

NASA Astrophysics Data System (ADS)

Ansorge, Wolfgang R.

2004-09-01

Systems Engineering (SE) is the discipline in a project management team, which transfers the user's operational needs and justifications for an Extremely Large Telescope (ELT) -or any other telescope-- into a set of validated required system performance characteristics. Subsequently transferring these validated required system performance characteris-tics into a validated system configuration, and eventually into the assembled, integrated telescope system with verified performance characteristics and provided it with "objective evidence that the particular requirements for the specified intended use are fulfilled". The latter is the ISO Standard 8402 definition for "Validation". This presentation describes the verification and validation processes of an ELT Project and outlines the key role System Engineering plays in these processes throughout all project phases. If these processes are implemented correctly into the project execution and are started at the proper time, namely at the very beginning of the project, and if all capabilities of experienced system engineers are used, the project costs and the life-cycle costs of the telescope system can be reduced between 25 and 50 %. The intention of this article is, to motivate and encourage project managers of astronomical telescopes and scientific instruments to involve the entire spectrum of Systems Engineering capabilities performed by trained and experienced SYSTEM engineers for the benefit of the project by explaining them the importance of Systems Engineering in the AIV and validation processes.

The coexistence of alternative and scientific conceptions in physics

NASA Astrophysics Data System (ADS)

Ozdemir, Omer F.

The purpose of this study was to inquire about the simultaneous coexistence of alternative and scientific conceptions in the domain of physics. This study was particularly motivated by several arguments put forward in opposition to the Conceptual Change Model. In the simplest form, these arguments state that people construct different domains of knowledge and different modes of perception in different situations. Therefore, holding different conceptualizations is unavoidable and expecting a replacement in an individual's conceptual structure is not plausible in terms of instructional practices. The following research questions were generated to inquire about this argument: (1) Do individuals keep their alternative conceptions after they have acquired scientific conceptions? (2) Assuming that individuals who acquired scientific conceptions also have alternative conceptions, how are these different conceptions nested in their conceptual structure? (3) What kind of knowledge, skills, and reasoning are necessary to transfer scientific principles instead of alternative ones in the construction of a valid model? Analysis of the data collected from the non-physics group indicated that the nature of alternative conceptions is framed by two types of reasoning: reasoning by mental simulation and semiformal reasoning. Analysis of the data collected from the physics group revealed that mental images or scenes feeding reasoning by mental simulation had not disappeared after the acquisition of scientific conceptions. The analysis of data also provided enough evidence to conclude that alternative principles feeding semiformal reasoning have not necessarily disappeared after the acquisition of scientific conceptions. However, in regard to semiformal reasoning, compartmentalization was not as clear as the case demonstrated in reasoning by mental simulation; instead semiformal and scientific reasoning are intertwined in a way that the components of semiformal reasoning can easily

Development of, and initial validity evidence for, the referee self-efficacy scale: a multistudy report.

PubMed

Myers, Nicholas D; Feltz, Deborah L; Guillén, Félix; Dithurbide, Lori

2012-12-01

The purpose of this multistudy report was to develop, and then to provide initial validity evidence for measures derived from, the Referee Self-Efficacy Scale. Data were collected from referees (N = 1609) in the United States (n = 978) and Spain (n = 631). In Study 1 (n = 512), a single-group exploratory structural equation model provided evidence for four factors: game knowledge, decision making, pressure, and communication. In Study 2 (n = 1153), multiple-group confirmatory factor analytic models provided evidence for partial factorial invariance by country, level of competition, team gender, and sport refereed. In Study 3 (n = 456), potential sources of referee self-efficacy information combined to account for a moderate or large amount of variance in each dimension of referee self-efficacy with years of referee experience, highest level refereed, physical/mental preparation, and environmental comfort, each exerting at least two statistically significant direct effects.

Promoting Scientific Faculties: Does It Work? Evidence from Italy

ERIC Educational Resources Information Center

Maestri, Virginia

2013-01-01

In reaction to the OECD-wide declining trend in scientific enrollments, the Italian government launched a policy in 2005 to promote the study of science at the university. The policy promoted extra-curricular activities for secondary school students in Chemistry, Physics, Math and Materials Science. This article evaluates the policy impact on…

Cross-cultural perspectives of scientific misconduct.

PubMed

Momen, Hooman; Gollogly, Laragh

2007-09-01

The increasing globalization of scientific research lends urgency to the need for international agreement on the concepts of scientific misconduct. Universal spiritual and moral principles on which ethical standards are generally based indicate that it is possible to reach international agreement on the ethical principles underlying good scientific practice. Concordance on an operational definition of scientific misconduct that would allow independent observers to agree which behaviour constitutes misconduct is more problematic. Defining scientific misconduct to be universally recognized and universally sanctioned means addressing the broader question of ensuring that research is not only well-designed - and addresses a real need for better evidence - but that it is ethically conducted in different cultures. An instrument is needed to ensure that uneven ethical standards do not create unnecessary obstacles to research, particularly in developing countries.

Development of Scientific Approach Based on Discovery Learning Module

NASA Astrophysics Data System (ADS)

Ellizar, E.; Hardeli, H.; Beltris, S.; Suharni, R.

2018-04-01

Scientific Approach is a learning process, designed to make the students actively construct their own knowledge through stages of scientific method. The scientific approach in learning process can be done by using learning modules. One of the learning model is discovery based learning. Discovery learning is a learning model for the valuable things in learning through various activities, such as observation, experience, and reasoning. In fact, the students’ activity to construct their own knowledge were not optimal. It’s because the available learning modules were not in line with the scientific approach. The purpose of this study was to develop a scientific approach discovery based learning module on Acid Based, also on electrolyte and non-electrolyte solution. The developing process of this chemistry modules use the Plomp Model with three main stages. The stages are preliminary research, prototyping stage, and the assessment stage. The subject of this research was the 10th and 11th Grade of Senior High School students (SMAN 2 Padang). Validation were tested by the experts of Chemistry lecturers and teachers. Practicality of these modules had been tested through questionnaire. The effectiveness had been tested through experimental procedure by comparing student achievement between experiment and control groups. Based on the findings, it can be concluded that the developed scientific approach discovery based learning module significantly improve the students’ learning in Acid-based and Electrolyte solution. The result of the data analysis indicated that the chemistry module was valid in content, construct, and presentation. Chemistry module also has a good practicality level and also accordance with the available time. This chemistry module was also effective, because it can help the students to understand the content of the learning material. That’s proved by the result of learning student. Based on the result can conclude that chemistry module based on

A model of scientific attitudes assessment by observation in physics learning based scientific approach: case study of dynamic fluid topic in high school

NASA Astrophysics Data System (ADS)

Yusliana Ekawati, Elvin

2017-01-01

This study aimed to produce a model of scientific attitude assessment in terms of the observations for physics learning based scientific approach (case study of dynamic fluid topic in high school). Development of instruments in this study adaptation of the Plomp model, the procedure includes the initial investigation, design, construction, testing, evaluation and revision. The test is done in Surakarta, so that the data obtained are analyzed using Aiken formula to determine the validity of the content of the instrument, Cronbach’s alpha to determine the reliability of the instrument, and construct validity using confirmatory factor analysis with LISREL 8.50 program. The results of this research were conceptual models, instruments and guidelines on scientific attitudes assessment by observation. The construct assessment instruments include components of curiosity, objectivity, suspended judgment, open-mindedness, honesty and perseverance. The construct validity of instruments has been qualified (rated load factor > 0.3). The reliability of the model is quite good with the Alpha value 0.899 (> 0.7). The test showed that the model fits the theoretical models are supported by empirical data, namely p-value 0.315 (≥ 0.05), RMSEA 0.027 (≤ 0.08)

Validity of 2D lateral cephalometry in orthodontics: a systematic review

PubMed Central

2013-01-01

Lateral cephalometric radiography is commonly used as a standard tool in orthodontic assessment and treatment planning. The aim of this study was to evaluate the available scientific literature and existing evidence for the validation of using lateral cephalometric imaging for orthodontic treatment planning. The secondary objective was to determine the accuracy and reliability of this technique. We did not attempt to evaluate the value of this radiographic technique for other purposes. A literature search was performed using specific keywords on electronic databases: Ovid MEDLINE, Scopus and Web of Science. Two reviewers selected relevant articles, corresponding to predetermined inclusion criteria. The electronic search was followed by a hand search of the reference lists of relevant papers. Two reviewers assessed the level of evidence of relevant publications as high, moderate or low. Based on this, the evidence grade for diagnostic efficacy was rated as strong, moderately strong, limited or insufficient. The initial search revealed 784 articles listed in MEDLINE (Ovid), 1,034 in Scopus and 264 articles in the Web of Science. Only 17 articles met the inclusion criteria and were selected for qualitative synthesis. Results showed seven studies on the role of cephalometry in orthodontic treatment planning, eight concerning cephalometric measurements and landmark identification and two on cephalometric analysis. It is surprising that, notwithstanding the 968 articles published in peer-reviewed journals, scientific evidence on the usefulness of this radiographic technique in orthodontics is still lacking, with contradictory results. More rigorous research on a larger study population should be performed to achieve full evidence on this topic. PMID:24325757

Psychometric instrumentation: reliability and validity of instruments used for clinical practice, evidence-based practice projects and research studies.

PubMed

Mayo, Ann M

2015-01-01

It is important for CNSs and other APNs to consider the reliability and validity of instruments chosen for clinical practice, evidence-based practice projects, or research studies. Psychometric testing uses specific research methods to evaluate the amount of error associated with any particular instrument. Reliability estimates explain more about how well the instrument is designed, whereas validity estimates explain more about scores that are produced by the instrument. An instrument may be architecturally sound overall (reliable), but the same instrument may not be valid. For example, if a specific group does not understand certain well-constructed items, then the instrument does not produce valid scores when used with that group. Many instrument developers may conduct reliability testing only once, yet continue validity testing in different populations over many years. All CNSs should be advocating for the use of reliable instruments that produce valid results. Clinical nurse specialists may find themselves in situations where reliability and validity estimates for some instruments that are being utilized are unknown. In such cases, CNSs should engage key stakeholders to sponsor nursing researchers to pursue this most important work.

Scientific Reasoning for Pre-service Elementary Teachers

NASA Astrophysics Data System (ADS)

Sadaghiani, Homeyra R.

2010-10-01

The objectives of K-12 teacher education science courses often focus on conceptual learning and improving students overall attitude towards science. It is often assumed that with the use of research-based curriculum material and more hands on inquiry approaches, without any explicit instruction, student scientific and critical thinking skills would also be enhanced. In the last three years, we have been investigating student scientific and evidence-based reasoning abilities in a K-8 pre-service science course at Cal Poly Pomona. After recognizing student difficulties understanding the elements of scientific reasoning, we have provided explicit feedback using a rubric to assist students to become more rigorous and reflective thinkers; to use appropriate and accurate vocabulary; exercise evidence-base reasoning; and develop skepticism with respect to their own views. We will share the rubric and report on the preliminary results.

Critical appraisal of scientific articles: part 1 of a series on evaluation of scientific publications.

PubMed

du Prel, Jean-Baptist; Röhrig, Bernd; Blettner, Maria

2009-02-01

In the era of evidence-based medicine, one of the most important skills a physician needs is the ability to analyze scientific literature critically. This is necessary to keep medical knowledge up to date and to ensure optimal patient care. The aim of this paper is to present an accessible introduction into critical appraisal of scientific articles. Using a selection of international literature, the reader is introduced to the principles of critical reading of scientific articles in medicine. For the sake of conciseness, detailed description of statistical methods is omitted. Widely accepted principles for critically appraising scientific articles are outlined. Basic knowledge of study design, structuring of an article, the role of different sections, of statistical presentations as well as sources of error and limitation are presented. The reader does not require extensive methodological knowledge. As far as necessary for critical appraisal of scientific articles, differences in research areas like epidemiology, clinical, and basic research are outlined. Further useful references are presented. Basic methodological knowledge is required to select and interpret scientific articles correctly.

Official Position of the American Academy of Clinical Neuropsychology Social Security Administration Policy on Validity Testing: Guidance and Recommendations for Change.

PubMed

Chafetz, M D; Williams, M A; Ben-Porath, Y S; Bianchini, K J; Boone, K B; Kirkwood, M W; Larrabee, G J; Ord, J S

2015-01-01

The milestone publication by Slick, Sherman, and Iverson (1999) of criteria for determining malingered neurocognitive dysfunction led to extensive research on validity testing. Position statements by the National Academy of Neuropsychology and the American Academy of Clinical Neuropsychology (AACN) recommended routine validity testing in neuropsychological evaluations. Despite this widespread scientific and professional support, the Social Security Administration (SSA) continued to discourage validity testing, a stance that led to a congressional initiative for SSA to reevaluate their position. In response, SSA commissioned the Institute of Medicine (IOM) to evaluate the science concerning the validation of psychological testing. The IOM concluded that validity assessment was necessary in psychological and neuropsychological examinations (IOM, 2015 ). The AACN sought to provide independent expert guidance and recommendations concerning the use of validity testing in disability determinations. A panel of contributors to the science of validity testing and its application to the disability process was charged with describing why the disability process for SSA needs improvement, and indicating the necessity for validity testing in disability exams. This work showed how the determination of malingering is a probability proposition, described how different types of validity tests are appropriate, provided evidence concerning non-credible findings in children and low-functioning individuals, and discussed the appropriate evaluation of pain disorders typically seen outside of mental consultations. A scientific plan for validity assessment that additionally protects test security is needed in disability determinations and in research on classification accuracy of disability decisions.

Using Science as Evidence in Public Policy

ERIC Educational Resources Information Center

Prewitt, Kenneth, Ed.; Schwandt, Thomas A., Ed.; Straf, Miron L., Ed.

2012-01-01

"Using Science as Evidence in Public Policy" encourages scientists to think differently about the use of scientific evidence in policy making. This report investigates why scientific evidence is important to policy making and argues that an extensive body of research on knowledge utilization has not led to any widely accepted explanation…

Performance of a cognitive load inventory during simulated handoffs: Evidence for validity.

PubMed

Young, John Q; Boscardin, Christy K; van Dijk, Savannah M; Abdullah, Ruqayyah; Irby, David M; Sewell, Justin L; Ten Cate, Olle; O'Sullivan, Patricia S

2016-01-01

Advancing patient safety during handoffs remains a public health priority. The application of cognitive load theory offers promise, but is currently limited by the inability to measure cognitive load types. To develop and collect validity evidence for a revised self-report inventory that measures cognitive load types during a handoff. Based on prior published work, input from experts in cognitive load theory and handoffs, and a think-aloud exercise with residents, a revised Cognitive Load Inventory for Handoffs was developed. The Cognitive Load Inventory for Handoffs has items for intrinsic, extraneous, and germane load. Students who were second- and sixth-year students recruited from a Dutch medical school participated in four simulated handoffs (two simple and two complex cases). At the end of each handoff, study participants completed the Cognitive Load Inventory for Handoffs, Paas' Cognitive Load Scale, and one global rating item for intrinsic load, extraneous load, and germane load, respectively. Factor and correlational analyses were performed to collect evidence for validity. Confirmatory factor analysis yielded a single factor that combined intrinsic and germane loads. The extraneous load items performed poorly and were removed from the model. The score from the combined intrinsic and germane load items associated, as predicted by cognitive load theory, with a commonly used measure of overall cognitive load (Pearson's r = 0.83, p < 0.001), case complexity (beta = 0.74, p < 0.001), level of experience (beta = -0.96, p < 0.001), and handoff accuracy (r = -0.34, p < 0.001). These results offer encouragement that intrinsic load during handoffs may be measured via a self-report measure. Additional work is required to develop an adequate measure of extraneous load.

[Challenges in care of trauma patient in Spain. The need for implementation of scientific evidence including secondary prevention].

PubMed

Fernández Mondéjar, E; Alvarez, F J; González Luque, J C

2014-01-01

The mortality of trauma patients has improved significantly in recent decades due to a combination of factors: medical care, educational campaigns and structural changes. Generalization of out-of hospital emergence medical services and the hospital care in specific centers for traumatized has undoubtedly contributed to this decline, but other factors such as periodic campaigns to prevent workplace and traffic accidents, as well as improvements in the road network have played a key role. The challenge now is to continue to decrease mortality, for which is essential an analysis of the situation to detect potential areas of improvement. The application of diagnostic or therapeutic actions with scientific evidence is associated with lower mortality, but as in other areas of medicine, the application of scientific evidence in trauma patients is barely 50%. Moreover, nearly 90% of trauma deaths occur in the crash site or in the first 72h of hospitalization, the vast majority as a result of injuries incompatible with life. In these circumstances it is clear that prevention is the most cost-effective activity. As medical practitioners, our role in prevention is mainly focused on the secondary prevention to avoid recidivism, for which it is necessary to identify risk factor (frequently alcohol, illegal drugs, psychotropic medication etc.) and implement a brief motivational intervention. This activity can reduce recidivism by nearly 50%. In Spain, the activity in this field is negligible therefore measures should be implemented for dissemination of secondary prevention in trauma. Copyright © 2014 Elsevier España, S.L. and SEMICYUC. All rights reserved.

Explaining the Alluring Influence of Neuroscience Information on Scientific Reasoning

ERIC Educational Resources Information Center

Rhodes, Rebecca E.; Rodriguez, Fernando; Shah, Priti

2014-01-01

Previous studies have investigated the influence of neuroscience information or images on ratings of scientific evidence quality but have yielded mixed results. We examined the influence of neuroscience information on evaluations of flawed scientific studies after taking into account individual differences in scientific reasoning skills, thinking…

Bibliometrics for Social Validation.

PubMed

Hicks, Daniel J

2016-01-01

This paper introduces a bibliometric, citation network-based method for assessing the social validation of novel research, and applies this method to the development of high-throughput toxicology research at the US Environmental Protection Agency. Social validation refers to the acceptance of novel research methods by a relevant scientific community; it is formally independent of the technical validation of methods, and is frequently studied in history, philosophy, and social studies of science using qualitative methods. The quantitative methods introduced here find that high-throughput toxicology methods are spread throughout a large and well-connected research community, which suggests high social validation. Further assessment of social validation involving mixed qualitative and quantitative methods are discussed in the conclusion.

Bibliometrics for Social Validation

PubMed Central

2016-01-01

This paper introduces a bibliometric, citation network-based method for assessing the social validation of novel research, and applies this method to the development of high-throughput toxicology research at the US Environmental Protection Agency. Social validation refers to the acceptance of novel research methods by a relevant scientific community; it is formally independent of the technical validation of methods, and is frequently studied in history, philosophy, and social studies of science using qualitative methods. The quantitative methods introduced here find that high-throughput toxicology methods are spread throughout a large and well-connected research community, which suggests high social validation. Further assessment of social validation involving mixed qualitative and quantitative methods are discussed in the conclusion. PMID:28005974

Adaptation of the ESPA29 Parental Socialization Styles Scale to the Basque language: evidence of validity.

PubMed

López-Jáuregui, Alicia; Oliden, Paula Elosua

2009-11-01

The aim of this study is to adapt the ESPA29 scale of parental socialization styles in adolescence to the Basque language. The study of its psychometric properties is based on the search for evidence of internal and external validity. The first focuses on the assessment of the dimensionality of the scale by means of exploratory factor analysis. The relationship between the dimensions of parental socialization styles and gender and age guarantee the external validity of the scale. The study of the equivalence of the adapted and original versions is based on the comparisons of the reliability coefficients and on factor congruence. The results allow us to conclude the equivalence of the two scales.

Validation of learning assessments: A primer.

PubMed

Peeters, Michael J; Martin, Beth A

2017-09-01

The Accreditation Council for Pharmacy Education's Standards 2016 has placed greater emphasis on validating educational assessments. In this paper, we describe validity, reliability, and validation principles, drawing attention to the conceptual change that highlights one validity with multiple evidence sources; to this end, we recommend abandoning historical (confusing) terminology associated with the term validity. Further, we describe and apply Kane's framework (scoring, generalization, extrapolation, and implications) for the process of validation, with its inferences and conclusions from varied uses of assessment instruments by different colleges and schools of pharmacy. We then offer five practical recommendations that can improve reporting of validation evidence in pharmacy education literature. We describe application of these recommendations, including examples of validation evidence in the context of pharmacy education. After reading this article, the reader should be able to understand the current concept of validation, and use a framework as they validate and communicate their own institution's learning assessments. Copyright © 2017 Elsevier Inc. All rights reserved.

Evidence based policy making in the European Union: the role of the scientific community.

PubMed

Majcen, Špela

2017-03-01

In the times when the acquis of the European Union (EU) has developed so far as to reach a high level of technical complexity, in particular in certain policy fields such as environmental legislation, it is important to look at what kind of information and data policy decisions are based on. This position paper looks at the extent to which evidence-based decision-making process is being considered in the EU institutions when it comes to adopting legislation in the field of environment at the EU level. The paper calls for closer collaboration between scientists and decision-makers in view of ensuring that correct data is understood and taken into consideration when drafting, amending, negotiating and adopting new legal texts at all levels of the EU decision-making process. It concludes that better awareness of the need for such collaboration among the decision-makers as well as the scientific community would benefit the process and quality of the final outcomes (legislation).

Roadblocks to Scientific Thinking in Educational Decision Making

ERIC Educational Resources Information Center

Yates, Gregory C. R.

2008-01-01

Principles of scientific data accumulation and evidence-based practices are vehicles of professional enhancement. In this article, the author argues that a scientific knowledge base exists descriptive of the relationship between teachers' activities and student learning. This database appears barely recognised however, for reasons including (a)…

Defending the scientific integrity of conservation-policy processes.

PubMed

Carroll, Carlos; Hartl, Brett; Goldman, Gretchen T; Rohlf, Daniel J; Treves, Adrian; Kerr, Jeremy T; Ritchie, Euan G; Kingsford, Richard T; Gibbs, Katherine E; Maron, Martine; Watson, James E M

2017-10-01

Government agencies faced with politically controversial decisions often discount or ignore scientific information, whether from agency staff or nongovernmental scientists. Recent developments in scientific integrity (the ability to perform, use, communicate, and publish science free from censorship or political interference) in Canada, Australia, and the United States demonstrate a similar trajectory. A perceived increase in scientific-integrity abuses provokes concerted pressure by the scientific community, leading to efforts to improve scientific-integrity protections under a new administration. However, protections are often inconsistently applied and are at risk of reversal under administrations publicly hostile to evidence-based policy. We compared recent challenges to scientific integrity to determine what aspects of scientific input into conservation policy are most at risk of political distortion and what can be done to strengthen safeguards against such abuses. To ensure the integrity of outbound communications from government scientists to the public, we suggest governments strengthen scientific integrity policies, include scientists' right to speak freely in collective-bargaining agreements, guarantee public access to scientific information, and strengthen agency culture supporting scientific integrity. To ensure the transparency and integrity with which information from nongovernmental scientists (e.g., submitted comments or formal policy reviews) informs the policy process, we suggest governments broaden the scope of independent reviews, ensure greater diversity of expert input and transparency regarding conflicts of interest, require a substantive response to input from agencies, and engage proactively with scientific societies. For their part, scientists and scientific societies have a responsibility to engage with the public to affirm that science is a crucial resource for developing evidence-based policy and regulations in the public interest. �

[Evidence-based aspects of clinical mastitis treatment].

PubMed

Mansion-de Vries, E M; Hoedemaker, M; Krömker, V

2015-01-01

Mastitis is one of the most common and expensive diseases in dairy cattle. The decision to treat clinical mastitis is usually made without any knowledge of the etiology, and can therefore only be evidence-based to a limited extent. Evidence-based medicine relies essentially on a combination of one's own clinical competence and scientific findings. In mastitis therapy, those insights depend mostly on pathogen-specific factors. Therefore, in evidence-based therapeutic decision making the pathogen identification should serve as a basis for the consideration of scientifically validated therapeutic concepts. The present paper considers evidence-based treatment of clinical mastitis based on a literature review. The authors conclude that an anti-inflammatory treatment using an NSAID should be conducted regardless of the pathogen. However, the choice of an antibiotic therapy depends on the mastitis causative pathogen, clinical symptoms and the animal itself. In principle, a local antibiotic treatment should be chosen for mild and moderate mastitis. It should be noted, that the benefit of an antibiotic therapy for coliform infections is questionable. With knowledge concerning the pathogen, it appears entirely reasonable to refrain from an antibiotic therapy. For severe (i.   e. feverish) mastitis, a parenteral antibiotic therapy should be selected. An extension of the antibiotic therapy beyond the manufacturer's information is only reasonable for streptococcal infections. It is important to make the decision on a prolonged antibiotic therapy only with the knowledge of the mastitis-causative pathogen. In terms of the therapy of a staphylococcus or streptococcus infection, a narrow-spectrum antibiotic from the penicillin family should be adopted when selecting the active agents.

Further Validation of the IDAS: Evidence of Convergent, Discriminant, Criterion, and Incremental Validity

ERIC Educational Resources Information Center

Watson, David; O'Hara, Michael W.; Chmielewski, Michael; McDade-Montez, Elizabeth A.; Koffel, Erin; Naragon, Kristin; Stuart, Scott

2008-01-01

The authors explicated the validity of the Inventory of Depression and Anxiety Symptoms (IDAS; D. Watson et al., 2007) in 2 samples (306 college students and 605 psychiatric patients). The IDAS scales showed strong convergent validity in relation to parallel interview-based scores on the Clinician Rating version of the IDAS; the mean convergent…

Bayesian assurance and sample size determination in the process validation life-cycle.

PubMed

Faya, Paul; Seaman, John W; Stamey, James D

2017-01-01

Validation of pharmaceutical manufacturing processes is a regulatory requirement and plays a key role in the assurance of drug quality, safety, and efficacy. The FDA guidance on process validation recommends a life-cycle approach which involves process design, qualification, and verification. The European Medicines Agency makes similar recommendations. The main purpose of process validation is to establish scientific evidence that a process is capable of consistently delivering a quality product. A major challenge faced by manufacturers is the determination of the number of batches to be used for the qualification stage. In this article, we present a Bayesian assurance and sample size determination approach where prior process knowledge and data are used to determine the number of batches. An example is presented in which potency uniformity data is evaluated using a process capability metric. By using the posterior predictive distribution, we simulate qualification data and make a decision on the number of batches required for a desired level of assurance.

Occupational health practice and exposure to nanoparticles: reconciling scientific evidence, ethical aspects, and legal requirements.

PubMed

Franco, Giuliano

2011-01-01

The paper aims at focusing the relationship between scientific evidence and ethical values' issues of occupational health practice according to the new Italian law 81/2008 stating that the occupational health physician (OHP) is required to act according to the Code of Ethics of the International Commission on Occupational Health. The code itself emphasizes that (i) the practice should be relevant, knowledge-based, sound, and appropriate to the occupational risks and (ii) the objectives and methods of health surveillance must be clearly defined. Because exposure to nanoparticles involves several uncertainties about health effects and may limit the effectiveness of workers' health surveillance, OHPs face a several ethical dilemmas, involving different stakeholders. The dilemmas arising from the practice should be dealt with according to the ethical principles of beneficence, autonomy, and justice in order to take a decision.

[Phytotherapy in urology. Current scientific evidence of its application in urolithiasis, chronic pelvic pain, erectile dysfunction and urinary tract infections].

PubMed

Morán, E; Budía, A; Broseta, E; Boronat, F

2013-03-01

To assess the usefulness of phytotherapy in urolitiasis, urinary tract infections, erectile dysfunction (ED) and chronic prostatitis/chronic pelvic pain (CP/CPP). Systematic review of the evidence published until January 2011 using the following scientific terms:phytotherapy, urinary lithiasis, Chronic prostatitis, chronic pelvic pain, erectile dysfunction, urinary tract infection, cystitis and the scientific names of compounds following the rules of the International Code of Botanical Nomenclature. The databases used were Medline and The Cochrane Library.We included articles published until January 2011 written in English and Spanish. We included studies in Vitro/in vivo on animal models or human beings. Exclusion criteria were literature not in English and Spanish or articles with serious methodological flaws. We included 86 articles selecting 40 that met the inclusion criteria. In Urolitiasis there are few works in humans. The phytate has its main use as prevention and in reducing the growth of residual fragments after extracorporeal shock wave lithotripsy (ESWL). In CP/CPP the only compound that has shown effectiveness was the extract of pollen in a field of multimodal treatment. In DE ther is no evidence for the use of herbal medicine.Most of the works have limitations in the design or low sample size. In urinary tract infections most of the products are diuretics .There is only evidence for the cranberry as prevention in young or pregnant women. It must not be used as a treatment for urinary tract infections. Phytotherapy is usefull in repeat urinary tract infections and the CP/CPP. It has some role in the urolitiasis and lacks useful in the DE. Copyright © 2012 AEU. Published by Elsevier Espana. All rights reserved.

Plausibility and evidence: the case of homeopathy.

PubMed

Rutten, Lex; Mathie, Robert T; Fisher, Peter; Goossens, Maria; van Wassenhoven, Michel

2013-08-01

Homeopathy is controversial and hotly debated. The conclusions of systematic reviews of randomised controlled trials of homeopathy vary from 'comparable to conventional medicine' to 'no evidence of effects beyond placebo'. It is claimed that homeopathy conflicts with scientific laws and that homoeopaths reject the naturalistic outlook, but no evidence has been cited. We are homeopathic physicians and researchers who do not reject the scientific outlook; we believe that examination of the prior beliefs underlying this enduring stand-off can advance the debate. We show that interpretations of the same set of evidence--for homeopathy and for conventional medicine--can diverge. Prior disbelief in homeopathy is rooted in the perceived implausibility of any conceivable mechanism of action. Using the 'crossword analogy', we demonstrate that plausibility bias impedes assessment of the clinical evidence. Sweeping statements about the scientific impossibility of homeopathy are themselves unscientific: scientific statements must be precise and testable. There is growing evidence that homeopathic preparations can exert biological effects; due consideration of such research would reduce the influence of prior beliefs on the assessment of systematic review evidence.

Oligosaccharides in infant formula: more evidence to validate the role of prebiotics.

PubMed

Vandenplas, Yvan; Zakharova, Irina; Dmitrieva, Yulia

2015-05-14

The gastrointestinal (GI) microbiota differs between breast-fed and classic infant formula-fed infants. Breast milk is rich in prebiotic oligosaccharides (OS) and may also contain some probiotics, but scientific societies do not recommend the addition of prebiotic OS or probiotics to standard infant formula. Nevertheless, many infant formula companies often add one or the other or both. Different types of prebiotic OS are used in infant formula, including galacto-oligosaccharide, fructo-oligosaccharide, polydextrose and mixtures of these OS, but none adds human milk OS. There is evidence that the addition of prebiotics to infant formula brings the GI microbiota of formula-fed infants closer to that of breast-fed infants. Prebiotics change gut metabolic activity (by decreasing stool pH and increasing SCFA), have a bifidogenic effect and bring stool consistency and defecation frequency closer to those of breast-fed infants. Although there is only limited evidence that these changes in GI microbiota induce a significant clinical benefit for the immune system, interesting positive trends have been observed in some markers. Additionally, adverse effects are extremely seldom. Prebiotics are added to infant formula because breast milk contains human milk OS. Because most studies suggest a trend of beneficial effects and because these ingredients are very safe, prebiotics bring infant formula one step closer to the golden standard of breast milk.

Self-Reported Emotion Reactivity Among Early-Adolescent Girls: Evidence for Convergent and Discriminant Validity in an Urban Community Sample.

PubMed

Evans, Spencer C; Blossom, Jennifer B; Canter, Kimberly S; Poppert-Cordts, Katrina; Kanine, Rebecca; Garcia, Andrea; Roberts, Michael C

2016-05-01

Emotion reactivity, measured via the self-report Emotion Reactivity Scale (ERS), has shown unique associations with different forms of psychopathology and suicidal thoughts and behaviors; however, this limited body of research has been conducted among adults and older adolescents of predominantly White/European ethnic backgrounds. The present study investigated the validity of ERS scores for measuring emotion reactivity among an urban community sample of middle-school-age girls. Participants (N = 93, ages 11-15, 76% African-American, 18% Latina) completed the ERS and measures of emotion coping, internalizing problems, proactive and reactive aggression, negative life events, and lifetime suicidal ideation and substance use. As hypothesized, ERS scores were significantly associated with internalizing problems, poor emotion coping, negative life events, reactive aggression, and suicidal ideation (evidence for convergent validity), but showed little to no association with proactive aggression or lifetime substance use (evidence for discriminant validity). A series of logistic regressions were conducted to further explore the associations among internalizing problems, emotion reactivity, and suicidal ideation. With depressive symptoms included in the model, emotion reactivity was no longer uniquely predictive of lifetime suicidal ideation, nor did it serve as a moderator of other associations. In conjunction with previous research, these findings offer further support for the construct validity and research utility of the ERS as a self-report measure of emotion reactivity in adolescents. Copyright © 2016. Published by Elsevier Ltd.

Science Classroom Discussion as Scientific Argumentation: A Study of Conceptually Rich (and Poor) Student Talk

ERIC Educational Resources Information Center

Shemwell, Jonathan T.; Furtak, Erin Marie

2010-01-01

One way to frame science classroom discussion is to engage students in scientific argumentation, an important discourse format within science aimed at coordinating empirical evidence and scientific theory. Framing discussion as scientific argumentation gives clear priority to contributions that are sustained by evidence. We question whether this…

Evidences of Validity of a Scale for Mapping Professional as Defining Competences and Performance by Brazilian Tutors

ERIC Educational Resources Information Center

Coelho, Francisco Antonio, Jr.; Ferreira, Rodrigo Rezende; Paschoal, Tatiane; Faiad, Cristiane; Meneses, Paulo Murce

2015-01-01

The purpose of this study was twofold: to assess evidences of construct validity of the Brazilian Scale of Tutors Competences in the field of Open and Distance Learning and to examine if variables such as professional experience, perception of the student´s learning performance and prior experience influence the development of technical and…

Direct Observation of Clinical Skills Feedback Scale: Development and Validity Evidence.

PubMed

Halman, Samantha; Dudek, Nancy; Wood, Timothy; Pugh, Debra; Touchie, Claire; McAleer, Sean; Humphrey-Murto, Susan

2016-01-01

Construct: This article describes the development and validity evidence behind a new rating scale to assess feedback quality in the clinical workplace. Competency-based medical education has mandated a shift to learner-centeredness, authentic observation, and frequent formative assessments with a focus on the delivery of effective feedback. Because feedback has been shown to be of variable quality and effectiveness, an assessment of feedback quality in the workplace is important to ensure we are providing trainees with optimal learning opportunities. The purposes of this project were to develop a rating scale for the quality of verbal feedback in the workplace (the Direct Observation of Clinical Skills Feedback Scale [DOCS-FBS]) and to gather validity evidence for its use. Two panels of experts (local and national) took part in a nominal group technique to identify features of high-quality feedback. Through multiple iterations and review, 9 features were developed into the DOCS-FBS. Four rater types (residents n = 21, medical students n = 8, faculty n = 12, and educators n = 12) used the DOCS-FBS to rate videotaped feedback encounters of variable quality. The psychometric properties of the scale were determined using a generalizability analysis. Participants also completed a survey to gather data on a 5-point Likert scale to inform the ease of use, clarity, knowledge acquisition, and acceptability of the scale. Mean video ratings ranged from 1.38 to 2.96 out of 3 and followed the intended pattern suggesting that the tool allowed raters to distinguish between examples of higher and lower quality feedback. There were no significant differences between rater type (range = 2.36-2.49), suggesting that all groups of raters used the tool in the same way. The generalizability coefficients for the scale ranged from 0.97 to 0.99. Item-total correlations were all above 0.80, suggesting some redundancy in items. Participants found the scale easy to use (M = 4.31/5) and clear

The Mastery Rubric for Evidence-Based Medicine: Institutional Validation via Multidimensional Scaling.

PubMed

Tractenberg, Rochelle E; Gushta, Matthew M; Weinfeld, Jeffrey M

2016-01-01

CONSTRUCT: In this study we describe a multidimensional scaling (MDS) exercise to validate the curricular elements composing a new Mastery Rubric (MR) for a curriculum in evidence-based medicine (EBM). This MR-EBM comprises 10 elements of knowledge, skills, and abilities (KSAs) representing our institutional learning goals of career-spanning engagement with EBM. An MR also includes developmental trajectories for each KSA, beginning with medical school coursework, including residency training, and outlining the qualifications of individuals to teach and mentor in EBM. The development was not part of the validation effort, as our curriculum is focused at a single stage (undergraduate medical students). An MR comprises the desired KSAs for an entire curriculum, together with descriptions of a learner's performance and/or capabilities as they develop from novice to proficiency of the curricular target(s). The MR construct is intended to support curriculum development or refinement by capturing the KSAs that support the articulation of concrete learning goals; it also promotes assessment that demonstrates development in the target KSAs and encourages reflection and self-directed learning throughout the learner's career. Two other MRs have been published, and this is the first one specific to teaching and learning in medicine; this is also the first one created specifically to evaluate an existing curriculum. To validate the dispersion of the elements of the EBM curriculum, the nine clinical instructors in the EBM two-course curriculum completed an MDS exercise, rating the similarities of the 10 curricular elements. MDS is a mathematical approach to understanding relationships among concepts/objects when these relationships are difficult to quantify. Eliciting similarity ratings biased the responses toward the null hypothesis (that the elements are not different). MDS results suggested that the MR represents 10 different, although related, facets of the construct

Predictors, Indicators, and Validated Measures of Dependence in Menthol Smokers

PubMed Central

Muhammad-Kah, Raheema; Rimmer, Lonnie; Liang, Qiwei

2014-01-01

This article presents a comprehensive review of the menthol cigarette dependence-related literature and results from an original analysis of the Total Exposure Study (TES), which included 1,100 menthol and 2,400 nonmenthol adult smokers. The substantial scientific evidence available related to age of first cigarette, age of regular use, single-item dependence indicators (smoking frequency, cigarettes per day, time to first cigarette, night waking to smoke), smoking duration, numerous validated and widely accepted measures of nicotine/cigarette dependence, and our analysis of the TES do not support that menthol smokers are more dependent than nonmenthol smokers or that menthol increases dependence. PMID:24738914

Scientific Research in Education

ERIC Educational Resources Information Center

Shavelson, Richard J., Ed.; Towne, Lisa, Ed.

2002-01-01

Researchers, historians, and philosophers of science have debated the nature of scientific research in education for more than 100 years. Recent enthusiasm for "evidence-based" policy and practice in education now codified in the federal law that authorizes the bulk of elementary and secondary education programs have brought a new sense…

Development of an evidence-based training program for laparoscopic hysterectomy on a virtual reality simulator.

PubMed

Crochet, Patrice; Aggarwal, Rajesh; Knight, Sophie; Berdah, Stéphane; Boubli, Léon; Agostini, Aubert

2017-06-01

Substantial evidence in the scientific literature supports the use of simulation for surgical education. However, curricula lack for complex laparoscopic procedures in gynecology. The objective was to evaluate the validity of a program that reproduces key specific components of a laparoscopic hysterectomy (LH) procedure until colpotomy on a virtual reality (VR) simulator and to develop an evidence-based and stepwise training curriculum. This prospective cohort study was conducted in a Marseille teaching hospital. Forty participants were enrolled and were divided into experienced (senior surgeons who had performed more than 100 LH; n = 8), intermediate (surgical trainees who had performed 2-10 LH; n = 8) and inexperienced (n = 24) groups. Baselines were assessed on a validated basic task. Participants were tested for the LH procedure on a high-fidelity VR simulator. Validity evidence was proposed as the ability to differentiate between the three levels of experience. Inexperienced subjects performed ten repetitions for learning curve analysis. Proficiency measures were based on experienced surgeons' performances. Outcome measures were simulator-derived metrics and Objective Structured Assessment of Technical Skills (OSATS) scores. Quantitative analysis found significant inter-group differences between experienced intermediate and inexperienced groups for time (1369, 2385 and 3370 s; p < 0.001), number of movements (2033, 3195 and 4056; p = 0.001), path length (3390, 4526 and 5749 cm; p = 0.002), idle time (357, 654 and 747 s; p = 0.001), respect for tissue (24, 40 and 84; p = 0.01) and number of bladder injuries (0.13, 0 and 4.27; p < 0.001). Learning curves plateaued at the 2nd to 6th repetition. Further qualitative analysis found significant inter-group OSATS score differences at first repetition (22, 15 and 8, respectively; p < 0.001) and second repetition (25.5, 19.5 and 14; p < 0.001). The VR program for LH accrued validity evidence and

A Simple Exercise Reveals the Way Students Think about Scientific Modeling

ERIC Educational Resources Information Center

Ruebush, Laura; Sulikowski, Michelle; North, Simon

2009-01-01

Scientific modeling is an integral part of contemporary science, yet many students have little understanding of how models are developed, validated, and used to predict and explain phenomena. A simple modeling exercise led to significant gains in understanding key attributes of scientific modeling while revealing some stubborn misconceptions.…

Factor Analysis Methods and Validity Evidence: A Systematic Review of Instrument Development across the Continuum of Medical Education

ERIC Educational Resources Information Center

Wetzel, Angela Payne

2011-01-01

Previous systematic reviews indicate a lack of reporting of reliability and validity evidence in subsets of the medical education literature. Psychology and general education reviews of factor analysis also indicate gaps between current and best practices; yet, a comprehensive review of exploratory factor analysis in instrument development across…

The effects of metallic engineered nanoparticles upon plant systems: An analytic examination of scientific evidence.

PubMed

Tolaymat, Thabet; Genaidy, Ash; Abdelraheem, Wael; Dionysiou, Dionysios; Andersen, Christian

2017-02-01

Recent evidence for the effects of metallic engineered nanoparticles (ENPs) on plants and plant systems was examined together with its implications for other constituents of the Society-Environment-Economy (SEE) system. In this study, we were particularly interested to determine whether or not metallic ENPs have both stimulatory and inhibitory effects upon plant performance. An emphasis was made to analyze the scientific evidence on investigations examining both types of effects in the same studies. Analysis of evidence demonstrated that metallic ENPs have both stimulatory and inhibitory effects mostly in well-controlled environments and soilless media. Nano zero-valent iron (nZVI) and Cu ENPs have potential for use as micronutrients for plant systems, keeping in mind the proper formulation at the right dose for each type of ENP. The concentration levels for the stimulatory effects of Cu ENPs are lower than for those for nZVI. Newer findings showed that extremely smaller concentrations of Au ENPs (smaller than those for nZVI and Cu ENPs) induce positive effects for plant growth, which is attributed to effects on secondary metabolites. Ag ENPs have demonstrated their usage as antimicrobial/pesticidal agents for plant protection; however, precautions should be taken to avoid higher concentrations not only for plant systems, but also, other constituents in the SEE. Further research is warranted to investigate the stimulatory and inhibitory effects of metallic ENPs in soil media in order to broaden the horizon of sustainable agriculture production in terms of higher and safer yields so as to meet the food requirements of human population. Copyright © 2016. Published by Elsevier B.V.

Additional evidence of far transfer of scientific reasoning skills acquired in a CLASP reformed physics course

NASA Astrophysics Data System (ADS)

Potter, Wendell H.; Lynch, Robert B.

2013-01-01

The introductory physics course taken by biological science majors at UC Davis, Physics 7, was radically reformed 16 years ago in order to explicitly emphasize the development of scientific reasoning skills in all elements of the course. We have previously seen evidence of increased performance on the biological and physical science portions of the MCAT exam, in a rigorous systemic physiology course, and higher graduating GPAs for students who took Physics 7 rather than a traditionally taught introductory physics course. We report here on the increased performance by a group of biological-science majors in a general chemistry course who took the first quarter of Physics 7 prior to beginning the chemistry course sequence compared to a similar group who began taking physics after completing the first two quarters of general chemistry.

ESP: Teaching "Scientific Method" by Counterexample

ERIC Educational Resources Information Center

Blatt, S. L.

1975-01-01

Offers a course description of an introductory course in physics for nonscientists. The history of research into extrasensory perception is used as evidence of the scientific method. Lecture demonstrations are discussed. (Author/CP)

Framing of scientific knowledge as a new category of health care research.

PubMed

Salvador-Carulla, Luis; Fernandez, Ana; Madden, Rosamond; Lukersmith, Sue; Colagiuri, Ruth; Torkfar, Ghazal; Sturmberg, Joachim

2014-12-01

The new area of health system research requires a revision of the taxonomy of scientific knowledge that may facilitate a better understanding and representation of complex health phenomena in research discovery, corroboration and implementation. A position paper by an expert group following and iterative approach. 'Scientific evidence' should be differentiated from 'elicited knowledge' of experts and users, and this latter typology should be described beyond the traditional qualitative framework. Within this context 'framing of scientific knowledge' (FSK) is defined as a group of studies of prior expert knowledge specifically aimed at generating formal scientific frames. To be distinguished from other unstructured frames, FSK must be explicit, standardized, based on the available evidence, agreed by a group of experts and subdued to the principles of commensurability, transparency for corroboration and transferability that characterize scientific research. A preliminary typology of scientific framing studies is presented. This typology includes, among others, health declarations, position papers, expert-based clinical guides, conceptual maps, classifications, expert-driven health atlases and expert-driven studies of costs and burden of illness. This grouping of expert-based studies constitutes a different kind of scientific knowledge and should be clearly differentiated from 'evidence' gathered from experimental and observational studies in health system research. © 2014 John Wiley & Sons, Ltd.

Evidence Study Guide.

DTIC Science & Technology

1987-04-01

involving novel scientific evidence, e.g., the drug-induced or hypnosis -induced interview of a witness. Although the rules on experts contain no reference...under the Fed.R.Evid. Among the evidence which Nil.R.Evid. 803(6) makes admissible are forensic laboratory reports and chain of custody documents. The...34 inclusion of forensic laboratory reports and chain of custody documents in this Mil.R.Evid. is in conflict with the legislative history of

A new dataset validation system for the Planetary Science Archive

NASA Astrophysics Data System (ADS)

Manaud, N.; Zender, J.; Heather, D.; Martinez, S.

2007-08-01

The Planetary Science Archive is the official archive for the Mars Express mission. It has received its first data by the end of 2004. These data are delivered by the PI teams to the PSA team as datasets, which are formatted conform to the Planetary Data System (PDS). The PI teams are responsible for analyzing and calibrating the instrument data as well as the production of reduced and calibrated data. They are also responsible of the scientific validation of these data. ESA is responsible of the long-term data archiving and distribution to the scientific community and must ensure, in this regard, that all archived products meet quality. To do so, an archive peer-review is used to control the quality of the Mars Express science data archiving process. However a full validation of its content is missing. An independent review board recently recommended that the completeness of the archive as well as the consistency of the delivered data should be validated following well-defined procedures. A new validation software tool is being developed to complete the overall data quality control system functionality. This new tool aims to improve the quality of data and services provided to the scientific community through the PSA, and shall allow to track anomalies in and to control the completeness of datasets. It shall ensure that the PSA end-users: (1) can rely on the result of their queries, (2) will get data products that are suitable for scientific analysis, (3) can find all science data acquired during a mission. We defined dataset validation as the verification and assessment process to check the dataset content against pre-defined top-level criteria, which represent the general characteristics of good quality datasets. The dataset content that is checked includes the data and all types of information that are essential in the process of deriving scientific results and those interfacing with the PSA database. The validation software tool is a multi-mission tool that

Validation of educational assessments: a primer for simulation and beyond.

PubMed

Cook, David A; Hatala, Rose

2016-01-01

Simulation plays a vital role in health professions assessment. This review provides a primer on assessment validation for educators and education researchers. We focus on simulation-based assessment of health professionals, but the principles apply broadly to other assessment approaches and topics. Validation refers to the process of collecting validity evidence to evaluate the appropriateness of the interpretations, uses, and decisions based on assessment results. Contemporary frameworks view validity as a hypothesis, and validity evidence is collected to support or refute the validity hypothesis (i.e., that the proposed interpretations and decisions are defensible). In validation, the educator or researcher defines the proposed interpretations and decisions, identifies and prioritizes the most questionable assumptions in making these interpretations and decisions (the "interpretation-use argument"), empirically tests those assumptions using existing or newly-collected evidence, and then summarizes the evidence as a coherent "validity argument." A framework proposed by Messick identifies potential evidence sources: content, response process, internal structure, relationships with other variables, and consequences. Another framework proposed by Kane identifies key inferences in generating useful interpretations: scoring, generalization, extrapolation, and implications/decision. We propose an eight-step approach to validation that applies to either framework: Define the construct and proposed interpretation, make explicit the intended decision(s), define the interpretation-use argument and prioritize needed validity evidence, identify candidate instruments and/or create/adapt a new instrument, appraise existing evidence and collect new evidence as needed, keep track of practical issues, formulate the validity argument, and make a judgment: does the evidence support the intended use? Rigorous validation first prioritizes and then empirically evaluates key

The need for scientific software engineering in the pharmaceutical industry

NASA Astrophysics Data System (ADS)

Luty, Brock; Rose, Peter W.

2017-03-01

Scientific software engineering is a distinct discipline from both computational chemistry project support and research informatics. A scientific software engineer not only has a deep understanding of the science of drug discovery but also the desire, skills and time to apply good software engineering practices. A good team of scientific software engineers can create a software foundation that is maintainable, validated and robust. If done correctly, this foundation enable the organization to investigate new and novel computational ideas with a very high level of efficiency.

The need for scientific software engineering in the pharmaceutical industry.

PubMed

Luty, Brock; Rose, Peter W

2017-03-01

Scientific software engineering is a distinct discipline from both computational chemistry project support and research informatics. A scientific software engineer not only has a deep understanding of the science of drug discovery but also the desire, skills and time to apply good software engineering practices. A good team of scientific software engineers can create a software foundation that is maintainable, validated and robust. If done correctly, this foundation enable the organization to investigate new and novel computational ideas with a very high level of efficiency.

Adjusting Claims as New Evidence Emerges: Do Students Incorporate New Evidence into Their Scientific Explanations?

ERIC Educational Resources Information Center

Novak, Ann M.; Treagust, David F.

2018-01-01

Constructing explanations of complex phenomena is an important part of doing science and it is also an important component of learning science. Students need opportunities to make claims based on available evidence and then use science concepts to justify why evidence supports the claim. But what happens when "new" evidence emerges for…

Montreal Battery of Evaluation of Amusia: Validity evidence and norms for adolescents in Belo Horizonte, Minas Gerais, Brazil

PubMed Central

Nunes-Silva, Marília; Haase, Vitor Geraldi

2012-01-01

The Montreal Battery of Evaluation of Amusia (MBEA) is a battery of tests that assesses six music processing components: scale, contour, interval, rhythm, metric, and music memory. The present study sought to verify the psychometric characteristics of the MBEA in a sample of 150 adolescents aged 14-18 years in the city of Belo Horizonte, Minas Gerais, Brazil, and to develop specific norms for this population. We used statistical procedures that explored the dimensional structure of the MBEA and its items, evaluating their adequacy from empirical data, verifying their reliability, and providing evidence of validity. The results for the difficult levels for each test indicated a trend toward higher scores, corroborating previous studies. From the analysis of the criterion groups, almost all of the items were considered discriminatory. The global score of the MBEA was shown to be valid and reliable (rK-R20=0.896) for assessing the musical ability of normal teenagers. Based on the analysis of the items, we proposed a short version of the MBEA. Further studies with larger samples and amusic individuals are necessary to provide evidence of the validity of the MBEA in the Brazilian milieu. The present study brings to the Brazilian context a tool for diagnosing deficits in musical skills and will serve as a basis for comparisons with single case studies and studies of populations with specific neuropsychological syndromes. PMID:29213804

Cancer based pharmacogenomics network supported with scientific evidences: from the view of drug repurposing.

PubMed

Wang, Liwei; Liu, Hongfang; Chute, Christopher G; Zhu, Qian

2015-01-01

Pharmacogenomics (PGx) as an emerging field, is poised to change the way we practice medicine and deliver health care by customizing drug therapies on the basis of each patient's genetic makeup. A large volume of PGx data including information among drugs, genes, and single nucleotide polymorphisms (SNPs) has been accumulated. Normalized and integrated PGx information could facilitate revelation of hidden relationships among drug treatments, genomic variations, and phenotype traits to better support drug discovery and next generation of treatment. In this study, we generated a normalized and scientific evidence supported cancer based PGx network (CPN) by integrating cancer related PGx information from multiple well-known PGx resources including the Pharmacogenomics Knowledge Base (PharmGKB), the FDA PGx Biomarkers in Drug Labeling, and the Catalog of Published Genome-Wide Association Studies (GWAS). We successfully demonstrated the capability of the CPN for drug repurposing by conducting two case studies. The CPN established in this study offers comprehensive cancer based PGx information to support cancer orientated research, especially for drug repurposing.

The 10 basic requirements for a scientific paper reporting antioxidant, antimutagenic or anticarcinogenic potential of test substances in in vitro experiments and animal studies in vivo.

PubMed

Verhagen, H; Aruoma, O I; van Delft, J H M; Dragsted, L O; Ferguson, L R; Knasmüller, S; Pool-Zobel, B L; Poulsen, H E; Williamson, G; Yannai, S

2003-05-01

There is increasing evidence that chemicals/test substances cannot only have adverse effects, but that there are many substances that can (also) have a beneficial effect on health. As this journal regularly publishes papers in this area and has every intention in continuing to do so in the near future, it has become essential that studies reported in this journal reflect an adequate level of scientific scrutiny. Therefore a set of essential characteristics of studies has been defined. These basic requirements are default properties rather than non-negotiables: deviations are possible and useful, provided they can be justified on scientific grounds. The 10 basic requirements for a scientific paper reporting antioxidant, antimutagenic or anticarcinogenic potential of test substances in in vitro experiments and animal studies in vivo concern the following areas: (1) Hypothesis-driven study design; (2) The nature of the test substance; (3) Valid and invalid test systems; (4) The selection of dose levels and gender; (5) Reversal of the effects induced by oxidants, carcinogens and mutagens; (6) Route of administration; (7) Number and validity of test variables; (8) Repeatability and reproducibility; (9) Statistics; and (10) Quality Assurance.

Food for Thought ... Mechanistic Validation

PubMed Central

Hartung, Thomas; Hoffmann, Sebastian; Stephens, Martin

2013-01-01

Summary Validation of new approaches in regulatory toxicology is commonly defined as the independent assessment of the reproducibility and relevance (the scientific basis and predictive capacity) of a test for a particular purpose. In large ring trials, the emphasis to date has been mainly on reproducibility and predictive capacity (comparison to the traditional test) with less attention given to the scientific or mechanistic basis. Assessing predictive capacity is difficult for novel approaches (which are based on mechanism), such as pathways of toxicity or the complex networks within the organism (systems toxicology). This is highly relevant for implementing Toxicology for the 21st Century, either by high-throughput testing in the ToxCast/ Tox21 project or omics-based testing in the Human Toxome Project. This article explores the mostly neglected assessment of a test's scientific basis, which moves mechanism and causality to the foreground when validating/qualifying tests. Such mechanistic validation faces the problem of establishing causality in complex systems. However, pragmatic adaptations of the Bradford Hill criteria, as well as bioinformatic tools, are emerging. As critical infrastructures of the organism are perturbed by a toxic mechanism we argue that by focusing on the target of toxicity and its vulnerability, in addition to the way it is perturbed, we can anchor the identification of the mechanism and its verification. PMID:23665802

Associations between attitudes towards scientific misconduct and self-reported behavior.

PubMed

Holm, Søren; Hofmann, Bjørn

2018-06-25

We investigate the relationship between doctoral students' attitudes towards scientific misconduct and their self-reported behavior. 203 questionnaires were distributed to doctoral candidates at the Faculty of Medicine, University of Oslo 2016/2017. The response rate was 74%. The results show a correlation between attitudes towards misconduct and self-reported problematic behaviors among doctoral students in biomedicine. The four most common reported misbehaviors are adding author(s) who did not qualify for authorship (17.9%), collecting more data after seeing that the results were almost statistically significant (11.8%), turning a blind eye to colleagues' use of flawed data or questionable interpretation of data (11.2%), and reporting an unexpected finding as having been hypothesized from the start (10.5%). We find correlations between scientific misbehavior and the location of undergraduate studies and whether the respondents have had science ethics lectures previously. The study provides evidence for the concurrent validity of the two instruments used to measure attitudes and behavior, i.e. the Kalichman scale and the Research Misbehavior Severity Score (RMSS). Although the direction of causality between attitudes and misbehavior cannot be determined in this study the correlation between the two indicates that it can be important to engender the right attitudes in early career researchers.

Validity evidence for the Hamburg multiple mini-interview.

PubMed

Knorr, Mirjana; Schwibbe, Anja; Ehrhardt, Maren; Lackamp, Janina; Zimmermann, Stefan; Hampe, Wolfgang

2018-05-14

Multiple mini-interviews (MMI) become increasingly popular for the selection of medical students. In this work, we examine the validity evidence for the Hamburg MMI. We conducted three follow-up studies for the 2014 cohort of applicants to medical school over the course of two years. We calculated Spearman's rank correlation (ρ) between MMI results and (1) emotional intelligence measured by the Trait Emotional Intelligence Questionnaire (TEIQue-SF) and the Situational Test of Emotion Management (STEM), (2) supervisors' and practice team members' evaluations of psychosocial competencies and suitability for the medical profession after a one-week 1:1 teaching in a general practice (GP) and (3) objective structured clinical examination (OSCE) scores. There were no significant correlations between MMI results and the TEIQue-SF (ρ = .07, p > .05) or the STEM (ρ = .05, p > .05). MMI results could significantly predict GP evaluations of psychosocial competencies (ρ = .32, p < .05) and suitability for the medical profession (ρ = .42, p < .01) as well as OSCE scores (ρ = .23, p < .05). The MMI remained a significant predictor of these outcomes in a robust regression model including gender and age as control variables. Our findings suggest that MMIs can measure competencies that are relevant in a practical context. However, these competencies do not seem to be related to emotional intelligence as measured by self-report or situational judgement test.

Development and Preliminary Validation of a New Measure of Values in Scientific Work.

PubMed

English, Tammy; Antes, Alison L; Baldwin, Kari A; DuBois, James M

2018-04-01

In this paper we describe the development and initial psychometric evaluation of a new measure, the values in scientific work (VSW). This scale assesses the level of importance that investigators attach to different VSW. It taps a broad range of intrinsic, extrinsic, and social values that motivate the work of scientists, including values specific to scientific work (e.g., truth and integrity) and more classic work values (e.g., security and prestige) in the context of science. Notably, the values represented in this scale are relevant to scientists regardless of their career stage and research focus. We administered the VSW and a measure of global values to 203 NIH-funded investigators. Exploratory factor analyses suggest the delineation of eight VSW, including autonomy, research ethics, social impact, income, collaboration, innovation and growth, conserving relationships, and job security. These VSW showed predictable and distinct associations with global values. Implications of these findings for work on research integrity and scientific misconduct are discussed.

[Evidence-based medicine: a critical analysis of the concept of evidence in medicine].

PubMed

Federspil, G; Vettor, R

2001-06-01

There is currently a lively debate involving scholars from diverse cultural background on the subject of evidence-based medicine. In order to set out the grounds of discussion this paper deals with the problem of "evidence", both the concept and meaning of this term. After a brief history of the idea of "evidence" from antiquity to the present day, it will be underlined how modern day thinking recognizes the existence of two types of "evidence": rational evidence supported first by René Descartes, and perceptible evidence, defended by Francis Bacon. In contemporary epistemology the idea of "evidence" has been conceived above all as perceptible and is closely linked to the idea of fact. The concept of "scientific fact" will therefore be analyzed and will reveal how in science, contrary to prevailing opinion, "pure facts" practically do not exist and how the "facts" which scientists talk about in their research are always "facts depending on theory". Subsequently the capacity of "facts" to prove scientific hypothesis will be examined. In the light of more recent epistemological reflection the thesis will be maintained according to which facts are not capable of definitively proving the truth of a theory. Such reflection leads to the conclusion that in medicine "evidence" is always dependent on the theoretical and practical context in which researchers work. In the final part of the paper the epistemological presumptions and ambitions of evidence-based medicine will be examined. This analysis concludes that the epistemology on which evidence-based medicine relies upon does not grasp the true complexity of the scientific methodology and can weaken in doctors the beneficial stimulus that is doubt.

Evidence and evidence gaps in therapies of nasal obstruction and rhinosinusitis

PubMed Central

Rotter, Nicole

2016-01-01

Therapeutic decisions in otorhinolaryngology are based on clinical experience, surgical skills, and scientific evidence. Recently, evidence-based therapies have gained increased attention and importance due to their potential to improve the individual patient’s treatment and their potential at the same time to reduce treatment costs. In clinical practice, it is almost impossible to stay ahead of the increasing mass of literature and on the other hand critically assess the presented data. A solid scientific and statistical knowledge as well as a significant amount of spare time are required to detect systematic bias and other errors in study designs, also with respect to assessing whether or not a study should be part of an individual therapeutic decision. Meta-analyses, reviews, and clinical guidelines are, therefore, of increasing importance for evidence-based therapy in clinical practice. This review is an update of the availability of external evidence for the treatment of nasal obstruction and rhinosinusitis. It becomes evident that both groups of diseases differ significantly in the availability of external evidence. Furthermore, it becomes obvious that surgical treatment options are normally based on evidence of significantly lower quality than medical treatment options. PMID:28025606

An Evidence-Based Systematic Review of Beta-Sitosterol, Sitosterol (22,23- dihydrostigmasterol, 24-ethylcholesterol) by the Natural Standard Research Collaboration.

PubMed

Ulbricht, Catherine E

2016-01-01

An evidence-based systematic review of beta-sitosterol, sitosterol (22,23-dihydrostigmasterol, 24-ethylcholesterol) by the Natural Standard Research Collaboration consolidates the safety and efficacy data available in the scientific literature using a validated, reproducible grading rationale. This article includes written and statistical analysis of clinical trials, plus a compilation of expert opinion, folkloric precedent, history, pharmacology, kinetics/dynamics, interactions, adverse effects, toxicology, and dosing.

The polity of academic medicine: evidence-based democracy.

PubMed

Willing, Steven J; Gunderman, Richard B; Cochran, Philip L; Saxton, Todd

2005-04-01

The authors consider the empirical data examining relationships between democratic governance and organizational success. There is overwhelming evidence that democratically run organizations excel in key parameters of success, such as business valuation, productivity, responsiveness, innovation, decision making, and worker morale and satisfaction. A review of physician surveys shows that discontent with academic administration is a major contributor to faculty turnover. Other data indicate that the basic concepts justifying autocratic governance of a department are deeply flawed and that autocratic governance is counterproductive. The authors conclude that the democratic governance of academic departments is the only model that is scientifically valid and would greatly enhance all missions of academic medicine in the 21st century.

Communicating Scientific Findings to Lawyers, Policy-Makers, and the Public (Invited)

NASA Astrophysics Data System (ADS)

Thompson, W.; Velsko, S. P.

2013-12-01

This presentation will summarize the authors' collaborative research on inferential errors, bias and communication difficulties that have arisen in the area of WMD forensics. This research involves analysis of problems that have arisen in past national security investigations, interviews with scientists from various disciplines whose work has been used in WMD investigations, interviews with policy-makers, and psychological studies of lay understanding of forensic evidence. Implications of this research for scientists involved in nuclear explosion monitoring will be discussed. Among the issues covered will be: - Potential incompatibilities between the questions policy makers pose and the answers that experts can provide. - Common misunderstandings of scientific and statistical data. - Advantages and disadvantages of various methods for describing and characterizing the strength of scientific findings. - Problems that can arise from excessive hedging or, alternatively, insufficient qualification of scientific conclusions. - Problems that can arise from melding scientific and non-scientific evidence in forensic assessments.

Development and Validation of Scientific Literacy Scale for College Preparedness in STEM with Freshmen from Diverse Institutions

ERIC Educational Resources Information Center

Benjamin, Thomas E.; Marks, Bryant; Demetrikopoulos, Melissa K.; Rose, Jordan; Pollard, Ethen; Thomas, Alicia; Muldrow, Lycurgus L.

2017-01-01

Although a major goal of Science, Technology, Engineering, and Mathematics (STEM) education is to develop scientific literacy, prior efforts at measuring scientific literacy have not attempted to link scientific literacy with success in STEM fields. The current Scientific Literacy Survey for College Preparedness in STEM (SLSCP-STEM) scale was…

Is risk analysis scientific?

PubMed

Hansson, Sven Ove; Aven, Terje

2014-07-01

This article discusses to what extent risk analysis is scientific in view of a set of commonly used definitions and criteria. We consider scientific knowledge to be characterized by its subject matter, its success in developing the best available knowledge in its fields of study, and the epistemic norms and values that guide scientific investigations. We proceed to assess the field of risk analysis according to these criteria. For this purpose, we use a model for risk analysis in which science is used as a base for decision making on risks, which covers the five elements evidence, knowledge base, broad risk evaluation, managerial review and judgment, and the decision; and that relates these elements to the domains experts and decisionmakers, and to the domains fact-based or value-based. We conclude that risk analysis is a scientific field of study, when understood as consisting primarily of (i) knowledge about risk-related phenomena, processes, events, etc., and (ii) concepts, theories, frameworks, approaches, principles, methods and models to understand, assess, characterize, communicate, and manage risk, in general and for specific applications (the instrumental part). © 2014 Society for Risk Analysis.

Ethical, Scientific, and Educational Concerns With Unproven Medications

PubMed Central

Pray, W. Steven

2006-01-01

Quackery (promotion of products that do not work or have not been proven to work) was once a commonly used term within the pharmacy and medical communities. However, an increasingly anti-scientific national climate culminated in passage of the 1994 Dietary Supplement Health and Education Act, which granted unprecedented legitimacy to “dietary supplements” that had not been scientifically proven to be effective and/or safe. In part, this was facilitated when professional pharmacy magazines and journals published advertisements and articles promoting these unproven medications. Gradually, pharmacy codes of ethics eliminated references to quackery, and some pharmacy organizations seemed to accept the unproven medications they once exhorted the pharmacist not to sell. The profession's shift in attitude toward unproven medications occurred as the medical community at large began to realize the value of evidence-based medicine. Academicians must resist pressure to present unproven therapies as realistic alternatives for medications with scientific proof of safety and efficacy. They must stress the value of evidence-based medicine and urge students and pharmacists to recommend only those medications with evidence-based proof of safety and efficacy. PMID:17332867

Evidence-Based Toxicology.

PubMed

Hoffmann, Sebastian; Hartung, Thomas; Stephens, Martin

Evidence-based toxicology (EBT) was introduced independently by two groups in 2005, in the context of toxicological risk assessment and causation as well as based on parallels between the evaluation of test methods in toxicology and evidence-based assessment of diagnostics tests in medicine. The role model of evidence-based medicine (EBM) motivated both proposals and guided the evolution of EBT, whereas especially systematic reviews and evidence quality assessment attract considerable attention in toxicology.Regarding test assessment, in the search of solutions for various problems related to validation, such as the imperfectness of the reference standard or the challenge to comprehensively evaluate tests, the field of Diagnostic Test Assessment (DTA) was identified as a potential resource. DTA being an EBM discipline, test method assessment/validation therefore became one of the main drivers spurring the development of EBT.In the context of pathway-based toxicology, EBT approaches, given their objectivity, transparency and consistency, have been proposed to be used for carrying out a (retrospective) mechanistic validation.In summary, implementation of more evidence-based approaches may provide the tools necessary to adapt the assessment/validation of toxicological test methods and testing strategies to face the challenges of toxicology in the twenty first century.

Educational Testing and Validity of Conclusions in the Scholarship of Teaching and Learning

PubMed Central

Beltyukova, Svetlana A.; Martin, Beth A.

2013-01-01

Validity and its integral evidence of reliability are fundamentals for educational and psychological measurement, and standards of educational testing. Herein, we describe these standards of educational testing, along with their subtypes including internal consistency, inter-rater reliability, and inter-rater agreement. Next, related issues of measurement error and effect size are discussed. This article concludes with a call for future authors to improve reporting of psychometrics and practical significance with educational testing in the pharmacy education literature. By increasing the scientific rigor of educational research and reporting, the overall quality and meaningfulness of SoTL will be improved. PMID:24249848

A Practical Measure of Student Motivation: Establishing Validity Evidence for the Expectancy-Value-Cost Scale in Middle School

ERIC Educational Resources Information Center

Kosovich, Jeff J.; Hulleman, Chris S.; Barron, Kenneth E.; Getty, Steve

2015-01-01

We present validity evidence for the Expectancy-Value-Cost (EVC) Scale of student motivation. Using a brief, 10-item scale, we measured middle school students' expectancy, value, and cost for their math and science classes in the Fall and Winter of the same academic year. Confirmatory factor analyses supported the three-factor structure of the EVC…

Validation Evidence of the Motivation for Teaching Scale in Secondary Education.

PubMed

Abós, Ángel; Sevil, Javier; Martín-Albo, José; Aibar, Alberto; García-González, Luis

2018-04-10

Grounded in self-determination theory, the aim of this study was to develop a scale with adequate psychometric properties to assess motivation for teaching and to explain some outcomes of secondary education teachers at work. The sample comprised 584 secondary education teachers. Analyses supported the five-factor model (intrinsic motivation, identified regulation, introjected regulation, external regulation and amotivation) and indicated the presence of a continuum of self-determination. Evidence of reliability was provided by Cronbach's alpha, composite reliability and average variance extracted. Multigroup confirmatory factor analyses supported the partial invariance (configural and metric) of the scale in different sub-samples, in terms of gender and type of school. Concurrent validity was analyzed by a structural equation modeling that explained 71% of the work dedication variance and 69% of the boredom at work variance. Work dedication was positively predicted by intrinsic motivation (ß = .56, p < .001) and external regulation (ß = .29, p < .001) and negatively predicted by introjected regulation (ß = -.22, p < .001) and amotivation (ß = -.49, p < .001). Boredom at work was negatively predicted by intrinsic motivation (ß = -.28, p < .005) and positively predicted by amotivation (ß = .68, p < .001). The Motivation for Teaching Scale in Secondary Education (Spanish acronym EME-ES, Escala de Motivación por la Enseñanza en Educación Secundaria) is discussed as a valid and reliable instrument. This is the first specific scale in the work context of secondary teachers that has integrated the five-factor structure together with their dedication and boredom at work.

Scientific Revolutions to the nth power: n = 0, 1, 2, 3.

NASA Astrophysics Data System (ADS)

Beichler, James

2008-04-01

Thomas Kuhn's description and characterization of scientific revolutions set the standard for interpreting and understanding these events, but his characterization introduced an anomaly. Newtonian science was at the pinnacle of its success immediately prior to the Second Scientific Revolution. From an evolutionary point-of-view, there were no crises to be solved just problems within the Newtonian paradigm, whereas the specific crises that initiated the revolution are evident from everyone's point-of-view after the revolution. This paradox is well recognized, but it seems not to be a problem and is just ignored as if it were not important or significant. Yet this discrepancy strikes at the very heart of physics and the overall progress of science. Historical conditions currently parallel the period immediately prior to the Second Scientific Revolution indicating that a new scientific revolution is approaching. When a comparison of the two periods is made, new characteristics of scientific revolutions are identified, the paradox is solved and evidence of a Zeroth Scientific Revolution emerges from the historical record.

Agriscience Student Engagement in Scientific Inquiry: Representations of Scientific Processes and Nature of Science.

PubMed

Grady, Julie R; Dolan, Erin L; Glasson, George E

2010-01-01

Students' experiences with science integrated into agriscience courses contribute to their developing epistemologies of science. The purpose of this case study was to gain insight into the implementation of scientific inquiry in an agriscience classroom. Also of interest was how the tenets of the nature of science were reflected in the students' experiments. Participants included an agriscience teacher and her fifteen students who were conducting plant experiments to gain insight into the role of a gene disabled by scientists. Data sources included classroom observations, conversations with students, face-to-face interviews with the teacher, and students' work. Analysis of the data indicated that the teacher viewed scientific inquiry as a mechanical process with little emphasis on the reasoning that typifies scientific inquiry. Students' participation in their experiments also centered on the procedural aspects of inquiry with little attention to scientific reasoning. There was no explicit attention to the nature of science during the experiments, but the practice implied correct, incorrect, and underdeveloped conceptions of the nature of science. Evidence from the study suggests a need for collaboration between agriscience and science teacher educators to design and conduct professional development focused on scientific inquiry and nature of science for preservice and practicing teachers.

Agriscience Student Engagement in Scientific Inquiry: Representations of Scientific Processes and Nature of Science

PubMed Central

Grady, Julie R.; Dolan, Erin L.; Glasson, George E.

2013-01-01

Students’ experiences with science integrated into agriscience courses contribute to their developing epistemologies of science. The purpose of this case study was to gain insight into the implementation of scientific inquiry in an agriscience classroom. Also of interest was how the tenets of the nature of science were reflected in the students’ experiments. Participants included an agriscience teacher and her fifteen students who were conducting plant experiments to gain insight into the role of a gene disabled by scientists. Data sources included classroom observations, conversations with students, face–to–face interviews with the teacher, and students’ work. Analysis of the data indicated that the teacher viewed scientific inquiry as a mechanical process with little emphasis on the reasoning that typifies scientific inquiry. Students’ participation in their experiments also centered on the procedural aspects of inquiry with little attention to scientific reasoning. There was no explicit attention to the nature of science during the experiments, but the practice implied correct, incorrect, and underdeveloped conceptions of the nature of science. Evidence from the study suggests a need for collaboration between agriscience and science teacher educators to design and conduct professional development focused on scientific inquiry and nature of science for preservice and practicing teachers. PMID:23935256

Plagiarism in Scientific Research and Publications and How to Prevent It

PubMed Central

Masic, Izet

2014-01-01

Quality is assessed on the basis of adequate evidence, while best results of the research are accomplished through scientific knowledge. Information contained in a scientific work must always be based on scientific evidence. Guidelines for genuine scientific research should be designed based on real results. Dynamic research and use correct methods of scientific work must originate from everyday practice and the fundamentals of the research. The original work should have the proper data sources with clearly defined research goals, methods of operation which are acceptable for questions included in the study. When selecting the methods it is necessary to obtain the consent of the patients/respondents to provide data for execution of the project or so called informed consent. Only by the own efforts can be reached true results, from which can be drawn conclusions and which finally can give a valid scholarly commentary. Text may be copied from other sources, either in whole or in part and marked as a result of the other studies. For high-quality scientific work necessary are expertise and relevant scientific literature, mostly taken from publications that are stored in biomedical databases. These are scientific, professional and review articles, case reports of disease in physician practices, but the knowledge can also be acquired on scientific and expert lectures by renowned scientists. Form of text publications must meet standards on writing a paper. If the article has already been published in a scientific journal, the same article cannot be published in any other journal with a few minor adjustments, or without specifying the parts of the first article which is used in another article. Copyright infringement occurs when the author of a new article, with or without mentioning the author, uses a substantial portion of previously published articles, including past contributions in the first article. With the permission of the publisher and the author, another journal

Plagiarism in scientific research and publications and how to prevent it.

PubMed

Masic, Izet

2014-04-01

Quality is assessed on the basis of adequate evidence, while best results of the research are accomplished through scientific knowledge. Information contained in a scientific work must always be based on scientific evidence. Guidelines for genuine scientific research should be designed based on real results. Dynamic research and use correct methods of scientific work must originate from everyday practice and the fundamentals of the research. The original work should have the proper data sources with clearly defined research goals, methods of operation which are acceptable for questions included in the study. When selecting the methods it is necessary to obtain the consent of the patients/respondents to provide data for execution of the project or so called informed consent. Only by the own efforts can be reached true results, from which can be drawn conclusions and which finally can give a valid scholarly commentary. Text may be copied from other sources, either in whole or in part and marked as a result of the other studies. For high-quality scientific work necessary are expertise and relevant scientific literature, mostly taken from publications that are stored in biomedical databases. These are scientific, professional and review articles, case reports of disease in physician practices, but the knowledge can also be acquired on scientific and expert lectures by renowned scientists. Form of text publications must meet standards on writing a paper. If the article has already been published in a scientific journal, the same article cannot be published in any other journal with a few minor adjustments, or without specifying the parts of the first article which is used in another article. Copyright infringement occurs when the author of a new article, with or without mentioning the author, uses a substantial portion of previously published articles, including past contributions in the first article. With the permission of the publisher and the author, another journal

Unscientific beliefs about scientific topics in nutrition.

PubMed

Brown, Andrew W; Ioannidis, John P A; Cope, Mark B; Bier, Dennis M; Allison, David B

2014-09-01

Humans interact with food daily. Such repeated exposure creates a widespread, superficial familiarity with nutrition. Personal familiarity with nutrition from individual and cultural perspectives may give rise to beliefs about food not grounded in scientific evidence. In this summary of the session entitled “Unscientific Beliefs about Scientific Topics in Nutrition,” we discuss accumulated work illustrating and quantifying potentially misleading practices in the conduct and, more so, reporting of nutrition science along with proposed approaches to amelioration. We begin by defining “unscientific beliefs” and from where such beliefs may come, followed by discussing how large bodies of nutritional epidemiologic observations not only create highly improbable patterns of association but implausible magnitudes of implied effect. Poor reporting practices, biases, and methodologic issues that have distorted scientific understandings of nutrition are presented, followed by potential influences of conflicts of interest that extend beyond financial considerations. We conclude with recommendations for improving the conduct, reporting, and communication of nutrition-related research to ground discussions in evidence rather than solely on beliefs.

AIRS Retrieval Validation During the EAQUATE

NASA Technical Reports Server (NTRS)

Zhou, Daniel K.; Smith, William L.; Cuomo, Vincenzo; Taylor, Jonathan P.; Barnet, Christopher D.; DiGirolamo, Paolo; Pappalardo, Gelsomina; Larar, Allen M.; Liu, Xu; Newman, Stuart M.

2006-01-01

Atmospheric and surface thermodynamic parameters retrieved with advanced hyperspectral remote sensors of Earth observing satellites are critical for weather prediction and scientific research. The retrieval algorithms and retrieved parameters from satellite sounders must be validated to demonstrate the capability and accuracy of both observation and data processing systems. The European AQUA Thermodynamic Experiment (EAQUATE) was conducted mainly for validation of the Atmospheric InfraRed Sounder (AIRS) on the AQUA satellite, but also for assessment of validation systems of both ground-based and aircraft-based instruments which will be used for other satellite systems such as the Infrared Atmospheric Sounding Interferometer (IASI) on the European MetOp satellite, the Cross-track Infrared Sounder (CrIS) from the NPOESS Preparatory Project and the following NPOESS series of satellites. Detailed inter-comparisons were conducted and presented using different retrieval methodologies: measurements from airborne ultraspectral Fourier transform spectrometers, aircraft in-situ instruments, dedicated dropsondes and radiosondes, and ground based Raman Lidar, as well as from the European Center for Medium range Weather Forecasting (ECMWF) modeled thermal structures. The results of this study not only illustrate the quality of the measurements and retrieval products but also demonstrate the capability of these validation systems which are put in place to validate current and future hyperspectral sounding instruments and their scientific products.

Historical and cultural aspects of the pineal gland: comparison between the theories provided by Spiritism in the 1940s and the current scientific evidence.

PubMed

Lucchetti, Giancarlo; Daher, Jorge C; Iandoli, Decio; Gonçalves, Juliane P B; Lucchetti, Alessandra L G

2013-01-01

Significance has been attached to the pineal gland in numerous different cultures and beliefs. One religion that has advanced the role of the pineal gland is Spiritism. The objective of the present study was to compile information on the pineal gland drawing on the books of Francisco Cândido Xavier written through psychography and to carry out a critical analysis of their scientific bases by comparing against evidence in the current scientific literature. A systematic search using the terms "pineal gland" and "epiphysis" was conducted of 12 works allegedly dictated by the spirit "André Luiz". All information on the pineal having potential correlation with the field of medicine and current studies was included. Specialists in the area were recruited to compile the information and draw parallels with the scientific literature. The themes related to the pineal gland were: mental health, reproductive function, endocrinology, relationship with physical activity, spiritual connection, criticism of the theory that the organ exerts no function, and description of a hormone secreted by the gland (reference alluding to melatonin, isolated 13 years later). The historical background for each theme was outlined, together with the theories present in the Spiritist books and in the relevant scientific literature. The present article provides an analysis of the knowledge the scientific community can acquire from the history of humanity and from science itself. The process of formulating hypotheses and scientific theories can benefit by drawing on the cultural aspects of civilization, taking into account so-called non-traditional reports and theories.

Definitions and validation criteria for biomarkers and surrogate endpoints: development and testing of a quantitative hierarchical levels of evidence schema.

PubMed

Lassere, Marissa N; Johnson, Kent R; Boers, Maarten; Tugwell, Peter; Brooks, Peter; Simon, Lee; Strand, Vibeke; Conaghan, Philip G; Ostergaard, Mikkel; Maksymowych, Walter P; Landewe, Robert; Bresnihan, Barry; Tak, Paul-Peter; Wakefield, Richard; Mease, Philip; Bingham, Clifton O; Hughes, Michael; Altman, Doug; Buyse, Marc; Galbraith, Sally; Wells, George

2007-03-01

There are clear advantages to using biomarkers and surrogate endpoints, but concerns about clinical and statistical validity and systematic methods to evaluate these aspects hinder their efficient application. Our objective was to review the literature on biomarkers and surrogates to develop a hierarchical schema that systematically evaluates and ranks the surrogacy status of biomarkers and surrogates; and to obtain feedback from stakeholders. After a systematic search of Medline and Embase on biomarkers, surrogate (outcomes, endpoints, markers, indicators), intermediate endpoints, and leading indicators, a quantitative surrogate validation schema was developed and subsequently evaluated at a stakeholder workshop. The search identified several classification schema and definitions. Components of these were incorporated into a new quantitative surrogate validation level of evidence schema that evaluates biomarkers along 4 domains: Target, Study Design, Statistical Strength, and Penalties. Scores derived from 3 domains the Target that the marker is being substituted for, the Design of the (best) evidence, and the Statistical strength are additive. Penalties are then applied if there is serious counterevidence. A total score (0 to 15) determines the level of evidence, with Level 1 the strongest and Level 5 the weakest. It was proposed that the term "surrogate" be restricted to markers attaining Levels 1 or 2 only. Most stakeholders agreed that this operationalization of the National Institutes of Health definitions of biomarker, surrogate endpoint, and clinical endpoint was useful. Further development and application of this schema provides incentives and guidance for effective biomarker and surrogate endpoint research, and more efficient drug discovery, development, and approval.

Students' conceptions of evidence during a university introductory forensic science course

NASA Astrophysics Data System (ADS)

Yeshion, Theodore Elliot

Students' Conceptions of Science, Scientific Evidence, and Forensic Evidence during a University Introductory Forensic Science Course This study was designed to examine and understand what conceptions undergraduate students taking an introductory forensic science course had about scientific evidence. Because the relationships between the nature of science, the nature of evidence, and the nature of forensic evidence are not well understood in the science education literature, this study sought to understand how these concepts interact and affect students' understanding of scientific evidence. Four participants were purposefully selected for this study from among 89 students enrolled in two sections of an introductory forensic science course taught during the fall 2005 semester. Of the 89 students, 84 were criminal justice majors with minimal science background and five were chemistry majors with academic backgrounds in the natural and physical sciences. All 89 students completed a biographical data sheet and a pre-instruction Likert scale survey consisting of twenty questions relating to the nature of scientific evidence. An evaluation of these two documents resulted in a purposeful selection of four varied student participants, each of whom was interviewed three times throughout the semester about the nature of science, the nature of evidence, and the nature of forensic evidence. The same survey was administered to the participants again at the end of the semester-long course. This study examined students' assumptions, prior knowledge, their understanding of scientific inference, scientific theory, and methodology. Examination of the data found few differences with regard to how the criminal justice majors and the chemistry majors responded to interview questions about forensic evidence. There were qualitative differences, however, when the same participants answered interview questions relating to traditional scientific evidence. Furthermore, suggestions are

Science games and the development of scientific possible selves.

PubMed

Beier, Margaret; Miller, Leslie; Wang, Shu

2012-12-01

Serious scientific games, especially those that include a virtual apprenticeship component, provide players with realistic experiences in science. This article discusses how science games can influence learning about science and the development of science-oriented possible selves through repeated practice in professional play and through social influences (e.g., peer groups). We first review the theory of possible selves (Markus and Nurius 1986) and discuss the potential of serious scientific games for influencing the development of scientific possible selves. As part of our review, we present a forensic game that inspired our work. Next we present a measure of scientific possible selves and assess its reliability and validity with a sample of middle-school students (N=374). We conclude by discussing the promise of science games and the development of scientific possible selves on both the individual and group levels as a means of inspiring STEM careers among adolescents.

Science games and the development of scientific possible selves

PubMed Central

Beier, Margaret; Miller, Leslie; Wang, Shu

2012-01-01

Serious scientific games, especially those that include a virtual apprenticeship component, provide players with realistic experiences in science. This article discusses how science games can influence learning about science and the development of science-oriented possible selves through repeated practice in professional play and through social influences (e.g., peer groups). We first review the theory of possible selves (Markus and Nurius 1986) and discuss the potential of serious scientific games for influencing the development of scientific possible selves. As part of our review, we present a forensic game that inspired our work. Next we present a measure of scientific possible selves and assess its reliability and validity with a sample of middle-school students (N=374). We conclude by discussing the promise of science games and the development of scientific possible selves on both the individual and group levels as a means of inspiring STEM careers among adolescents. PMID:23483731

Science games and the development of scientific possible selves

NASA Astrophysics Data System (ADS)

Beier, Margaret E.; Miller, Leslie M.; Wang, Shu

2012-12-01

Serious scientific games, especially those that include a virtual apprenticeship component, provide players with realistic experiences in science. This article discusses how science games can influence learning about science and the development of science-oriented possible selves through repeated practice in professional play and through social influences (e.g., peer groups). We first review the theory of possible selves (Markus and Nurius 1986) and discuss the potential of serious scientific games for influencing the development of scientific possible selves. As part of our review, we present a forensic game that inspired our work. Next we present a measure of scientific possible selves and assess its reliability and validity with a sample of middle-school students ( N = 374). We conclude by discussing the promise of science games and the development of scientific possible selves on both the individual and group levels as a means of inspiring STEM careers among adolescents.

The complementary medicine (CAM) for the treatment of chronic pain: scientific evidence regarding the effects of healing touch massage.

PubMed

Marletta, Giuseppe; Canfora, Angela; Roscani, Francesco; Cernicchiaro, Lucia; Cutrera, Maria; Russo, Marianna; Artioli, Giovanna; Sarli, Leopoldo

2015-09-09

Evidence-based medicine offers effective pathways of pharmacological treatment for chronic pain that may compromise the quality of life of patients; this is one of the main reasons why more and more people resort to traditional and complementary approaches, to try to maintain or regain their health. The effectiveness of the various forms of complementary treatments often cannot be proven objectively, which is why, given the need to find more concrete evidence of the effectiveness of complementary therapies with particular reference to the method of healing touch massage, a review of the literature was conducted in order to gather evidence of the efficacy of the specific method regarding pain and other health outcomes of patients with malignant disease to support a proposal for improvement, based on the practice of healing touch massage conducted by nurses. Systematic review. There are several examples (in some cases specifically regarding patients with tumors) of the positive effects of healing touch massage on pain, anxiety and fatigue, and also on biochemical parameters. The way to full recognition by both the institutional and the scientific community seems to promise fairly well, although it should be noted that the achievement of this goal will require further research avoiding the limitations of previous studies.

Publication pressure and scientific misconduct in medical scientists.

PubMed

Tijdink, Joeri K; Verbeke, Reinout; Smulders, Yvo M

2014-12-01

There is increasing evidence that scientific misconduct is more common than previously thought. Strong emphasis on scientific productivity may increase the sense of publication pressure. We administered a nationwide survey to Flemish biomedical scientists on whether they had engaged in scientific misconduct and whether they had experienced publication pressure. A total of 315 scientists participated in the survey; 15% of the respondents admitted they had fabricated, falsified, plagiarized, or manipulated data in the past 3 years. Fraud was more common among younger scientists working in a university hospital. Furthermore, 72% rated publication pressure as "too high." Publication pressure was strongly and significantly associated with a composite scientific misconduct severity score. © The Author(s) 2014.

Preventive dentistry: practitioners' recommendations for low-risk patients compared with scientific evidence and practice guidelines.

PubMed

Frame, P S; Sawai, R; Bowen, W H; Meyerowitz, C

2000-02-01

and polishing to prevent periodontal disease in low-risk persons. There is no scientific evidence that dental examinations, including scaling and polishing, at 6 month intervals, as recommended by the dentists surveyed in this study, is superior to annual or less frequent examinations for low-risk populations. There is also no evidence that in-office fluoride applications offer incremental benefit over less costly methods of delivering fluoride for low-risk populations.

Network effects on scientific collaborations.

PubMed

Uddin, Shahadat; Hossain, Liaquat; Rasmussen, Kim

2013-01-01

The analysis of co-authorship network aims at exploring the impact of network structure on the outcome of scientific collaborations and research publications. However, little is known about what network properties are associated with authors who have increased number of joint publications and are being cited highly. Measures of social network analysis, for example network centrality and tie strength, have been utilized extensively in current co-authorship literature to explore different behavioural patterns of co-authorship networks. Using three SNA measures (i.e., degree centrality, closeness centrality and betweenness centrality), we explore scientific collaboration networks to understand factors influencing performance (i.e., citation count) and formation (tie strength between authors) of such networks. A citation count is the number of times an article is cited by other articles. We use co-authorship dataset of the research field of 'steel structure' for the year 2005 to 2009. To measure the strength of scientific collaboration between two authors, we consider the number of articles co-authored by them. In this study, we examine how citation count of a scientific publication is influenced by different centrality measures of its co-author(s) in a co-authorship network. We further analyze the impact of the network positions of authors on the strength of their scientific collaborations. We use both correlation and regression methods for data analysis leading to statistical validation. We identify that citation count of a research article is positively correlated with the degree centrality and betweenness centrality values of its co-author(s). Also, we reveal that degree centrality and betweenness centrality values of authors in a co-authorship network are positively correlated with the strength of their scientific collaborations. Authors' network positions in co-authorship networks influence the performance (i.e., citation count) and formation (i.e., tie strength

Network Effects on Scientific Collaborations

PubMed Central

Uddin, Shahadat; Hossain, Liaquat; Rasmussen, Kim

2013-01-01

Background The analysis of co-authorship network aims at exploring the impact of network structure on the outcome of scientific collaborations and research publications. However, little is known about what network properties are associated with authors who have increased number of joint publications and are being cited highly. Methodology/Principal Findings Measures of social network analysis, for example network centrality and tie strength, have been utilized extensively in current co-authorship literature to explore different behavioural patterns of co-authorship networks. Using three SNA measures (i.e., degree centrality, closeness centrality and betweenness centrality), we explore scientific collaboration networks to understand factors influencing performance (i.e., citation count) and formation (tie strength between authors) of such networks. A citation count is the number of times an article is cited by other articles. We use co-authorship dataset of the research field of ‘steel structure’ for the year 2005 to 2009. To measure the strength of scientific collaboration between two authors, we consider the number of articles co-authored by them. In this study, we examine how citation count of a scientific publication is influenced by different centrality measures of its co-author(s) in a co-authorship network. We further analyze the impact of the network positions of authors on the strength of their scientific collaborations. We use both correlation and regression methods for data analysis leading to statistical validation. We identify that citation count of a research article is positively correlated with the degree centrality and betweenness centrality values of its co-author(s). Also, we reveal that degree centrality and betweenness centrality values of authors in a co-authorship network are positively correlated with the strength of their scientific collaborations. Conclusions/Significance Authors’ network positions in co-authorship networks influence

Scientific Reasoning and Epistemological Commitments: Coordination of Theory and Evidence among College Science Students

ERIC Educational Resources Information Center

Zeineddin, Ava; Abd-El-Khalick, Fouad

2010-01-01

Reasoning skills are major contributors to academic and everyday life success. Epistemological commitments (ECs) are believed to underlie reasoning processes and, when considered, could do much in delineating the complex nature of scientific reasoning. This study examined the relationship between ECs and scientific reasoning among college science…

Moderators and Mediators in Social Work Research: Toward a More Ecologically Valid Evidence Base for Practice

PubMed Central

Magill, Molly

2012-01-01

Summary Evidence-based practice involves the consistent and critical consumption of the social work research literature. As methodologies advance, primers to guide such efforts are often needed. In the present work, common statistical methods for testing moderation and mediation are identified, summarized, and corresponding examples, drawn from the substance abuse, domestic violence, and mental health literature, are provided. Findings While methodologically complex, analyses of these third variable effects can provide an optimal fit for the complexity involved in the provision of evidence-based social work services. While a moderator may identify the trait or state requirement for a causal relationship to occur, a mediator is concerned with the transmission of that relationship. In social work practice, these are questions of “under what conditions and for whom?” and of the “how?” of behavior change. Implications Implications include a need for greater attention to these methods among practitioners and evaluation researchers. With knowledge gained through the present review, social workers can benefit from a more ecologically valid evidence base for practice. PMID:22833701

On the incremental validity of irrational beliefs to predict subjective well-being while controlling for personality factors.

PubMed

Spörrle, Matthias; Strobel, Maria; Tumasjan, Andranik

2010-11-01

This research examines the incremental validity of irrational thinking as conceptualized by Albert Ellis to predict diverse aspects of subjective well-being while controlling for the influence of personality factors. Rational-emotive behavior therapy (REBT) argues that irrational beliefs result in maladaptive emotions leading to reduced well-being. Although there is some early scientific evidence for this relation, it has never been investigated whether this connection would still persist when statistically controlling for the Big Five personality factors, which were consistently found to be important determinants of well-being. Regression analyses revealed significant incremental validity of irrationality over personality factors when predicting life satisfaction, but not when predicting subjective happiness. Results are discussed with respect to conceptual differences between these two aspects of subjective well-being.

Medical accuracy in sexuality education: ideology and the scientific process.

PubMed

Santelli, John S

2008-10-01

Recently, many states have implemented requirements for scientific or medical accuracy in sexuality education and HIV prevention programs. Although seemingly uncontroversial, these requirements respond to the increasing injection of ideology into sexuality education, as represented by abstinence-only programs. I describe the process by which health professionals and government advisory groups within the United States reach scientific consensus and review the legal requirements and definitions for medical accuracy. Key elements of this scientific process include the weight of scientific evidence, the importance of scientific theory, peer review, and recognition by mainstream scientific and health organizations. I propose a concise definition of medical accuracy that may be useful to policymakers, health educators, and other health practitioners.

Evidence on existing caries risk assessment systems: are they predictive of future caries?

PubMed

Tellez, M; Gomez, J; Pretty, I; Ellwood, R; Ismail, A I

2013-02-01

To critically appraise evidence for the prediction of caries using four caries risk assessment (CRA) systems/guidelines (Cariogram, Caries Management by Risk Assessment (CAMBRA), American Dental Association (ADA), and American Academy of Pediatric Dentistry (AAPD)). This review focused on prospective cohort studies or randomized controlled trials. A systematic search strategy was developed to locate papers published in Medline Ovid and Cochrane databases. The search identified 539 scientific reports, and after title and abstract review, 137 were selected for full review and 14 met the following inclusion criteria: (i) used as validating criterion caries incidence/increment, (ii) involved human subjects and natural carious lesions, and (iii) published in peer-reviewed journals. In addition, papers were excluded if they met one or more of the following criteria: (i) incomplete description of sample selection, outcomes, or small sample size and (ii) not meeting the criteria for best evidence under the prognosis category of the Oxford Centre for Evidence-Based Medicine. There are wide variations among the systems in terms of definitions of caries risk categories, type and number of risk factors/markers, and disease indicators. The Cariogram combined sensitivity and specificity for predicting caries in permanent dentition ranges from 110 to 139 and is the only system for which prospective studies have been conducted to assess its validity. The Cariogram had limited prediction utility in preschool children, and a moderate to good performance for sorting out elderly individuals into caries risk groups. One retrospective analysis on CAMBRA's CRA reported higher incidence of cavitated lesions among those assessed as extreme-risk patients when compared with those at low risk. The evidence on the validity for existing systems for CRA is limited. It is unknown if the identification of high-risk individuals can lead to more effective long-term patient management that prevents

Conflict of interest, tailored science, and responsibility of scientific institutions and journals.

PubMed

Ruff, Kathleen; Mirabelli, Dario

2014-11-01

Recent revelations have raised concerns on how conflicts of interest may involve even leading scientists and prestigious institutions and lead to bias in reporting and assessing scientific evidence. These have highlighted the need for action to safeguard scientific integrity and public health. The Italian Epidemiology Association has declared that the "biased and deliberately tailored use of the scientific evidence" by scientists with a conflict of interest serves to delay needed measures to prevent harm to public health from a polluting Italian steel plant's continuing chemical emissions. In France, unresolved concerns over conflict of interest forced the Centre for Research in Epidemiology and Public Health to cancel its imminent appointment of a prominent scientist as its Director. These negative events demonstrate the necessity for scientific institutions and journals to implement rigorous measures regarding conflict of interest and the safeguarding of scientific integrity and public health.

Refining animal models in fracture research: seeking consensus in optimising both animal welfare and scientific validity for appropriate biomedical use.

PubMed

Auer, Jorg A; Goodship, Allen; Arnoczky, Steven; Pearce, Simon; Price, Jill; Claes, Lutz; von Rechenberg, Brigitte; Hofmann-Amtenbrinck, Margarethe; Schneider, Erich; Müller-Terpitz, R; Thiele, F; Rippe, Klaus-Peter; Grainger, David W

2007-08-01

In an attempt to establish some consensus on the proper use and design of experimental animal models in musculoskeletal research, AOVET (the veterinary specialty group of the AO Foundation) in concert with the AO Research Institute (ARI), and the European Academy for the Study of Scientific and Technological Advance, convened a group of musculoskeletal researchers, veterinarians, legal experts, and ethicists to discuss, in a frank and open forum, the use of animals in musculoskeletal research. The group narrowed the field to fracture research. The consensus opinion resulting from this workshop can be summarized as follows: Anaesthesia and pain management protocols for research animals should follow standard protocols applied in clinical work for the species involved. This will improve morbidity and mortality outcomes. A database should be established to facilitate selection of anaesthesia and pain management protocols for specific experimental surgical procedures and adopted as an International Standard (IS) according to animal species selected. A list of 10 golden rules and requirements for conduction of animal experiments in musculoskeletal research was drawn up comprising 1) Intelligent study designs to receive appropriate answers; 2) Minimal complication rates (5 to max. 10%); 3) Defined end-points for both welfare and scientific outputs analogous to quality assessment (QA) audit of protocols in GLP studies; 4) Sufficient details for materials and methods applied; 5) Potentially confounding variables (genetic background, seasonal, hormonal, size, histological, and biomechanical differences); 6) Post-operative management with emphasis on analgesia and follow-up examinations; 7) Study protocols to satisfy criteria established for a "justified animal study"; 8) Surgical expertise to conduct surgery on animals; 9) Pilot studies as a critical part of model validation and powering of the definitive study design; 10) Criteria for funding agencies to include

Refining animal models in fracture research: seeking consensus in optimising both animal welfare and scientific validity for appropriate biomedical use

PubMed Central

Auer, Jorg A; Goodship, Allen; Arnoczky, Steven; Pearce, Simon; Price, Jill; Claes, Lutz; von Rechenberg, Brigitte; Hofmann-Amtenbrinck, Margarethe; Schneider, Erich; Müller-Terpitz, R; Thiele, F; Rippe, Klaus-Peter; Grainger, David W

2007-01-01

Background In an attempt to establish some consensus on the proper use and design of experimental animal models in musculoskeletal research, AOVET (the veterinary specialty group of the AO Foundation) in concert with the AO Research Institute (ARI), and the European Academy for the Study of Scientific and Technological Advance, convened a group of musculoskeletal researchers, veterinarians, legal experts, and ethicists to discuss, in a frank and open forum, the use of animals in musculoskeletal research. Methods The group narrowed the field to fracture research. The consensus opinion resulting from this workshop can be summarized as follows: Results & Conclusion Anaesthesia and pain management protocols for research animals should follow standard protocols applied in clinical work for the species involved. This will improve morbidity and mortality outcomes. A database should be established to facilitate selection of anaesthesia and pain management protocols for specific experimental surgical procedures and adopted as an International Standard (IS) according to animal species selected. A list of 10 golden rules and requirements for conduction of animal experiments in musculoskeletal research was drawn up comprising 1) Intelligent study designs to receive appropriate answers; 2) Minimal complication rates (5 to max. 10%); 3) Defined end-points for both welfare and scientific outputs analogous to quality assessment (QA) audit of protocols in GLP studies; 4) Sufficient details for materials and methods applied; 5) Potentially confounding variables (genetic background, seasonal, hormonal, size, histological, and biomechanical differences); 6) Post-operative management with emphasis on analgesia and follow-up examinations; 7) Study protocols to satisfy criteria established for a "justified animal study"; 8) Surgical expertise to conduct surgery on animals; 9) Pilot studies as a critical part of model validation and powering of the definitive study design; 10) Criteria

Scientific Reasoning Abilities in Kindergarten: Dynamic Assessment of the Control of Variables Strategy

ERIC Educational Resources Information Center

van der Graaf, Joep; Segers, Eliane; Verhoeven, Ludo

2015-01-01

A dynamic assessment tool was developed and validated using Mokken scale analysis to assess the extent to which kindergartners are able to construct unconfounded experiments, an essential part of scientific reasoning. Scientific reasoning is one of the learning processes happening within science education. A commonly used, hands-on,…

Overview of SCIAMACHY validation: 2002 2004

NASA Astrophysics Data System (ADS)

Piters, A. J. M.; Bramstedt, K.; Lambert, J.-C.; Kirchhoff, B.

2005-08-01

SCIAMACHY, on board Envisat, is now in operation for almost three years. This UV/visible/NIR spectrometer measures the solar irradiance, the earthshine radiance scattered at nadir and from the limb, and the attenuation of solar radiation by the atmosphere during sunrise and sunset, from 240 to 2380 nm and at moderate spectral resolution. Vertical columns and profiles of a variety of atmospheric constituents are inferred from the SCIAMACHY radiometric measurements by dedicated retrieval algorithms. With the support of ESA and several international partners, a methodical SCIAMACHY validation programme has been developed jointly by Germany, the Netherlands and Belgium (the three instrument providing countries) to face complex requirements in terms of measured species, altitude range, spatial and temporal scales, geophysical states and intended scientific applications. This summary paper describes the approach adopted to address those requirements. The actual validation of the operational SCIAMACHY processors established at DLR on behalf of ESA has been hampered by data distribution and processor problems. Since first data releases in summer 2002, operational processors were upgraded regularly and some data products - level-1b spectra, level-2 O3, NO2, BrO and clouds data - have improved significantly. Validation results summarised in this paper conclude that for limited periods and geographical domains they can already be used for atmospheric research. Nevertheless, remaining processor problems cause major errors preventing from scientific usability in other periods and domains. Untied to the constraints of operational processing, seven scientific institutes (BIRA-IASB, IFE, IUP-Heidelberg, KNMI, MPI, SAO and SRON) have developed their own retrieval algorithms and generated SCIAMACHY data products, together addressing nearly all targeted constituents. Most of the UV-visible data products (both columns and profiles) already have acceptable, if not excellent, quality

Initial construct validity evidence of a virtual human application for competency assessment in breaking bad news to a cancer patient.

PubMed

Guetterman, Timothy C; Kron, Frederick W; Campbell, Toby C; Scerbo, Mark W; Zelenski, Amy B; Cleary, James F; Fetters, Michael D

2017-01-01

Despite interest in using virtual humans (VHs) for assessing health care communication, evidence of validity is limited. We evaluated the validity of a VH application, MPathic-VR, for assessing performance-based competence in breaking bad news (BBN) to a VH patient. We used a two-group quasi-experimental design, with residents participating in a 3-hour seminar on BBN. Group A (n=15) completed the VH simulation before and after the seminar, and Group B (n=12) completed the VH simulation only after the BBN seminar to avoid the possibility that testing alone affected performance. Pre- and postseminar differences for Group A were analyzed with a paired t -test, and comparisons between Groups A and B were analyzed with an independent t -test. Compared to the preseminar result, Group A's postseminar scores improved significantly, indicating that the VH program was sensitive to differences in assessing performance-based competence in BBN. Postseminar scores of Group A and Group B were not significantly different, indicating that both groups performed similarly on the VH program. Improved pre-post scores demonstrate acquisition of skills in BBN to a VH patient. Pretest sensitization did not appear to influence posttest assessment. These results provide initial construct validity evidence that the VH program is effective for assessing BBN performance-based communication competence.

Predicting future discoveries from current scientific literature.

PubMed

Petrič, Ingrid; Cestnik, Bojan

2014-01-01

Knowledge discovery in biomedicine is a time-consuming process starting from the basic research, through preclinical testing, towards possible clinical applications. Crossing of conceptual boundaries is often needed for groundbreaking biomedical research that generates highly inventive discoveries. We demonstrate the ability of a creative literature mining method to advance valuable new discoveries based on rare ideas from existing literature. When emerging ideas from scientific literature are put together as fragments of knowledge in a systematic way, they may lead to original, sometimes surprising, research findings. If enough scientific evidence is already published for the association of such findings, they can be considered as scientific hypotheses. In this chapter, we describe a method for the computer-aided generation of such hypotheses based on the existing scientific literature. Our literature-based discovery of NF-kappaB with its possible connections to autism was recently approved by scientific community, which confirms the ability of our literature mining methodology to accelerate future discoveries based on rare ideas from existing literature.

The influence of weight-of-evidence strategies on audience perceptions of (un)certainty when media cover contested science.

PubMed

Kohl, Patrice Ann; Kim, Soo Yun; Peng, Yilang; Akin, Heather; Koh, Eun Jeong; Howell, Allison; Dunwoody, Sharon

2016-11-01

Controversy in science news accounts attracts audiences and draws attention to important science issues. But sometimes covering multiple sides of a science issue does the audience a disservice. Counterbalancing a truth claim backed by strong scientific support with a poorly backed argument can unnecessarily heighten audience perceptions of uncertainty. At the same time, journalistic norms often constrain reporters to "get both sides of the story" even when there is little debate in the scientific community about which truth claim is most valid. In this study, we look at whether highlighting the way in which experts are arrayed across truth claims-a strategy we label "weight-of-evidence reporting"-can attenuate heightened perceptions of uncertainty that can result from coverage of conflicting claims. The results of our study suggest weight-of-evidence strategies can indeed play a role in reducing some of the uncertainty audiences may perceive when encountering lop-sided truth claims. © The Author(s) 2015.