Enhancing patient autonomy through peer review to replace the FDA's rigorous approval process.

PubMed

Caplan, Arthur

2012-10-01

There may once have been a time when doctors unquestioningly accepted the government's declaration of a drug's effectiveness and when patients unquestioningly accepted the prescriptions of their doctors. That time has passed. Now, information--good and bad--showers from all directions on patients and physicians alike. A filter is needed, and peer review provides the best one. But who or what is this validated information for? Ethically, its primary purpose is to enable patients to make decisions consistent with their values. Providing vetted information in a form that is useful to patients requires an emphasis on comprehensible, comprehensive, trustworthy, verifiable, and transparent communication. The hypothetical comparative effectiveness case study in this month's Health Affairs does not appear to rise to the level that would be helpful to providers or patients.

Collegiate Aviation Review 1998.

ERIC Educational Resources Information Center

Carney, Thomas Q., Ed.; Luedtke, Jacqueline R., Ed.; Johnson, Jeffrey A., Ed.

1998-01-01

This document contains four peer-reviewed papers about university-level aviation education that were presented at the 1998 Fall Education Conference of the University Aviation Association. "Setting the Foundation for Effective Learning: Utilizing the Cognitive, Affective, and Psychomotor Domains to Establish Rigorous Performance Learning…

Review and Synthesize Completed Research Through Systematic Review.

PubMed

Hopp, Lisa; Rittenmeyer, Leslie

2015-10-01

The evidence-based health care movement has generated new opportunity for scholars to generate synthesized sources of evidence. Systematic reviews are rigorous forms of synthesized evidence that scholars can conduct if they have requisite skills, time, and access to excellent library resources. Systematic reviews play an important role in synthesizing what is known and unknown about a particular health issue. Thus, they have a synergistic relationship with primary research. They can both inform clinical decisions when the evidence is adequate and identify gaps in knowledge to inform research priorities. Systematic reviews can be conducted of quantitative and qualitative evidence to answer many types of questions. They all share characteristics of rigor that arise from a priori protocol development, transparency, exhaustive searching, dual independent reviewers who critically appraise studies using standardized tools, rigor in synthesis, and peer review at multiple stages in the conduct and reporting of the systematic review. © The Author(s) 2015.

Graphical Descriptives: A Way to Improve Data Transparency and Methodological Rigor in Psychology.

PubMed

Tay, Louis; Parrigon, Scott; Huang, Qiming; LeBreton, James M

2016-09-01

Several calls have recently been issued to the social sciences for enhanced transparency of research processes and enhanced rigor in the methodological treatment of data and data analytics. We propose the use of graphical descriptives (GDs) as one mechanism for responding to both of these calls. GDs provide a way to visually examine data. They serve as quick and efficient tools for checking data distributions, variable relations, and the potential appropriateness of different statistical analyses (e.g., do data meet the minimum assumptions for a particular analytic method). Consequently, we believe that GDs can promote increased transparency in the journal review process, encourage best practices for data analysis, and promote a more inductive approach to understanding psychological data. We illustrate the value of potentially including GDs as a step in the peer-review process and provide a user-friendly online resource (www.graphicaldescriptives.org) for researchers interested in including data visualizations in their research. We conclude with suggestions on how GDs can be expanded and developed to enhance transparency. © The Author(s) 2016.

Interventions for Toddlers with Autism Spectrum Disorders: An Evaluation of Research Evidence

ERIC Educational Resources Information Center

Schertz, Hannah H.; Reichow, Brian; Tan, Paulo; Vaiouli, Potheini; Yildirim, Emine

2012-01-01

Recently emerging intervention studies for toddlers with autism spectrum disorders (ASD) were reviewed through a systematic assessment of intervention outcomes, research rigor, and intervention features. The review includes published peer-reviewed experimental studies of toddlers with high risk for or diagnosis of ASD in which the majority of…

Conflicts of interest in medical science: peer usage, peer review and 'CoI consultancy'.

PubMed

Charlton, Bruce G

2004-01-01

In recent years, the perception has grown that conflicts of interest are having a detrimental effect on medical science as it influences health policy and clinical practice, leading medical journals to enforce self-declaration of potential biases in the attempt to counteract or compensate for the problem. Conflict of interest (CoI) declarations have traditionally been considered inappropriate in pure science since its evaluation systems themselves constitute a mechanism for eliminating the effect of individual biases. Pure science is primarily evaluated by 'peer usage', in which scientific information is 'replicated' by being incorporated in the work of other scientists, and tested by further observation of the natural world. Over the long-term, the process works because significant biases impair the quality of science, and bad science tends to be neglected or refuted. However, scientific evaluation operates slowly over years and decades, and only a small proportion of published work is ever actually evaluated. But most of modern medical science no longer conforms to the model of pure science, and may instead be conceptualized as a system of 'applied' science having different aims and evaluation processes. The aim of applied medical science is to solve pre-specified problems, and to provide scientific information ready for implementation immediately following publication. The primary evaluation process of applied science is peer review, not peer usage. Peer review is much more rapid (with a timescale of weeks or months) and cheaper than peer usage and (consequently) has a much wider application: peer review is a prospective validation while peer usage is retrospective. Since applied science consists of incremental advances on existing knowledge achieved using established techniques, its results can usually be reliably evaluated by peer review. However, despite its considerable convenience, peer review has significant limitations related to its reliance on opinion. One major limitation of peer review has proved to be its inability to deal with conflicts of interest, especially in a 'big science' context when prestigious scientists may have similar biases, and conflicts of interest are widely shared among peer reviewers. When applied medical science has been later checked against the slower but more valid processes of peer usage, it seems that reliance on peer review may allow damaging distortions to become 'locked-in' to clinical practice and health policy for considerable periods. Scientific progress is generally underpinned by increasing specialization. Medical journals should specialize in the communication of scientific information, and they have neither the resources nor the motivation to investigate and measure conflicts of interest. Effectively dealing with the problem of conflicts of interest in applied medical science firstly requires a more explicit demarcation between the communications media of pure medical science and applied medical science. Greater specialization of these activities would then allow distinctive aims and evaluation systems to evolve with the expectation of improved performance in both pure and applied systems. In future, applied medical science should operate with an assumption of bias, with the onus of proof on applied medical scientists to facilitate the 'data transparency' necessary to validate their research. Journals of applied medical science will probably require more rigorous processes of peer review than at present, since their publications are intended to be ready for implementation. But since peer review does not adequately filter-out conflicts of interest in applied medical science, there is a need for the evolution of specialist post-publication institutional mechanisms. The suggested solution is to encourage the establishment of independent 'CoI consultancy' services, whose role would be to evaluate conflicts of interest and other biases in published applied medical science prior to their implementation. Such services would be paid-for by the groups who intend to implement applied medical research.

Peer-reviewed and unbiased research, rather than ‘sound science’, should be used to evaluate endocrine-disrupting chemicals

PubMed Central

Trasande, Leonardo; Vandenberg, Laura N; Bourguignon, Jean-Pierre; Myers, John Peterson; Slama, Remy; Saal, Frederick vom; Zoeller, Robert Thomas

2017-01-01

Evidence increasingly confirms that synthetic chemicals disrupt the endocrine system and contribute to disease and disability across the lifespan. Despite a United Nations Environment Programme/WHO report affirmed by over 100 countries at the Fourth International Conference on Chemicals Management, ‘manufactured doubt’ continues to be cast as a cloud over rigorous, peer-reviewed and independently funded scientific data. This study describes the sources of doubt and their social costs, and suggested courses of action by policymakers to prevent disease and disability. The problem is largely based on the available data, which are all too limited. Rigorous testing programmes should not simply focus on oestrogen, androgen and thyroid. Tests should have proper statistical power. ‘Good laboratory practice’ (GLP) hardly represents a proper or even gold standard for laboratory studies of endocrine disruption. Studies should be evaluated with regard to the contamination of negative controls, responsiveness to positive controls and dissection techniques. Flaws in many GLP studies have been identified, yet regulatory agencies rely on these flawed studies. Peer-reviewed and unbiased research, rather than ‘sound science’, should be used to evaluate endocrine-disrupting chemicals. PMID:27417427

The Development and Implementation of a Peer-Led Intervention to Prevent Smoking among Secondary School Students Using Their Established Social Networks

ERIC Educational Resources Information Center

Audrey, Suzanne; Cordall, Kathleen; Moore, Laurence; Cohen, David; Campbell, Rona

2004-01-01

Objective: To design, implement and evaluate a peer-led intervention to reduce smoking amongst secondary school students. Design: A health promotion intervention combining peer education with diffusion of innovation theory, to be rigorously evaluated by means of a cluster randomised controlled trial with concurrent process and economic…

Editorial: Special Issue on Experimental Vibration Analysis

NASA Astrophysics Data System (ADS)

Serra, Roger

2018-04-01

The vibratory analyses are particularly present today in the various fields of industry, from aeronautics to manufacturing, from machining and maintenance to civil engineering, to mention a few areas, which have made this special issue a true need. The International Journal of Mechanics & Industry compiles a Special Issue on Experimental Vibration Analysis. More than thirty manuscripts were received by the international scientific committee on the 6th congress AVE2016 and only eight papers have been selected after completing a careful and rigorous peer-review process for the Special Issue, which are briefly summarized below.

The difficulties of systematic reviews.

PubMed

Westgate, Martin J; Lindenmayer, David B

2017-10-01

The need for robust evidence to support conservation actions has driven the adoption of systematic approaches to research synthesis in ecology. However, applying systematic review to complex or open questions remains challenging, and this task is becoming more difficult as the quantity of scientific literature increases. We drew on the science of linguistics for guidance as to why the process of identifying and sorting information during systematic review remains so labor intensive, and to provide potential solutions. Several linguistic properties of peer-reviewed corpora-including nonrandom selection of review topics, small-world properties of semantic networks, and spatiotemporal variation in word meaning-greatly increase the effort needed to complete the systematic review process. Conversely, the resolution of these semantic complexities is a common motivation for narrative reviews, but this process is rarely enacted with the rigor applied during linguistic analysis. Therefore, linguistics provides a unifying framework for understanding some key challenges of systematic review and highlights 2 useful directions for future research. First, in cases where semantic complexity generates barriers to synthesis, ecologists should consider drawing on existing methods-such as natural language processing or the construction of research thesauri and ontologies-that provide tools for mapping and resolving that complexity. These tools could help individual researchers classify research material in a more robust manner and provide valuable guidance for future researchers on that topic. Second, a linguistic perspective highlights that scientific writing is a rich resource worthy of detailed study, an observation that can sometimes be lost during the search for data during systematic review or meta-analysis. For example, mapping semantic networks can reveal redundancy and complementarity among scientific concepts, leading to new insights and research questions. Consequently, wider adoption of linguistic approaches may facilitate improved rigor and richness in research synthesis. © 2017 Society for Conservation Biology.

Biomedical journal speed and efficiency: a cross-sectional pilot survey of author experiences.

PubMed

Wallach, Joshua D; Egilman, Alexander C; Gopal, Anand D; Swami, Nishwant; Krumholz, Harlan M; Ross, Joseph S

2018-01-01

Although the peer review process is believed to ensure scientific rigor, enhance research quality, and improve manuscript clarity, many investigators are concerned that the process is too slow, too expensive, too unreliable, and too static. In this feasibility study, we sought to survey corresponding authors of recently published clinical research studies on the speed and efficiency of the publication process. Web-based survey of corresponding authors of a 20% random sample of clinical research studies in MEDLINE-indexed journals with Ovid MEDLINE entry dates between December 1 and 15, 2016. Survey addressed perceived manuscript importance before first submission, approximate first submission and final acceptance dates, and total number of journal submissions, external peer reviews, external peer reviewers, and revisions requested, as well as whether authors would have considered publicly sharing their manuscript on an online platform instead of submitting to a peer-reviewed journal. Of 1780 surveys distributed, 27 corresponding authors opted out or requested that we stop emailing them and 149 emails failed (e.g., emails that bounced n  = 64, returned with an away from office message n  = 70, or were changed/incorrect n  = 15), leaving 1604 respondents, of which 337 completed the survey (21.0%). Respondents and non-respondents were similar with respect to study type and publication journals' impact factor, although non-respondent authors had more publications ( p  = 0.03). Among respondents, the median impact factor of the publications' journal was 2.7 (interquartile range (IQR), 2.0-3.6) and corresponding authors' median h-index and number of publications was 9 (IQR, 3-20) and 27 (IQR, 10-77), respectively. The median time from first submission to journal acceptance and publication was 5 months (IQR, 3-8) and 7 months (IQR, 5-12), respectively. Most respondents (62.0%, n  = 209) rated the importance of their research as a 4 or 5 (5-point scale) prior to submission. Median number of journal submissions was 1 (IQR, 1-2), external peer reviews was 1 (IQR, 1-2), external peer reviewers was 3 (IQR, 2-4), and revisions requested was 1 (IQR, 1-1). Sharing manuscripts to a public online platform, instead of submitting to a peer-reviewed journal, would have been considered by 55.2% ( n  = 186) of respondents. Corresponding authors have high perceptions of their research and reported requiring few manuscript submissions prior to journal acceptance, most commonly by lower impact factor journals.

Peer-reviewed and unbiased research, rather than 'sound science', should be used to evaluate endocrine-disrupting chemicals.

PubMed

Trasande, Leonardo; Vandenberg, Laura N; Bourguignon, Jean-Pierre; Myers, John Peterson; Slama, Remy; Vom Saal, Frederick; Zoeller, Robert Thomas

2016-11-01

Evidence increasingly confirms that synthetic chemicals disrupt the endocrine system and contribute to disease and disability across the lifespan. Despite a United Nations Environment Programme/WHO report affirmed by over 100 countries at the Fourth International Conference on Chemicals Management, 'manufactured doubt' continues to be cast as a cloud over rigorous, peer-reviewed and independently funded scientific data. This study describes the sources of doubt and their social costs, and suggested courses of action by policymakers to prevent disease and disability. The problem is largely based on the available data, which are all too limited. Rigorous testing programmes should not simply focus on oestrogen, androgen and thyroid. Tests should have proper statistical power. 'Good laboratory practice' (GLP) hardly represents a proper or even gold standard for laboratory studies of endocrine disruption. Studies should be evaluated with regard to the contamination of negative controls, responsiveness to positive controls and dissection techniques. Flaws in many GLP studies have been identified, yet regulatory agencies rely on these flawed studies. Peer-reviewed and unbiased research, rather than 'sound science', should be used to evaluate endocrine-disrupting chemicals. Published by the BMJ Publishing Group Limited. For permission to use (where not already granted under a licence) please go to http://www.bmj.com/company/products-services/rights-and-licensing/.

Subspecialty Influence on Scientific Peer Review for an Obstetrics and Gynecology Journal With a High Impact Factor.

PubMed

Parikh, Laura I; Benner, Rebecca S; Riggs, Thomas W; Hazen, Nicholas; Chescheir, Nancy C

2017-02-01

To evaluate whether quality of peer review and reviewer recommendation differ based on reviewer subspecialty in obstetrics and gynecology and to determine the role of experience on reviewer recommendation. We performed a retrospective cohort study of reviews submitted to Obstetrics & Gynecology between January 2010 and December 2014. Subspecialties were determined based on classification terms selected by each reviewer and included all major obstetrics and gynecology subspecialties, general obstetrics and gynecology, and nonobstetrics and gynecology categories. Review quality (graded on a 5-point Likert scale by the journal's editors) and reviewer recommendation of "reject" were compared across subspecialties using χ, analysis of variance, and multivariate logistic regression. There were 20,027 reviews from 1,889 individual reviewers. Reviewers with family planning subspecialty provided higher-quality peer reviews compared with reviewers with gynecology only, reproductive endocrinology and infertility, gynecologic oncology, and general obstetrics and gynecology specialties (3.61±0.75 compared with 3.44±0.78, 3.42±0.72, 3.35±0.75, and 3.32±0.81, respectively, P<.05). Reviewers with gynecology-only subspecialty recommended rejection more often compared with reviewers with a nonobstetrics and gynecology subspecialty (57.7% compared with 38.7%, P<.05). Editorial Board members recommended rejection more often than new reviewers (68.0% compared with 41.5%, P<.05). Increased adjusted odds of manuscript rejection recommendation were associated with reproductive endocrinology, female pelvic medicine and reconstructive surgery, and gynecology-only reviewer subspecialty (adjusted odds ratio [OR] 1.23 [1.07-1.41], 1.21 [1.05-1.39], and 1.11 [1.02-1.20]). Manuscript rejection recommendation rate was also increased for reviewers who had completed the highest quintile of peer reviews (greater than 195) compared with the lowest quintile (one to seven) (adjusted OR 2.85 [2.60-3.12]). Peer review quality differs based on obstetrics and gynecology subspecialty. Obstetrics and gynecology subspecialty and reviewer experience have implications for manuscript rejection recommendation. Reviewer assignment is pivotal to maintaining a rigorous manuscript selection process.

Rigor, Transparency, and Reporting Social Science Research: Why Guidelines Don't Have to Kill Your Story

ERIC Educational Resources Information Center

Wharton, Tracy

2017-01-01

Dissemination of research is the most challenging aspect of building the evidence base. Despite peer review, evidence suggests that a substantial proportion of papers leave out details that are necessary to judge bias, consider replication, or initiate meta-analyses and systematic reviews. Reporting guidelines were created to ensure minimally…

Health promotion in small business: a systematic review of factors influencing adoption and effectiveness of worksite wellness programs.

PubMed

McCoy, Kira; Stinson, Kaylan; Scott, Kenneth; Tenney, Liliana; Newman, Lee S

2014-06-01

To assess the evidence regarding the adoption and efficacy of worksite health promotion programs (WHPPs) in small businesses. Peer-reviewed research articles were identified from a database search. Included articles were published before July 2013, described a study that used an experimental or quasiexperimental design and either assessed adoption of WHPPs or conducted interventions in businesses with fewer than 500 employees. A review team scored the study's rigor using the WHO-adapted GRADEprofiler "quality of evidence" criteria. Of the 84 retrieved articles, 19 met study inclusion criteria. Of these, only two met criteria for high rigor. Fewer small businesses adopt WHPPs compared with large businesses. Two high-rigor studies found that employees were healthier postintervention. Higher quality research is needed to better understand why small businesses rarely adopt wellness programs and to demonstrate the value of such programs.

NASA Product Peer Review Process

NASA Technical Reports Server (NTRS)

Jenks, Ken

2009-01-01

This viewgraph presentation describes NASA's product peer review process. The contents include: 1) Inspection/Peer Review at NASA; 2) Reasons for product peer reviews; 3) Different types of peer reviews; and 4) NASA requirements for peer reviews. This presentation also includes a demonstration of an actual product peer review.

Wildlife conservation and solar energy development in the Desert Southwest, United States

USGS Publications Warehouse

Lovich, Jeffrey E.; Ennen, Josua R.

2011-01-01

Large areas of public land are currently being permitted or evaluated for utility-scale solar energy development (USSED) in the southwestern United States, including areas with high biodiversity and protected species. However, peer-reviewed studies of the effects of USSED on wildlife are lacking. The potential effects of the construction and the eventual decommissioning of solar energy facilities include the direct mortality of wildlife; environmental impacts of fugitive dust and dust suppressants; destruction and modification of habitat, including the impacts of roads; and off-site impacts related to construction material acquisition, processing, and transportation. The potential effects of the operation and maintenance of the facilities include habitat fragmentation and barriers to gene flow, increased noise, electromagnetic field generation, microclimate alteration, pollution, water consumption, and fire. Facility design effects, the efficacy of site-selection criteria, and the cumulative effects of USSED on regional wildlife populations are unknown. Currently available peer-reviewed data are insufficient to allow a rigorous assessment of the impact of USSED on wildlife.

28 CFR 34.102 - Peer review procedures.

Code of Federal Regulations, 2010 CFR

2010-07-01

...” describes a process that evolves in accordance with experience and opportunities to effect improvements. The... Review § 34.102 Peer review procedures. The OJJDP peer review process is contained in an OJJDP “Peer... substantive and procedural matters related to the peer review process, the “Guideline” addresses such issues...

Demystifying the peer-review process - workshop

EPA Science Inventory

Scientific writing and peer-review are integral parts of the publishing process. This workshop aims to demystify the peer-review process for early career scientists and provide insightful tips for streamlining the submission and peer review process for all researchers. Providing ...

Health Promotion in Small Business

PubMed Central

McCoy, Kira; Stinson, Kaylan; Scott, Kenneth; Tenney, Liliana; Newman, Lee S.

2015-01-01

Objective To assess the evidence regarding the adoption and efficacy of worksite health promotion programs (WHPPs) in small businesses. Methods Peer-reviewed research articles were identified from a database search. Included articles were published before July 2013, described a study that used an experimental or quasiexperimental design and either assessed adoption of WHPPs or conducted interventions in businesses with fewer than 500 employees. A review team scored the study’s rigor using the WHO-adapted GRADEprofiler “quality of evidence” criteria. Results Of the 84 retrieved articles, 19 met study inclusion criteria. Of these, only two met criteria for high rigor. Conclusions Fewer small businesses adopt WHPPs compared with large businesses. Two high-rigor studies found that employees were healthier postintervention. Higher quality research is needed to better understand why small businesses rarely adopt wellness programs and to demonstrate the value of such programs. PMID:24905421

The Independent Technical Analysis Process

DOE Office of Scientific and Technical Information (OSTI.GOV)

Duberstein, Corey A.; Ham, Kenneth D.; Dauble, Dennis D.

2007-04-13

The Bonneville Power Administration (BPA) contracted with the Pacific Northwest National Laboratory (PNNL) to provide technical analytical support for system-wide fish passage information (BPA Project No. 2006-010-00). The goal of this project was to produce rigorous technical analysis products using independent analysts and anonymous peer reviewers. In the past, regional parties have interacted with a single entity, the Fish Passage Center to access the data, analyses, and coordination related to fish passage. This project provided an independent technical source for non-routine fish passage analyses while allowing routine support functions to be performed by other well-qualified entities.

The Independent Technical Analysis Process Final Report 2006-2007.

DOE Office of Scientific and Technical Information (OSTI.GOV)

Duberstein, Corey; Ham, Kenneth; Dauble, Dennis

2007-03-01

The Bonneville Power Administration (BPA) contracted with the Pacific Northwest National Laboratory (PNNL) to provide technical analytical support for system-wide fish passage information (BPA Project No. 2006-010-00). The goal of this project was to produce rigorous technical analysis products using independent analysts and anonymous peer reviewers. This project provided an independent technical source for non-routine fish passage analyses while allowing routine support functions to be performed by other well-qualified entities. The Independent Technical Analysis Process (ITAP) was created to provide non-routine analysis for fish and wildlife agencies and tribes in particular and the public in general on matters related tomore » juvenile and adult salmon and steelhead passage through the mainstem hydrosystem. The process was designed to maintain the independence of analysts and reviewers from parties requesting analyses, to avoid potential bias in technical products. The objectives identified for this project were to administer a rigorous, transparent process to deliver unbiased technical assistance necessary to coordinate recommendations for storage reservoir and river operations that avoid potential conflicts between anadromous and resident fish. Seven work elements, designated by numbered categories in the Pisces project tracking system, were created to define and accomplish project goals as follows: (1) 118 Coordination - Coordinate technical analysis and review process: (a) Retain expertise for analyst/reviewer roles. (b) Draft research directives. (c) Send directive to the analyst. (d) Coordinate two independent reviews of the draft report. (e) Ensure reviewer comments are addressed within the final report. (2) 162 Analyze/Interpret Data - Implement the independent aspects of the project. (3) 122 Provide Technical Review - Implement the review process for the analysts. (4) 132 Produce Annual Report - FY06 annual progress report with Pisces Disseminate (5) 161 Disseminate Raw/Summary Data and Results - Post technical products on the ITAP web site. (6) 185-Produce Pisces Status Report - Provide periodic status reports to BPA. (7) 119 Manage and Administer Projects - project/contract administration.« less

Peer-Mediated Theatrical Engagement for Improving Reciprocal Social Interaction in Autism Spectrum Disorder

PubMed Central

Corbett, Blythe A.; Qualls, Lydia R.; Valencia, Blythe; Fecteau, Stéphanie-M.; Swain, Deanna M.

2014-01-01

The hallmark characteristic of autism spectrum disorder (ASD) is poor reciprocal social communication. Interventions designed to improve this core deficit are critically needed. Social skills interventions such as direct training, peer mediation, and video modeling have contributed to improvements in various social skills in children with ASD. This paper reviews existing social competence interventions available for children with ASD while highlighting hypothesized critical components for advancing, maintaining, and generalizing skills, which include (1) peer mediation, (2) active learning, and (3) implementation in supportive, natural contexts. As a framework for these approaches, this conceptual paper describes SENSE Theatre, a novel intervention that combines trained peers that facilitate the performance-based theatrical treatment delivered in a supportive, community-based environment. A review of previous research shows early feasibility, setting the stage for more rigorous studies to aid in developing a standardized intervention package. PMID:25346926

34 CFR 350.50 - What is the peer review process for this Program?

Code of Federal Regulations, 2010 CFR

2010-07-01

... 34 Education 2 2010-07-01 2010-07-01 false What is the peer review process for this Program? 350... peer review process for this Program? (a) The Secretary refers each application for a grant governed by those regulations in this part to a peer review panel established by the Secretary. (b) Peer review...

Protecting the pipeline of science: openness, scientific methods and the lessons from ticagrelor and the PLATO trial.

PubMed

Coats, Andrew J Stewart; Nijjer, Sukhjinder S; Francis, Darrel P

2014-10-20

Ticagrelor, a potent antiplatelet, has been shown to be beneficial in patients with acute coronary syndromes in a randomised controlled trial published in a highly ranked peer reviewed journal. Accordingly it has entered guidelines and has been approved for clinical use by authorities. However, there remains a controversy regarding aspects of the PLATO trial, which are not immediately apparent from the peer-reviewed publications. A number of publications have sought to highlight potential discrepancies, using data available in publicly published documents from the US Food and Drug Administration (FDA) leading to disagreement regarding the value of open science and data sharing. We reflect upon potential sources of bias present in even rigorously performed randomised controlled trials, on whether peer review can establish the presence of bias and the need to constantly challenge and question even accepted data. Copyright © 2014 Elsevier Ireland Ltd. All rights reserved.

Peer review and the publication process.

PubMed

Ali, Parveen Azam; Watson, Roger

2016-10-01

To provide an overview of the peer review process, its various types, selection of peer reviewers, the purpose and significance of the peer review with regard to the assessment and management of quality of publications in academic journals. Discussion paper. This paper draws on information gained from literature on the peer review process and the authors' knowledge and experience of contributing as peer reviewers and editors in the field of health care, including nursing. There are various types of peer review: single blind; double blind; open; and post-publication review. The role of the reviewers in reviewing manuscripts and their contribution to the scientific and academic community remains important.

Peer Review in Scientific Publications: Benefits, Critiques, & A Survival Guide

PubMed Central

Kelly, Jacalyn; Sadeghieh, Tara

2014-01-01

Peer review has been defined as a process of subjecting an author’s scholarly work, research or ideas to the scrutiny of others who are experts in the same field. It functions to encourage authors to meet the accepted high standards of their discipline and to control the dissemination of research data to ensure that unwarranted claims, unacceptable interpretations or personal views are not published without prior expert review. Despite its wide-spread use by most journals, the peer review process has also been widely criticised due to the slowness of the process to publish new findings and due to perceived bias by the editors and/or reviewers. Within the scientific community, peer review has become an essential component of the academic writing process. It helps ensure that papers published in scientific journals answer meaningful research questions and draw accurate conclusions based on professionally executed experimentation. Submission of low quality manuscripts has become increasingly prevalent, and peer review acts as a filter to prevent this work from reaching the scientific community. The major advantage of a peer review process is that peer-reviewed articles provide a trusted form of scientific communication. Since scientific knowledge is cumulative and builds on itself, this trust is particularly important. Despite the positive impacts of peer review, critics argue that the peer review process stifles innovation in experimentation, and acts as a poor screen against plagiarism. Despite its downfalls, there has not yet been a foolproof system developed to take the place of peer review, however, researchers have been looking into electronic means of improving the peer review process. Unfortunately, the recent explosion in online only/electronic journals has led to mass publication of a large number of scientific articles with little or no peer review. This poses significant risk to advances in scientific knowledge and its future potential. The current article summarizes the peer review process, highlights the pros and cons associated with different types of peer review, and describes new methods for improving peer review. PMID:27683470

Rigorous, robust and systematic: Qualitative research and its contribution to burn care. An integrative review.

PubMed

Kornhaber, Rachel Anne; de Jong, A E E; McLean, L

2015-12-01

Qualitative methods are progressively being implemented by researchers for exploration within healthcare. However, there has been a longstanding and wide-ranging debate concerning the relative merits of qualitative research within the health care literature. This integrative review aimed to exam the contribution of qualitative research in burns care and subsequent rehabilitation. Studies were identified using an electronic search strategy using the databases PubMed, Cumulative Index of Nursing and Allied Health Literature (CINAHL), Excerpta Medica database (EMBASE) and Scopus of peer reviewed primary research in English between 2009 to April 2014 using Whittemore and Knafl's integrative review method as a guide for analysis. From the 298 papers identified, 26 research papers met the inclusion criteria. Across all studies there was an average of 22 participants involved in each study with a range of 6-53 participants conducted across 12 nations that focussed on burns prevention, paediatric burns, appropriate acquisition and delivery of burns care, pain and psychosocial implications of burns trauma. Careful and rigorous application of qualitative methodologies promotes and enriches the development of burns knowledge. In particular, the key elements in qualitative methodological process and its publication are critical in disseminating credible and methodologically sound qualitative research. Copyright © 2015 Elsevier Ltd and ISBI. All rights reserved.

Delivery Of Cascade Screening For Hereditary Conditions: A Scoping Review Of The Literature.

PubMed

Roberts, Megan C; Dotson, W David; DeVore, Christopher S; Bednar, Erica M; Bowen, Deborah J; Ganiats, Theodore G; Green, Ridgely Fisk; Hurst, Georgia M; Philp, Alisdair R; Ricker, Charité N; Sturm, Amy C; Trepanier, Angela M; Williams, Janet L; Zierhut, Heather A; Wilemon, Katherine A; Hampel, Heather

2018-05-01

Cascade screening is the process of contacting relatives of people who have been diagnosed with certain hereditary conditions. Its purpose is to identify, inform, and manage those who are also at risk. We conducted a scoping review to obtain a broad overview of cascade screening interventions, facilitators and barriers to their use, relevant policy considerations, and future research needs. We searched for relevant peer-reviewed literature in the period 1990-2017 and reviewed 122 studies. Finally, we described 45 statutes and regulations related to the use and release of genetic information across the fifty states. We sought standardized best practices for optimizing cascade screening across various geographic and policy contexts, but we found none. Studies in which trained providers contacted relatives directly, rather than through probands (index patients), showed greater cascade screening uptake; however, policies in some states might limit this approach. Major barriers to cascade screening delivery include suboptimal communication between the proband and family and geographic barriers to obtaining genetic services. Few US studies examined interventions for cascade screening or used rigorous study designs such as randomized controlled trials. Moving forward, there remains an urgent need to conduct rigorous intervention studies on cascade screening in diverse US populations, while accounting for state policy considerations.

Impact of interventions to improve the quality of peer review of biomedical journals: a systematic review and meta-analysis.

PubMed

Bruce, Rachel; Chauvin, Anthony; Trinquart, Ludovic; Ravaud, Philippe; Boutron, Isabelle

2016-06-10

The peer review process is a cornerstone of biomedical research. We aimed to evaluate the impact of interventions to improve the quality of peer review for biomedical publications. We performed a systematic review and meta-analysis. We searched CENTRAL, MEDLINE (PubMed), Embase, Cochrane Database of Systematic Reviews, and WHO ICTRP databases, for all randomized controlled trials (RCTs) evaluating the impact of interventions to improve the quality of peer review for biomedical publications. We selected 22 reports of randomized controlled trials, for 25 comparisons evaluating training interventions (n = 5), the addition of a statistical peer reviewer (n = 2), use of a checklist (n = 2), open peer review (i.e., peer reviewers informed that their identity would be revealed; n = 7), blinded peer review (i.e., peer reviewers blinded to author names and affiliation; n = 6) and other interventions to increase the speed of the peer review process (n = 3). Results from only seven RCTs were published since 2004. As compared with the standard peer review process, training did not improve the quality of the peer review report and use of a checklist did not improve the quality of the final manuscript. Adding a statistical peer review improved the quality of the final manuscript (standardized mean difference (SMD), 0.58; 95 % CI, 0.19 to 0.98). Open peer review improved the quality of the peer review report (SMD, 0.14; 95 % CI, 0.05 to 0.24), did not affect the time peer reviewers spent on the peer review (mean difference, 0.18; 95 % CI, -0.06 to 0.43), and decreased the rate of rejection (odds ratio, 0.56; 95 % CI, 0.33 to 0.94). Blinded peer review did not affect the quality of the peer review report or rejection rate. Interventions to increase the speed of the peer review process were too heterogeneous to allow for pooling the results. Despite the essential role of peer review, only a few interventions have been assessed in randomized controlled trials. Evidence-based peer review needs to be developed in biomedical journals.

Workplace accommodations for persons with physical disabilities: evidence synthesis of the peer-reviewed literature.

PubMed

Padkapayeva, Kathy; Posen, Andrew; Yazdani, Amin; Buettgen, Alexis; Mahood, Quenby; Tompa, Emile

2017-10-01

To identify and synthesize research evidence on workplace accommodations used by employers to recruit, hire, retain, and promote persons with physical disabilities. A structured search of six electronic journal databases was undertaken to identify peer-reviewed literature on the topic published from January 1990 to March 2016. Articles describing or evaluating workplace disability accommodation policies and practices were given a full-text review. Topic experts were contacted to identify additional studies. Details on specific accommodations described in 117 articles were synthesized and organized into three groups comprised of a total of 12 categories. The majority of studies did not rigorously evaluate effectiveness or cost-effectiveness of the accommodations under study. This evidence synthesis provides an overview of the peer-reviewed literature of value to occupational rehabilitation professionals and employers seeking guidance on workplace accommodation policies and practices for persons with physical disabilities. A wide range of accommodation options is available for addressing physical, social, and attitudinal barriers to successful employment. Besides physical/technological modifications, accommodations to enhance workplace flexibility and worker autonomy and strategies to promote workplace inclusion and integration are important. More comprehensive reporting and evaluations of the effectiveness of accommodations in research literature are needed to develop best practices for accommodating persons with disabilities. Implications for rehabilitation There is a substantial peer-reviewed literature that provides insights into the barriers for persons with physical disabilities and the workplace accommodation practices to address them, though rigorous evaluations of effectiveness and cost-effectiveness are uncommon. Attitudinal and social barriers stemming from stereotypes, ignorance and lack of knowledge are as important as physical barriers to employment for persons with physical disabilities. In addition to physical/technological modifications, accommodations to enhance workplace flexibility and autonomy of a worker, as well as strategies to promote workplace inclusion and integration may facilitate successful employment of persons with physical disabilities.

Built to last? The sustainability of health system improvements, interventions and change strategies: a study protocol for a systematic review

PubMed Central

Braithwaite, Jeffrey; Testa, Luke; Lamprell, Gina; Herkes, Jessica; Ludlow, Kristiana; McPherson, Elise; Campbell, Margie; Holt, Joanna

2017-01-01

Introduction The sustainability of healthcare interventions and change programmes is of increasing importance to researchers and healthcare stakeholders interested in creating sustainable health systems to cope with mounting stressors. The aim of this protocol is to extend earlier work and describe a systematic review to identify, synthesise and draw meaning from studies published within the last 5 years that measure the sustainability of interventions, improvement efforts and change strategies in the health system. Methods and analysis The protocol outlines a method by which to execute a rigorous systematic review. The design includes applying primary and secondary data collection techniques, consisting of a comprehensive database search complemented by contact with experts, and searching secondary databases and reference lists, using snowballing techniques. The review and analysis process will occur via an abstract review followed by a full-text screening process. The inclusion criteria include English-language, peer-reviewed, primary, empirical research articles published after 2011 in scholarly journals, for which the full text is available. No restrictions on location will be applied. The review that results from this protocol will synthesise and compare characteristics of the included studies. Ultimately, it is intended that this will help make it easier to identify and design sustainable interventions, improvement efforts and change strategies. Ethics and dissemination As no primary data were collected, ethical approval was not required. Results will be disseminated in conference presentations, peer-reviewed publications and among policymaker bodies interested in creating sustainable health systems. PMID:29133332

A Fine Balance: How Authors Strategize Around Journal Submission.

PubMed

Ginsburg, Shiphra; Lynch, Meghan; Walsh, Catharine M

2018-04-24

Publishing in peer-reviewed journals is essential for medical education researchers. Competition remains fierce for top journals and authors are advised to consider impact factor (IF), audience, and alignment of focus. However, little is known about how authors balance these factors when making submission decisions. The authors aimed to explore decision-making around journal choice. Using constructivist grounded theory, the authors conducted and analyzed 27 semi-structured phone interviews (August-November 2016) with medical education researchers. Participants were recruited from a larger study and all had presented abstracts at medical education meetings in 2005 or 2006. When deciding where to submit an article, participants weighed a journal's IF and prestige against other factors, such as a journal's vision and mission, finding the right audience, study-specific factors including perceived quality of the work, and the peer-review process. The opportunity cost of aiming high and risking rejection was influenced by career stage and external pressures. Despite much higher IFs, clinical journals were viewed as less desirable for establishing legitimacy in the medical education field and were often the target for less novel or rigorous work. Participants expressed dissatisfaction with peer review in general, citing overly critical and poorly informed reviewers. Authors strategize around a particular article's submission by attempting to balance many inter-related factors. Their perceptions that high IF clinical journals are viewed as less prestigious in this field can lead to publication strategies that run counter to advice given to junior faculty. This has implications for mentorship and institutional leadership.

Variability in Students' Evaluating Processes in Peer Assessment with Calibrated Peer Review

ERIC Educational Resources Information Center

Russell, J.; Van Horne, S.; Ward, A. S.; Bettis, E. A., III; Gikonyo, J.

2017-01-01

This study investigated students' evaluating process and their perceptions of peer assessment when they engaged in peer assessment using Calibrated Peer Review. Calibrated Peer Review is a web-based application that facilitates peer assessment of writing. One hundred and thirty-two students in an introductory environmental science course…

Peer review in hematopoietic cell transplantation: are we doing our fair share?

PubMed

Giralt, S; Korngold, R; Lazarus, H M

2016-09-01

Peer review is believed to be important in maintaining the quality and integrity of research in academic endeavors. Recently, the value of the current peer review process, which is more than 100 years old has come into question. In the field of hematopoietic cell transplantation (HCT), peer review was unable to prevent the publication of the largest and most notorious scientific fraud in our field. In order to assess how the HCT community views and how engaged it is with the peer review process, the American Society of Blood and Marrow Transplantation conducted a survey of all of its members in 2014. The survey was sent to all active members through multiple email communications in August and September 2014. Of a total of 1183 members, 149 responded. Almost all of the respondents had participated in the peer review process, with few respondents declining ever to review manuscripts. The most common cause for declining review requests was lack of time. Most respondents (68%) thought that the current peer review process was relatively fair and unbiased, whereas only 9% of the respondents stated that they did not believe in the peer review process. In conclusion, among the respondents of this survey most felt the peer review process to be valuable and fair, however, the lack of response suggests that further study into improving the peer review process in the field of HCT is warranted in the era of electronic publishing and communication.

How LIS Scholars Conceptualize Rigor in Qualitative Data

ERIC Educational Resources Information Center

Dempsey, Paula R.

2018-01-01

This study investigated how library and information science (LIS) scholars who used qualitative data explained and justified their methods. It analyzed research tasks mentioned in the methods sections of 151 peer-reviewed LIS studies published from 2011 to 2015 and in a survey of their authors. The study assumed that professors of LIS would…

A Review of Mixed Methods Research on Bullying and Peer Victimization in School

ERIC Educational Resources Information Center

Hong, Jun Sung; Espelage, Dorothy L.

2012-01-01

Recognizing the negative outcomes associated with experiences in bullying at school, educational researchers, school officials, and policy-makers have called for more rigorous research on bullying in school. Research on bullying behavior in school has primarily been examined using quantitative methods. Mixed methods research in the field of…

A survey of radiation treatment planning peer-review activities in a provincial radiation oncology programme: current practice and future directions

PubMed Central

Brundage, Michael; Foxcroft, Sophie; McGowan, Tom; Gutierrez, Eric; Sharpe, Michael; Warde, Padraig

2013-01-01

Objectives To describe current patterns of practice of radiation oncology peer review within a provincial cancer system, identifying barriers and facilitators to its use with the ultimate aim of process improvement. Design A survey of radiation oncology programmes at provincial cancer centres. Setting All cancer centres within the province of Ontario, Canada (n=14). These are community-based outpatient facilities overseen by Cancer Care Ontario, the provincial cancer agency. Participants A delegate from each radiation oncology programme filled out a single survey based on input from their multidisciplinary team. Outcome measures Rated importance of peer review; current utilisation; format of the peer-review process; organisation and timing; case attributes; outcomes of the peer-review process and perceived barriers and facilitators to expanding peer-review processes. Results 14 (100%) centres responded. All rated the importance of peer review as at least 8/10 (10=extremely important). Detection of medical error and improvement of planning processes were the highest rated perceived benefits of peer review (each median 9/10). Six centres (43%) reviewed at least 50% of curative cases; four of these centres (29%) conducted peer review in more than 80% of cases treated with curative intent. Fewer than 20% of cases treated with palliative intent were reviewed in most centres. Five centres (36%) reported usually conducting peer review prior to the initiation of treatment. Five centres (36%) recorded the outcomes of peer review on the medical record. Thirteen centres (93%) planned to expand peer-review activities; a critical mass of radiation oncologists was the most important limiting factor (median 6/10). Conclusions Radiation oncology peer-review practices can vary even within a cancer system with provincial oversight. The application of guidelines and standards for peer-review processes, and monitoring of implementation and outcomes, will require effective knowledge translation activities. PMID:23903814

A systematic review of definitions and classification systems of adjacent segment pathology.

PubMed

Kraemer, Paul; Fehlings, Michael G; Hashimoto, Robin; Lee, Michael J; Anderson, Paul A; Chapman, Jens R; Raich, Annie; Norvell, Daniel C

2012-10-15

Systematic review. To undertake a systematic review to determine how "adjacent segment degeneration," "adjacent segment disease," or clinical pathological processes that serve as surrogates for adjacent segment pathology are classified and defined in the peer-reviewed literature. Adjacent segment degeneration and adjacent segment disease are terms referring to degenerative changes known to occur after reconstructive spine surgery, most commonly at an immediately adjacent functional spinal unit. These can include disc degeneration, instability, spinal stenosis, facet degeneration, and deformity. The true incidence and clinical impact of degenerative changes at the adjacent segment is unclear because there is lack of a universally accepted classification system that rigorously addresses clinical and radiological issues. A systematic review of the English language literature was undertaken and articles were classified using the Grades of Recommendation Assessment, Development, and Evaluation criteria. RESULTS.: Seven classification systems of spinal degeneration, including degeneration at the adjacent segment, were identified. None have been evaluated for reliability or validity specific to patients with degeneration at the adjacent segment. The ways in which terms related to adjacent segment "degeneration" or "disease" are defined in the peer-reviewed literature are highly variable. On the basis of the systematic review presented in this article, no formal classification system for either cervical or thoracolumbar adjacent segment disorders currently exists. No recommendations regarding the use of current classification of degeneration at any segments can be made based on the available literature. A new comprehensive definition for adjacent segment pathology (ASP, the now preferred terminology) has been proposed in this Focus Issue, which reflects the diverse pathology observed at functional spinal units adjacent to previous spinal reconstruction and balances detailed stratification with clinical utility. A comprehensive classification system is being developed through expert opinion and will require validation as well as peer review. Strength of Statement: Strong.

Peer Review as a Strategy for Improving Students' Writing Process

ERIC Educational Resources Information Center

Baker, Kimberly M.

2016-01-01

Peer review is an established strategy for improving the quality of students' writing. This study moves beyond the focus on outcomes to assess the peer-review process. In particular, this study focuses on the timing of the peer review, a highly structured feedback form, and student writers' revisions after engaging in peer review. This study draws…

Connecting Technological Innovation in Artificial Intelligence to Real-world Medical Practice through Rigorous Clinical Validation: What Peer-reviewed Medical Journals Could Do

PubMed Central

2018-01-01

Artificial intelligence (AI) is projected to substantially influence clinical practice in the foreseeable future. However, despite the excitement around the technologies, it is yet rare to see examples of robust clinical validation of the technologies and, as a result, very few are currently in clinical use. A thorough, systematic validation of AI technologies using adequately designed clinical research studies before their integration into clinical practice is critical to ensure patient benefit and safety while avoiding any inadvertent harms. We would like to suggest several specific points regarding the role that peer-reviewed medical journals can play, in terms of study design, registration, and reporting, to help achieve proper and meaningful clinical validation of AI technologies designed to make medical diagnosis and prediction, focusing on the evaluation of diagnostic accuracy efficacy. Peer-reviewed medical journals can encourage investigators who wish to validate the performance of AI systems for medical diagnosis and prediction to pay closer attention to the factors listed in this article by emphasizing their importance. Thereby, peer-reviewed medical journals can ultimately facilitate translating the technological innovations into real-world practice while securing patient safety and benefit. PMID:29805337

Connecting Technological Innovation in Artificial Intelligence to Real-world Medical Practice through Rigorous Clinical Validation: What Peer-reviewed Medical Journals Could Do.

PubMed

Park, Seong Ho; Kressel, Herbert Y

2018-05-28

Artificial intelligence (AI) is projected to substantially influence clinical practice in the foreseeable future. However, despite the excitement around the technologies, it is yet rare to see examples of robust clinical validation of the technologies and, as a result, very few are currently in clinical use. A thorough, systematic validation of AI technologies using adequately designed clinical research studies before their integration into clinical practice is critical to ensure patient benefit and safety while avoiding any inadvertent harms. We would like to suggest several specific points regarding the role that peer-reviewed medical journals can play, in terms of study design, registration, and reporting, to help achieve proper and meaningful clinical validation of AI technologies designed to make medical diagnosis and prediction, focusing on the evaluation of diagnostic accuracy efficacy. Peer-reviewed medical journals can encourage investigators who wish to validate the performance of AI systems for medical diagnosis and prediction to pay closer attention to the factors listed in this article by emphasizing their importance. Thereby, peer-reviewed medical journals can ultimately facilitate translating the technological innovations into real-world practice while securing patient safety and benefit.

Medical journal peer review: process and bias.

PubMed

Manchikanti, Laxmaiah; Kaye, Alan D; Boswell, Mark V; Hirsch, Joshua A

2015-01-01

Scientific peer review is pivotal in health care research in that it facilitates the evaluation of findings for competence, significance, and originality by qualified experts. While the origins of peer review can be traced to the societies of the eighteenth century, it became an institutionalized part of the scholarly process in the latter half of the twentieth century. This was a response to the growth of research and greater subject specialization. With the current increase in the number of specialty journals, the peer review process continues to evolve to meet the needs of patients, clinicians, and policy makers. The peer review process itself faces challenges. Unblinded peer review might suffer from positive or negative bias towards certain authors, specialties, and institutions. Peer review can also suffer when editors and/or reviewers might be unable to understand the contents of the submitted manuscript. This can result in an inability to detect major flaws, or revelations of major flaws after acceptance of publication by the editors. Other concerns include potentially long delays in publication and challenges uncovering plagiarism, duplication, corruption and scientific misconduct. Conversely, a multitude of these challenges have led to claims of scientific misconduct and an erosion of faith. These challenges have invited criticism of the peer review process itself. However, despite its imperfections, the peer review process enjoys widespread support in the scientific community. Peer review bias is one of the major focuses of today's scientific assessment of the literature. Various types of peer review bias include content-based bias, confirmation bias, bias due to conservatism, bias against interdisciplinary research, publication bias, and the bias of conflicts of interest. Consequently, peer review would benefit from various changes and improvements with appropriate training of reviewers to provide quality reviews to maintain the quality and integrity of research without bias. Thus, an appropriate, transparent peer review is not only ideal, but necessary for the future to facilitate scientific progress.

Proposal Auto-Categorizer and Manager for Time Allocation Review at Space Telescope Science Institute

NASA Astrophysics Data System (ADS)

Porter, Sophia; Strolger, Louis-Gregory; Lagerstrom, Jill; Weissman, Sarah

2016-01-01

The Space Telescope Science Institute annually receives more than one thousand formal proposals for Hubble Space Telescope time, exceeding the available time with the observatory by a factor of over four. With JWST, the proposal pressure will only increase, straining our ability to provide rigorous peer review of each proposal's scientific merit. Significant hurdles in this process include the proper categorization of proposals, to ensure Time Allocation Committees (TACs) have the required and desired expertise to fairly and appropriately judge each proposal, and the selection of reviewers themselves, to establish diverse and well-qualified TACs. The Panel Auto-Categorizer and Manager (PACMan; a naive Bayesian classifier) was developed to automatically sort new proposals into their appropriate science categories and, similarly, to appoint panel reviewers with the best qualifications to serve on the corresponding TACs. We will provide an overview of PACMan and present the results of its testing on five previous cycles of proposals. PACMan will be implemented in upcoming cycles to support and eventually replace the process for constructing the time allocation reviews.

Assessment and clinical management of bone disease in adults with eating disorders: a review.

PubMed

Drabkin, Anne; Rothman, Micol S; Wassenaar, Elizabeth; Mascolo, Margherita; Mehler, Philip S

2017-01-01

To review current medical literature regarding the causes and clinical management options for low bone mineral density (BMD) in adult patients with eating disorders. Low bone mineral density is a common complication of eating disorders with potentially lifelong debilitating consequences. Definitive, rigorous guidelines for screening, prevention and management are lacking. This article intends to provide a review of the literature to date and current options for prevention and treatment. Current, peer-reviewed literature was reviewed, interpreted and summarized. Any patient with lower than average BMD should weight restore and in premenopausal females, spontaneous menses should resume. Adequate vitamin D and calcium supplementation is important. Weight-bearing exercise should be avoided unless cautiously monitored by a treatment team in the setting of weight restoration. If a patient has a Z-score less than expected for age with a high fracture risk or likelihood of ongoing BMD loss, physiologic transdermal estrogen plus oral progesterone, bisphosphonates (alendronate or risedronate) or teriparatide could be considered. Other agents, such as denosumab and testosterone in men, have not been tested in eating-disordered populations and should only be trialed on an empiric basis if there is a high clinical concern for fractures or worsening bone mineral density. A rigorous peer-based approach to establish guidelines for evaluation and management of low bone mineral density is needed in this neglected subspecialty of eating disorders.

Peer Review Quality and Transparency of the Peer-Review Process in Open Access and Subscription Journals.

PubMed

Wicherts, Jelte M

2016-01-01

Recent controversies highlighting substandard peer review in Open Access (OA) and traditional (subscription) journals have increased the need for authors, funders, publishers, and institutions to assure quality of peer-review in academic journals. I propose that transparency of the peer-review process may be seen as an indicator of the quality of peer-review, and develop and validate a tool enabling different stakeholders to assess transparency of the peer-review process. Based on editorial guidelines and best practices, I developed a 14-item tool to rate transparency of the peer-review process on the basis of journals' websites. In Study 1, a random sample of 231 authors of papers in 92 subscription journals in different fields rated transparency of the journals that published their work. Authors' ratings of the transparency were positively associated with quality of the peer-review process but unrelated to journal's impact factors. In Study 2, 20 experts on OA publishing assessed the transparency of established (non-OA) journals, OA journals categorized as being published by potential predatory publishers, and journals from the Directory of Open Access Journals (DOAJ). Results show high reliability across items (α = .91) and sufficient reliability across raters. Ratings differentiated the three types of journals well. In Study 3, academic librarians rated a random sample of 140 DOAJ journals and another 54 journals that had received a hoax paper written by Bohannon to test peer-review quality. Journals with higher transparency ratings were less likely to accept the flawed paper and showed higher impact as measured by the h5 index from Google Scholar. The tool to assess transparency of the peer-review process at academic journals shows promising reliability and validity. The transparency of the peer-review process can be seen as an indicator of peer-review quality allowing the tool to be used to predict academic quality in new journals.

Peer Review Quality and Transparency of the Peer-Review Process in Open Access and Subscription Journals

PubMed Central

Wicherts, Jelte M.

2016-01-01

Background Recent controversies highlighting substandard peer review in Open Access (OA) and traditional (subscription) journals have increased the need for authors, funders, publishers, and institutions to assure quality of peer-review in academic journals. I propose that transparency of the peer-review process may be seen as an indicator of the quality of peer-review, and develop and validate a tool enabling different stakeholders to assess transparency of the peer-review process. Methods and Findings Based on editorial guidelines and best practices, I developed a 14-item tool to rate transparency of the peer-review process on the basis of journals’ websites. In Study 1, a random sample of 231 authors of papers in 92 subscription journals in different fields rated transparency of the journals that published their work. Authors’ ratings of the transparency were positively associated with quality of the peer-review process but unrelated to journal’s impact factors. In Study 2, 20 experts on OA publishing assessed the transparency of established (non-OA) journals, OA journals categorized as being published by potential predatory publishers, and journals from the Directory of Open Access Journals (DOAJ). Results show high reliability across items (α = .91) and sufficient reliability across raters. Ratings differentiated the three types of journals well. In Study 3, academic librarians rated a random sample of 140 DOAJ journals and another 54 journals that had received a hoax paper written by Bohannon to test peer-review quality. Journals with higher transparency ratings were less likely to accept the flawed paper and showed higher impact as measured by the h5 index from Google Scholar. Conclusions The tool to assess transparency of the peer-review process at academic journals shows promising reliability and validity. The transparency of the peer-review process can be seen as an indicator of peer-review quality allowing the tool to be used to predict academic quality in new journals. PMID:26824759

Open peer review at four STEM journals: an observational overview.

PubMed

Ford, Emily

2015-01-01

Open peer review, peer review where authors' and reviewers' identities are disclosed to one another, is a growing trend in scholarly publishing. Through observation of four journals in STEM disciplines, PLOS One, Atmospheric Chemistry & Physics, PeerJ, and F1000Research, an observational overview is conducted. The overview relies on defined characteristics of open peer review. Results show that despite differing open peer review implementations, each journal retains editorial involvement in scholarly publishing. Further, the analysis shows that only one of these implementations is fully transparent in its peer review and decision making process. Finally, the overview contends that journals should clearly outline peer review and editorial processes in order to allow for open peer review to be better understood and adopted by authors, reviewers, editors, and readers of science communications.

Evaluating the Pros and Cons of Different Peer Review Policies via Simulation.

PubMed

Zhu, Jia; Fung, Gabriel; Wong, Wai Hung; Li, Zhixu; Xu, Chuanhua

2016-08-01

In the academic world, peer review is one of the major processes in evaluating a scholars contribution. In this study, we are interested in quantifying the merits of different policies in a peer review process, such as single-blind review, double-blind review, and obtaining authors feedback. Currently, insufficient work has been undertaken to evaluate the benefits of different peer review policies. One of the major reasons for this situation is the inability to conduct any empirical study because data are presently unavailable. In this case, a computer simulation is one of the best ways to conduct a study. We perform a series of simulations to study the effects of different policies on a peer review process. In this study, we focus on the peer review process of a typical computer science conference. Our results point to the crucial role of program chairs in determining the quality and diversity of the articles to be accepted for publication. We demonstrate the importance of discussion among reviewers, suggest circumstances in which the double-blind review policy should be adopted, and question the credibility of the authors feedback mechanism. Finally, we stress that randomness plays an important role in the peer review process, and this role cannot be eliminated. Although our model may not capture every component of a peer review process, it covers some of the most essential elements. Thus, even the simulation results clearly cannot be taken as literal descriptions of an actual peer review process. However, we can at least still use them to identify alternative directions for future study.

Coached Peer Review: Developing the Next Generation of Authors.

PubMed

Sidalak, Daniel; Purdy, Eve; Luckett-Gatopoulos, S; Murray, Heather; Thoma, Brent; Chan, Teresa M

2017-02-01

Publishing in academic journals is challenging for learners. Those who pass the initial stages of internal review by an editor often find the anonymous peer review process harsh. Academic blogs offer alternate avenues for publishing medical education material. Many blogs, however, lack a peer review process, which some consumers argue compromises the quality of materials published. CanadiEM (formerly BoringEM) is an academic educational emergency medicine blog dedicated to publishing high-quality materials produced by learners (i.e., residents and medical students). The editorial team has designed and implemented a collaborative "coached peer review" process that comprises an open exchange among the learner-author, editors, and reviewers. The goal of this process is to facilitate the publication of high-quality academic materials by learner-authors while providing focused feedback to help them develop academic writing skills. The authors of this Innovation Report surveyed (February-June 2015) their blog's learner-authors and external expert "staff" reviewers who had participated in coached peer review for their reactions to the process. The survey results revealed that participants viewed the process positively compared with both traditional journal peer review and academic blog publication processes. Participants found the process friendly, easy, efficient, and transparent. Learner-authors also reported increased confidence in their published material. These outcomes met the goals of coached peer review. CanadiEM aims to inspire continued participation in, exposure to, and high-quality production of academic writing by promoting the adoption of coached peer review for online educational resources produced by learners.

Enhancing rigor and practice of scoping reviews in social policy research: considerations from a worked example on the Americans with disabilities act.

PubMed

Harris, Sarah Parker; Gould, Robert; Fujiura, Glenn

2015-01-01

There is increasing theoretical consideration about the use of systematic and scoping reviews of evidence in informing disability and rehabilitation research and practice. Indicative of this trend, this journal published a piece by Rumrill, Fitzgerald and Merchant in 2010 explaining the utility and process for conducting reviews of intervention-based research. There is still need to consider how to apply such rigor when conducting more exploratory reviews of heterogeneous research. This article explores the challenges, benefits, and procedures for conducting rigorous exploratory scoping reviews of diverse evidence. The article expands upon Rumrill, Fitzgerald and Merchant's framework and considers its application to more heterogeneous evidence on the impact of social policy. A worked example of a scoping review of the Americans with Disabilities Act is provided with a procedural framework for conducting scoping reviews on the effects of a social policy. The need for more nuanced techniques for enhancing rigor became apparent during the review process. There are multiple methodological steps that can enhance the utility of exploratory scoping reviews. The potential of systematic consideration during the exploratory review process is shown as a viable method to enhance the rigor in reviewing diverse bodies of evidence.

Built to last? The sustainability of health system improvements, interventions and change strategies: a study protocol for a systematic review.

PubMed

Braithwaite, Jeffrey; Testa, Luke; Lamprell, Gina; Herkes, Jessica; Ludlow, Kristiana; McPherson, Elise; Campbell, Margie; Holt, Joanna

2017-11-12

The sustainability of healthcare interventions and change programmes is of increasing importance to researchers and healthcare stakeholders interested in creating sustainable health systems to cope with mounting stressors. The aim of this protocol is to extend earlier work and describe a systematic review to identify, synthesise and draw meaning from studies published within the last 5 years that measure the sustainability of interventions, improvement efforts and change strategies in the health system. The protocol outlines a method by which to execute a rigorous systematic review. The design includes applying primary and secondary data collection techniques, consisting of a comprehensive database search complemented by contact with experts, and searching secondary databases and reference lists, using snowballing techniques. The review and analysis process will occur via an abstract review followed by a full-text screening process. The inclusion criteria include English-language, peer-reviewed, primary, empirical research articles published after 2011 in scholarly journals, for which the full text is available. No restrictions on location will be applied. The review that results from this protocol will synthesise and compare characteristics of the included studies. Ultimately, it is intended that this will help make it easier to identify and design sustainable interventions, improvement efforts and change strategies. As no primary data were collected, ethical approval was not required. Results will be disseminated in conference presentations, peer-reviewed publications and among policymaker bodies interested in creating sustainable health systems. © Article author(s) (or their employer(s) unless otherwise stated in the text of the article) 2017. All rights reserved. No commercial use is permitted unless otherwise expressly granted.

Clinical peer review in the United States: history, legal development and subsequent abuse.

PubMed

Vyas, Dinesh; Hozain, Ahmed E

2014-06-07

The Joint Commission on Accreditation requires hospitals to conduct peer review to retain accreditation. Despite the intended purpose of improving quality medical care, the peer review process has suffered several setbacks throughout its tenure. In the 1980s, abuse of peer review for personal economic interest led to a highly publicized multimillion-dollar verdict by the United States Supreme Court against the perpetrating physicians and hospital. The verdict led to decreased physician participation for fear of possible litigation. Believing that peer review was critical to quality medical care, Congress subsequently enacted the Health Care Quality Improvement Act (HCQIA) granting comprehensive legal immunity for peer reviewers to increase participation. While serving its intended goal, HCQIA has also granted peer reviewers significant immunity likely emboldening abuses resulting in Sham Peer Reviews. While legal reform of HCQIA is necessary to reduce sham peer reviews, further measures including the need for standardization of the peer review process alongside external organizational monitoring are critical to improving peer review and reducing the prevalence of sham peer reviews.

Clinical peer review in the United States: History, legal development and subsequent abuse

PubMed Central

Vyas, Dinesh; Hozain, Ahmed E

2014-01-01

The Joint Commission on Accreditation requires hospitals to conduct peer review to retain accreditation. Despite the intended purpose of improving quality medical care, the peer review process has suffered several setbacks throughout its tenure. In the 1980s, abuse of peer review for personal economic interest led to a highly publicized multimillion-dollar verdict by the United States Supreme Court against the perpetrating physicians and hospital. The verdict led to decreased physician participation for fear of possible litigation. Believing that peer review was critical to quality medical care, Congress subsequently enacted the Health Care Quality Improvement Act (HCQIA) granting comprehensive legal immunity for peer reviewers to increase participation. While serving its intended goal, HCQIA has also granted peer reviewers significant immunity likely emboldening abuses resulting in Sham Peer Reviews. While legal reform of HCQIA is necessary to reduce sham peer reviews, further measures including the need for standardization of the peer review process alongside external organizational monitoring are critical to improving peer review and reducing the prevalence of sham peer reviews. PMID:24914357

The ethics of peer review in bioethics

PubMed Central

Wendler, David; Miller, Franklin

2014-01-01

A good deal has been written on the ethics of peer review, especially in the scientific and medical literatures. In contrast, we are unaware of any articles on the ethics of peer review in bioethics. Recognising this gap, we evaluate the extant proposals regarding ethical standards for peer review in general and consider how they apply to bioethics. We argue that scholars have an obligation to perform peer review based on the extent to which they personally benefit from the peer review process. We also argue, contrary to existing proposals and guidelines, that it can be appropriate for peer reviewers to benefit in their own scholarship from the manuscripts they review. With respect to bioethics in particular, we endorse double-blind review and suggest several ways in which the peer review process might be improved. PMID:24131903

Development of a peer-review framework for cancer multidisciplinary meetings.

PubMed

Johnson, Claire E; Slavova-Azmanova, Neli; Saunders, Christobel

2017-05-01

There is no mechanism in place for monitoring or quality improvement of cancer multidisciplinary meetings (MDM) in Australia. To develop a peer-review process for quality improvement of MDM. This project involved three phases: (i) development of a draft peer-review framework, supporting documents and peer-review process; (ii) consultation with key stakeholders; (iii) refinement of the framework, documents and processes following a pilot study with three MDM. Feedback indicated that specific standards included in the framework needed to allow the peer reviewers to be flexible relative to the circumstances of the individual MDM. Conversely, feedback identified the need for clear, evidence-based clinical practice guidelines for the conduct of MDM, with accepted standards and objective measures of performance. MDM members were divided about the need to employ peer reviewers from the tumour stream of the MDM under review but agreed that closer involvement of the team under review to support the implementation of recommendations is warranted. We developed an adaptable peer-review framework and process using the current available evidence and guidance. While further research is needed to establish what constitutes best practice in MDM and which processes contribute to improved patient outcomes, the structured peer-review process we describe, when modified using the disease-relevant evidence, could be utilised more broadly as a quality improvement tool. © 2017 Royal Australasian College of Physicians.

Journal peer review: a bar or bridge? An analysis of a paper's revision history and turnaround time, and the effect on citation.

PubMed

Rigby, J; Cox, D; Julian, K

2018-01-01

Journal peer review lies at the heart of academic quality control. This article explores the journal peer review process and seeks to examine how the reviewing process might itself contribute to papers, leading them to be more highly cited and to achieve greater recognition. Our work builds on previous observations and views expressed in the literature about (a) the role of actors involved in the research and publication process that suggest that peer review is inherent in the research process and (b) on the contribution reviewers themselves might make to the content and increased citation of papers. Using data from the journal peer review process of a single journal in the Social Sciences field (Business, Management and Accounting), we examine the effects of peer review on papers submitted to that journal including the effect upon citation, a novel step in the study of the outcome of peer review. Our detailed analysis suggests, contrary to initial assumptions, that it is not the time taken to revise papers but the actual number of revisions that leads to greater recognition for papers in terms of citation impact. Our study provides evidence, albeit limited to the case of a single journal, that the peer review process may constitute a form of knowledge production and is not the simple correction of errors contained in submitted papers.

Redefining the Practice of Peer Review Through Intelligent Automation Part 2: Data-Driven Peer Review Selection and Assignment.

PubMed

Reiner, Bruce I

2017-12-01

In conventional radiology peer review practice, a small number of exams (routinely 5% of the total volume) is randomly selected, which may significantly underestimate the true error rate within a given radiology practice. An alternative and preferable approach would be to create a data-driven model which mathematically quantifies a peer review risk score for each individual exam and uses this data to identify high risk exams and readers, and selectively target these exams for peer review. An analogous model can also be created to assist in the assignment of these peer review cases in keeping with specific priorities of the service provider. An additional option to enhance the peer review process would be to assign the peer review cases in a truly blinded fashion. In addition to eliminating traditional peer review bias, this approach has the potential to better define exam-specific standard of care, particularly when multiple readers participate in the peer review process.

Comprehensive Adolescent Health Programs That Include Sexual and Reproductive Health Services: A Systematic Review

PubMed Central

Parekh, Jenita; Tunçalp, Özge; Turke, Shani; Blum, Robert William

2014-01-01

We systematically reviewed peer-reviewed and gray literature on comprehensive adolescent health (CAH) programs (1998–2013), including sexual and reproductive health services. We screened 36 119 records and extracted articles using predefined criteria. We synthesized data into descriptive characteristics and assessed quality by evidence level. We extracted data on 46 programs, of which 19 were defined as comprehensive. Ten met all inclusion criteria. Most were US based; others were implemented in Egypt, Ethiopia, and Mexico. Three programs displayed rigorous evidence; 5 had strong and 2 had modest evidence. Those with rigorous or strong evidence directly or indirectly influenced adolescent sexual and reproductive health. The long-term impact of many CAH programs cannot be proven because of insufficient evaluations. Evaluation approaches that take into account the complex operating conditions of many programs are needed to better understand mechanisms behind program effects. PMID:25320876

School Racial and Economic Composition & Math and Science Achievement. Research Brief No. 1. Updated

ERIC Educational Resources Information Center

Eaton, Susan

2011-01-01

This is the first in a series of three research briefs summarizing findings from the newest and most rigorous research related to racial and socioeconomic diversity in public schools. The studies on which this brief is based were published recently in three special issues of the peer-reviewed journal, "Teachers College Record," edited by…

The Impact of Racially Diverse Schools in a Democratic Society. Research Brief No. 3. Updated

ERIC Educational Resources Information Center

Eaton, Susan; Chirichigno, Gina

2011-01-01

This is the third in a series of briefs summarizing findings from the newest and most rigorous research related to racial and socioeconomic diversity in public schools. The studies on which this brief is based were published recently in three special issues of the peer-reviewed journal, "Teachers College Record," edited by Professors…

Intratheater Airlift Functional Needs Analysis (FNA)

DTIC Science & Technology

2011-01-01

information on reprint and linking permissions, please see RAND Permissions. Skip all front matter: Jump to Page 16 The RAND Corporation is a nonprofit...facing the public and private sectors. All RAND mono- graphs undergo rigorous peer review to ensure high standards for research quality and...personnel. xii Intratheater Airlift Functional Needs Analysis all operating environments. The FNA assesses the ability of current assets to

Ambiguity, logic, simplicity, and dynamics: Wittgensteinian evaluative criteria in peer review of quantitative research on categorization.

PubMed

Shimp, Charles P

2004-06-30

Research on categorization has changed over time, and some of these changes resemble how Wittgenstein's views changed from his Tractatus Logico-Philosophicus to his Philosophical Investigations. Wittgenstein initially focused on unambiguous, abstract, parsimonious, logical propositions and rules, and on independent, static, "atomic facts." This approach subsequently influenced the development of logical positivism and thereby may have indirectly influenced method and theory in research on categorization: much animal research on categorization has focused on learning simple, static, logical rules unambiguously interrelating small numbers of independent features. He later rejected logical simplicity and rigor and focused instead on Gestalt ideas about figure-ground reversals and context, the ambiguity of family resemblance, and the function of details of everyday language. Contemporary contextualism has been influenced by this latter position, some features of which appear in contemporary empirical research on categorization. These developmental changes are illustrated by research on avian local and global levels of visual perceptual analysis, categorization of rectangles and moving objects, and artificial grammar learning. Implications are described for peer review of quantitative theory in which ambiguity, logical rigor, simplicity, or dynamics are designed to play important roles.

Random Versus Nonrandom Peer Review: A Case for More Meaningful Peer Review.

PubMed

Itri, Jason N; Donithan, Adam; Patel, Sohil H

2018-05-10

Random peer review programs are not optimized to discover cases with diagnostic error and thus have inherent limitations with respect to educational and quality improvement value. Nonrandom peer review offers an alternative approach in which diagnostic error cases are targeted for collection during routine clinical practice. The objective of this study was to compare error cases identified through random and nonrandom peer review approaches at an academic center. During the 1-year study period, the number of discrepancy cases and score of discrepancy were determined from each approach. The nonrandom peer review process collected 190 cases, of which 60 were scored as 2 (minor discrepancy), 94 as 3 (significant discrepancy), and 36 as 4 (major discrepancy). In the random peer review process, 1,690 cases were reviewed, of which 1,646 were scored as 1 (no discrepancy), 44 were scored as 2 (minor discrepancy), and none were scored as 3 or 4. Several teaching lessons and quality improvement measures were developed as a result of analysis of error cases collected through the nonrandom peer review process. Our experience supports the implementation of nonrandom peer review as a replacement to random peer review, with nonrandom peer review serving as a more effective method for collecting diagnostic error cases with educational and quality improvement value. Copyright © 2018 American College of Radiology. Published by Elsevier Inc. All rights reserved.

Using the Inquiry Process to Motivate and Engage All (Including Struggling) Readers

ERIC Educational Resources Information Center

Savitz, Rachelle S.; Wallace, Kelly

2016-01-01

With increasingly rigorous standards and mounting high stakes testing, it seems harder than ever to motivate and engage struggling readers. In this article the authors provide an overview of the inquiry learning process, which details how providing students with choice and opportunities to collaborate with peers can keep students invested in their…

Report on Climate Change E-mails Exonerates Scientists

NASA Astrophysics Data System (ADS)

Showstack, Randy

2010-07-01

A new report commissioned by the University of East Anglia (UEA) has largely exonerated climate scientists from the university's Climatic Research Unit (CRU) who wrote a number of controversial e-mail messages that were made public without authorization in November 2009. Critics have argued that the e-mails indicate that scientists had tampered with scientific data—including data related to land station temperatures and temperature reconstructions from tree ring analysis—subverted the peer review process, misused the Intergovernmental Panel on Climate Change (IPCC) process, and withheld data from critics. At a 7 July news conference to release the “Independent climate change e-mails review,” report chair Muir Russell said, “Climate science is a matter of such global importance that the highest standards of honesty, rigor, and openness are needed in its conduct. On the specific allegations made against the behavior of CRU scientists, we find that their rigor and honesty as scientists are not in doubt.” He continued, “In addition, we do not find that their behavior has prejudiced the balance of advice given to policy makers. In particular, we did not find any evidence of behavior that might undermine the conclusions of the IPCC assessments.” Russell is chair of the Judicial Appointments Board for Scotland and formerly was principal and vice-chancellor of the University of Glasgow, in Scotland.

Scientific approaches to science policy.

PubMed

Berg, Jeremy M

2013-11-01

The development of robust science policy depends on use of the best available data, rigorous analysis, and inclusion of a wide range of input. While director of the National Institute of General Medical Sciences (NIGMS), I took advantage of available data and emerging tools to analyze training time distribution by new NIGMS grantees, the distribution of the number of publications as a function of total annual National Institutes of Health support per investigator, and the predictive value of peer-review scores on subsequent scientific productivity. Rigorous data analysis should be used to develop new reforms and initiatives that will help build a more sustainable American biomedical research enterprise.

A proposal for an 'equal peer-review' statement.

PubMed

Moustafa, Khaled

2015-08-01

To make the peer-review process as objective as possible, I suggest the introduction of an 'equal peer-review' statement that preserves author anonymity across the board, thus removing any potential bias related to nominal or institutional 'prestige'; this would guarantee an equal peer-review process for all authors and grant applicants. Copyright © 2015 Elsevier Ltd. All rights reserved.

Field Test of a Peer Review System for Digital Geoscience Education Resources

NASA Astrophysics Data System (ADS)

Mayhew, M. A.; Hall, M. K.

2007-12-01

We report the results of an experiment aimed at developing a rigorous peer review system for evaluating digital geoscience education resources under consideration for acceptance into a digital library. The objective is the basis for developing a digital library of the highest quality that will become a trusted resource for Earth science instructors. Our model is NSF-style review panels. Panels were convened in locations having colleges, universities, and labs: Philadelphia, Boston, Austin, St. Petersburg, Seattle, Tucson, and Portland (Maine). The conveners traveled to the sites for the panel meetings. Panelists were reputable geoscience and geoscience education experts. The panelists proved to be uniformly supportive of the process and valued both the experience of serving on the panels and the introduction to resources they could take back to their classroom; thus, the process proved to have a valuable community-building component. The resources reviewed in the experiment, grouped by theme, were provided by the Science Education Resource Center at Carleton College; they are also catalogued in DLESE and NSDL. Panelists wrote reviews that addressed the criteria: 1) scientific accuracy and currency, 2) usability, and 3) pedagogical effectiveness. Additionally, the reviews addressed the questions: 1) Does this resource make an important contribution to Earth system education? 2) Would you recommend this resource to a colleague? and If you recommend major revisions for this resource, would you be willing to review it again? Each review concluded with a recommended action: 1) Accept, 2) Accept with minor revisions, 3) Accept with major revisions, or 4) Reject. Accept with major revisions requires a review by a subset of the panel conducting the original review. Once accepted, a resource enters a reviewed collection, with a specific indicator that it has been through the peer review process. Each panel was invited to single out those resources they considered particularly exemplary, which we refer to as a gold star rating; such resources will be indicated as such in the reviewed collection. Following the panel meetings, the conveners wrote summaries of the panel discussion for each resource; these are transmitted to the creator, along with anonymous versions of the reviews. The panel process proved to be a critical filter for the reviewed resources. Relatively few resources were accepted as is. In most cases, the majority of the resources were either designated as 1) Reject or 2) Accept with major revisions. Resources were most often rejected for their lack of completeness to be used in a classroom or they contained scientific accuracies. The review process modeled provides a basis for building a trusted geoscience education digital library of the highest quality on a less-is-more foundation, as opposed to the prevailing more-is-better philosophy. project.org/isovera/peerreview

A prospective study on an innovative online forum for peer reviewing of surgical science.

PubMed

Almquist, Martin; von Allmen, Regula S; Carradice, Dan; Oosterling, Steven J; McFarlane, Kirsty; Wijnhoven, Bas

2017-01-01

Peer review is important to the scientific process. However, the present system has been criticised and accused of bias, lack of transparency, failure to detect significant breakthrough and error. At the British Journal of Surgery (BJS), after surveying authors' and reviewers' opinions on peer review, we piloted an open online forum with the aim of improving the peer review process. In December 2014, a web-based survey assessing attitudes towards open online review was sent to reviewers with a BJS account in Scholar One. From April to June 2015, authors were invited to allow their manuscripts to undergo online peer review in addition to the standard peer review process. The quality of each review was evaluated by editors and editorial assistants using a validated instrument based on a Likert scale. The survey was sent to 6635 reviewers. In all, 1454 (21.9%) responded. Support for online peer review was strong, with only 10% stating that they would not subject their manuscripts to online peer review. The most prevalent concern was about intellectual property, being highlighted in 118 of 284 comments (41.5%). Out of 265 eligible manuscripts, 110 were included in the online peer review trial. Around 7000 potential reviewers were invited to review each manuscript. In all, 44 of 110 manuscripts (40%) received 100 reviews from 59 reviewers, alongside 115 conventional reviews. The quality of the open forum reviews was lower than for conventional reviews (2.13 (± 0.75) versus 2.84 (± 0.71), P<0.001). Open online peer review is feasible in this setting, but it attracts few reviews, of lower quality than conventional peer reviews.

A prospective study on an innovative online forum for peer reviewing of surgical science

PubMed Central

von Allmen, Regula S.; Carradice, Dan; Oosterling, Steven J.; McFarlane, Kirsty; Wijnhoven, Bas

2017-01-01

Background Peer review is important to the scientific process. However, the present system has been criticised and accused of bias, lack of transparency, failure to detect significant breakthrough and error. At the British Journal of Surgery (BJS), after surveying authors’ and reviewers’ opinions on peer review, we piloted an open online forum with the aim of improving the peer review process. Methods In December 2014, a web-based survey assessing attitudes towards open online review was sent to reviewers with a BJS account in Scholar One. From April to June 2015, authors were invited to allow their manuscripts to undergo online peer review in addition to the standard peer review process. The quality of each review was evaluated by editors and editorial assistants using a validated instrument based on a Likert scale. Results The survey was sent to 6635 reviewers. In all, 1454 (21.9%) responded. Support for online peer review was strong, with only 10% stating that they would not subject their manuscripts to online peer review. The most prevalent concern was about intellectual property, being highlighted in 118 of 284 comments (41.5%). Out of 265 eligible manuscripts, 110 were included in the online peer review trial. Around 7000 potential reviewers were invited to review each manuscript. In all, 44 of 110 manuscripts (40%) received 100 reviews from 59 reviewers, alongside 115 conventional reviews. The quality of the open forum reviews was lower than for conventional reviews (2.13 (± 0.75) versus 2.84 (± 0.71), P<0.001). Conclusion Open online peer review is feasible in this setting, but it attracts few reviews, of lower quality than conventional peer reviews. PMID:28662046

Peer Review: Promoting Efficient School District Operations

ERIC Educational Resources Information Center

Hale, Jason S.

2010-01-01

Many professions recognize the benefits of peer reviews to assess processes and operations because peers can more easily identify one another's inefficiencies and provide some kind of intervention. Generally, the goal of the peer review process is to verify whether the work satisfies the standards set by the industry. A number of states have begun…

Intergenerational Trauma in Refugee Families: A Systematic Review

PubMed Central

Sangalang, Cindy C.; Vang, Cindy

2016-01-01

Although a robust literature describes the intergenerational effects of traumatic experiences in various populations, evidence specific to refugee families is scattered and contains wide variations in approaches for examining intergenerational trauma. Using the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) criteria, the purpose of this systematic review was to describe the methodologies and findings of peer-reviewed literature regarding intergenerational trauma in refugee families. In doing so we aimed to critically examine how existing literature characterizes refugee trauma, its long-term effects on descendants, and psychosocial processes of transmission in order to provide recommendations for future research. The results highlight populations upon which current evidence is based, conceptualizations of refugee trauma, effects of parental trauma transmission on descendants’ health and well-being, and mechanisms of transmission and underlying meanings attributed to parental trauma in refugee families. Greater methodological rigor and consistency in future evidence-based research is needed to inform supportive systems that promote the health and well-being of refugees and their descendants. PMID:27659490

Peer review of health research funding proposals: A systematic map and systematic review of innovations for effectiveness and efficiency.

PubMed

Shepherd, Jonathan; Frampton, Geoff K; Pickett, Karen; Wyatt, Jeremy C

2018-01-01

To investigate methods and processes for timely, efficient and good quality peer review of research funding proposals in health. A two-stage evidence synthesis: (1) a systematic map to describe the key characteristics of the evidence base, followed by (2) a systematic review of the studies stakeholders prioritised as relevant from the map on the effectiveness and efficiency of peer review 'innovations'. Standard processes included literature searching, duplicate inclusion criteria screening, study keyword coding, data extraction, critical appraisal and study synthesis. A total of 83 studies from 15 countries were included in the systematic map. The evidence base is diverse, investigating many aspects of the systems for, and processes of, peer review. The systematic review included eight studies from Australia, Canada, and the USA, evaluating a broad range of peer review innovations. These studies showed that simplifying the process by shortening proposal forms, using smaller reviewer panels, or expediting processes can speed up the review process and reduce costs, but this might come at the expense of peer review quality, a key aspect that has not been assessed. Virtual peer review using videoconferencing or teleconferencing appears promising for reducing costs by avoiding the need for reviewers to travel, but again any consequences for quality have not been adequately assessed. There is increasing international research activity into the peer review of health research funding. The studies reviewed had methodological limitations and variable generalisability to research funders. Given these limitations it is not currently possible to recommend immediate implementation of these innovations. However, many appear promising based on existing evidence, and could be adapted as necessary by funders and evaluated. Where feasible, experimental evaluation, including randomised controlled trials, should be conducted, evaluating impact on effectiveness, efficiency and quality.

Paired peer review of university classroom teaching in a school of nursing and midwifery.

PubMed

Bennett, Paul N; Parker, Steve; Smigiel, Heather

2012-08-01

Peer review of university classroom teaching can increase the quality of teaching but is not universally practiced in Australian universities. To report an evaluation of paired peer-review process using both paper and web based teaching evaluation tools. Twenty university teachers in one metropolitan Australian School of Nursing and Midwifery were randomly paired and then randomly assigned to a paper based or web-based peer review tool. Each teacher reviewed each other's classroom teaching as part of a peer review program. The participants then completed an 18 question survey evaluating the peer review tool and paired evaluation process. Responses were analyzed using frequencies and percentages. Regardless of the tool used, participants found this process of peer review positive (75%), collegial (78%), supportive (61%) and non-threatening (71%). Participants reported that the peer review will improve their own classroom delivery (61%), teaching evaluation (61%) and planning (53%). The web-based tool was found to be easier to use and allowed more space than the paper-based tool. Implementation of a web-based paired peer review system can be a positive method of peer review of university classroom teaching. Pairing of teachers to review each other's classroom teaching is a promising strategy and has the potential to improve teaching in teaching universities. Copyright © 2011 Elsevier Ltd. All rights reserved.

Marketing Academics' Perceptions of the Peer Review Process

ERIC Educational Resources Information Center

Bailey, Charles D.; Hair, Joe F.; Hermanson, Dana R.; Crittenden, Victoria L.

2012-01-01

Publication in refereed journals is critical to career success for most marketing faculty members, and the peer review process is the gatekeeper for a refereed journal. The study reported here examines marketing academics' perceptions of this peer review process. Based on responses from 653 marketing academics, we find favorable overall…

45 CFR 1388.9 - Peer review.

Code of Federal Regulations, 2010 CFR

2010-10-01

... 45 Public Welfare 4 2010-10-01 2010-10-01 false Peer review. 1388.9 Section 1388.9 Public Welfare... PROGRAM THE UNIVERSITY AFFILIATED PROGRAMS § 1388.9 Peer review. (a) The purpose of the peer review... D, Section 152 of the Act, must be evaluated through the peer review process. (c) Panels must be...

40 CFR 194.27 - Peer review.

Code of Federal Regulations, 2010 CFR

2010-07-01

... 40 Protection of Environment 24 2010-07-01 2010-07-01 false Peer review. 194.27 Section 194.27... § 194.27 Peer review. (a) Any compliance application shall include documentation of peer review that has... barrier evaluation as required in § 194.44. (b) Peer review processes required in paragraph (a) of this...

Peer Collaboration: Improving Teaching through Comprehensive Peer Review

ERIC Educational Resources Information Center

Smith, Shelley L.

2014-01-01

This article includes a brief rationale and review of the literature on peer review of teaching (PRT). Based on that literature review, it offers a proposal for an optimal formative review process that results in a teaching portfolio that would reflect a faculty member's efforts and successes in a critically reflective PRT process, and contributes…

28 CFR 34.102 - Peer review procedures.

Code of Federal Regulations, 2011 CFR

2011-07-01

... 28 Judicial Administration 1 2011-07-01 2011-07-01 false Peer review procedures. 34.102 Section 34.102 Judicial Administration DEPARTMENT OF JUSTICE OJJDP COMPETITION AND PEER REVIEW PROCEDURES Peer... substantive and procedural matters related to the peer review process, the “Guideline” addresses such issues...

28 CFR 34.102 - Peer review procedures.

Code of Federal Regulations, 2014 CFR

2014-07-01

... 28 Judicial Administration 1 2014-07-01 2014-07-01 false Peer review procedures. 34.102 Section 34.102 Judicial Administration DEPARTMENT OF JUSTICE OJJDP COMPETITION AND PEER REVIEW PROCEDURES Peer... substantive and procedural matters related to the peer review process, the “Guideline” addresses such issues...

28 CFR 34.102 - Peer review procedures.

Code of Federal Regulations, 2012 CFR

2012-07-01

... 28 Judicial Administration 1 2012-07-01 2012-07-01 false Peer review procedures. 34.102 Section 34.102 Judicial Administration DEPARTMENT OF JUSTICE OJJDP COMPETITION AND PEER REVIEW PROCEDURES Peer... substantive and procedural matters related to the peer review process, the “Guideline” addresses such issues...

28 CFR 34.102 - Peer review procedures.

Code of Federal Regulations, 2013 CFR

2013-07-01

... 28 Judicial Administration 1 2013-07-01 2013-07-01 false Peer review procedures. 34.102 Section 34.102 Judicial Administration DEPARTMENT OF JUSTICE OJJDP COMPETITION AND PEER REVIEW PROCEDURES Peer... substantive and procedural matters related to the peer review process, the “Guideline” addresses such issues...

28 CFR 34.108 - Selection of reviewers.

Code of Federal Regulations, 2010 CFR

2010-07-01

....108 Judicial Administration DEPARTMENT OF JUSTICE OJJDP COMPETITION AND PEER REVIEW PROCEDURES Peer Review § 34.108 Selection of reviewers. The Program Manager, through the Director of the OJJDP program... by the Administrator. The selection process for peer reviewers is detailed in the OJJDP “Peer Review...

Designing a strategy to promote safe, innovative off-label use of medications.

PubMed

Ansani, Nicole; Sirio, Carl; Smitherman, Thomas; Fedutes-Henderson, Bethany; Skledar, Susan; Weber, Robert J; Zgheib, Nathalie; Branch, Robert

2006-01-01

Innovative off-label medication use (defined as prescribing with reasonable rationale for use, but insufficient evidence to allay safety, efficacy, and cost-effectiveness concerns, yet is not clinical research) is common practice and provides challenges to ensuring high-quality health care and patient safety. This article describes a strategy to promote policy and standardization of innovative off-label medication use, ensure oversight of patient safety, and prospectively assess efficacy. A multidisciplinary group developed a policy and process to regulate innovative off-label medication use that standardizes formulary review, maximizes peer expertise input, and minimizes institution liability by evaluating the effectiveness of use, promoting evidence-based practices, and ensuring ethical obligations to patients and society. This strategy has been implemented through institutional staff structure. The review process balances benefits/risks for biologically plausible therapy that lacks rigorous data support. The authors' strategy illustrates collaboration that enables a priori consideration for innovative off-label medication use while providing safety surveillance and outcomes monitoring.

Clinical perspective: creating an effective practice peer review process-a primer.

PubMed

Gandhi, Manisha; Louis, Frances S; Wilson, Shae H; Clark, Steven L

2017-03-01

Peer review serves as an important adjunct to other hospital quality and safety programs. Despite its importance, the available literature contains virtually no guidance regarding the structure and function of effective peer review committees. This Clinical Perspective provides a summary of the purposes, structure, and functioning of effective peer review committees. We also discuss important legal considerations that are a necessary component of such processes. This discussion includes useful templates for case selection and review. Proper committee structure, membership, work flow, and leadership as well as close cooperation with the hospital medical executive committee and legal representatives are essential to any effective peer review process. A thoughtful, fair, systematic, and organized approach to creating a peer review process will lead to confidence in the committee by providers, hospital leadership, and patients. If properly constructed, such committees may also assist in monitoring and enforcing compliance with departmental protocols, thus reducing harm and promoting high-quality practice. Copyright © 2016 Elsevier Inc. All rights reserved.

Why Participate in Peer Review as a Journal Manuscript Reviewer: What's in It for You?

PubMed

Pytynia, Kristen B

2017-06-01

The peer review process for scientific journals relies on the efforts of volunteer reviewers. Reviewers are selected due to their expertise in their fields. With so many demands on professional time, the benefits of participating in peer review may not be obvious. However, reviewers benefit by exposure to the latest developments in their fields, facilitating their keeping up-to-date with the latest publications. Tenure committees look favorably on participation in peer review, and invitations to review underscore that the reviewer is a respected subject matter expert. Contacts made during the peer review process can lead to long-lasting collaboration. Continuing medical education credit can be obtained through various mechanisms. Overall, participating in peer review is an important part of career development and should be viewed as a critical component of advancement.

Quality Control and Peer Review of Data Sets: Mapping Data Archiving Processes to Data Publication Requirements

NASA Astrophysics Data System (ADS)

Mayernik, M. S.; Daniels, M.; Eaker, C.; Strand, G.; Williams, S. F.; Worley, S. J.

2012-12-01

Data sets exist within scientific research and knowledge networks as both technical and non-technical entities. Establishing the quality of data sets is a multi-faceted task that encompasses many automated and manual processes. Data sets have always been essential for science research, but now need to be more visible as first-class scholarly objects at national, international, and local levels. Many initiatives are establishing procedures to publish and curate data sets, as well as to promote professional rewards for researchers that collect, create, manage, and preserve data sets. Traditionally, research quality has been assessed by peer review of textual publications, e.g. journal articles, conference proceedings, and books. Citation indices then provide standard measures of productivity used to reward individuals for their peer-reviewed work. Whether a similar peer review process is appropriate for assessing and ensuring the quality of data sets remains as an open question. How does the traditional process of peer review apply to data sets? This presentation will describe current work being done at the National Center for Atmospheric Research (NCAR) in the context of the Peer REview for Publication & Accreditation of Research Data in the Earth sciences (PREPARDE) project. PREPARDE is assessing practices and processes for data peer review, with the goal of developing recommendations. NCAR data management teams perform various kinds of quality assessment and review of data sets prior to making them publicly available. The poster will investigate how notions of peer review relate to the types of data review already in place at NCAR. We highlight the data set characteristics and management/archiving processes that challenge the traditional peer review processes by using a number of questions as probes, including: Who is qualified to review data sets? What formal and informal documentation is necessary to allow someone outside of a research team to review a data set? What data set review can be done pre-publication, and what must be done post-publication? What components of the data sets review processes can be automated, and what components will always require human expertise and evaluation?

Promoting International Energy Security. Volume 2: Turkey and the Caspian

DTIC Science & Technology

2012-01-01

RAND reports un- dergo rigorous peer review to ensure that they meet high standards for research quality and objectivity. Promoting International...Russian invasion of Georgia in 2008 did not directly target energy infrastructure, most export routes for oil and natural gas from Azerbai- jan to...particular focus on the three countries with appreciable energy export potential: Azerbai- jan , Kazakhstan, and Turkmenistan. It also provides an

The ethics of peer review in bioethics.

PubMed

Wendler, David; Miller, Franklin

2014-10-01

A good deal has been written on the ethics of peer review, especially in the scientific and medical literatures. In contrast, we are unaware of any articles on the ethics of peer review in bioethics. Recognising this gap, we evaluate the extant proposals regarding ethical standards for peer review in general and consider how they apply to bioethics. We argue that scholars have an obligation to perform peer review based on the extent to which they personally benefit from the peer review process. We also argue, contrary to existing proposals and guidelines, that it can be appropriate for peer reviewers to benefit in their own scholarship from the manuscripts they review. With respect to bioethics in particular, we endorse double-blind review and suggest several ways in which the peer review process might be improved. Published by the BMJ Publishing Group Limited. For permission to use (where not already granted under a licence) please go to http://group.bmj.com/group/rights-licensing/permissions.

Tardive Dyskinesia

MedlinePlus

... Supplements Peer Review Process Review Committees Application Support Library Clinical Research Next Steps Pre-Funding: After Review Terms of ... Supplements Peer Review Process Review Committees Application Support Library Clinical Research Next Steps Pre-Funding: After Review Terms of ...

Hemicrania Continua

MedlinePlus

... Supplements Peer Review Process Review Committees Application Support Library Clinical Research Next Steps Pre-Funding: After Review Terms of ... Supplements Peer Review Process Review Committees Application Support Library Clinical Research Next Steps Pre-Funding: After Review Terms of ...

Benign Essential Blepharospasm

MedlinePlus

... Supplements Peer Review Process Review Committees Application Support Library Clinical Research Next Steps Pre-Funding: After Review Terms of ... Supplements Peer Review Process Review Committees Application Support Library Clinical Research Next Steps Pre-Funding: After Review Terms of ...

What makes a phenomenological study phenomenological? An analysis of peer-reviewed empirical nursing studies.

PubMed

Norlyk, Annelise; Harder, Ingegerd

2010-03-01

This article contributes to the debate about phenomenology as a research approach in nursing by providing a systematic review of what nurse researchers hold as phenomenology in published empirical studies. Based on the assumption that presentations of phenomenological approaches in peer-reviewed journals have consequences for the quality of future research, the aim was to analyze articles presenting phenomenological studies and, in light of the findings, raise a discussion about addressing scientific criteria. The analysis revealed considerable variations, ranging from brief to detailed descriptions of the stated phenomenological approach, and from inconsistencies to methodological clarity and rigor. Variations, apparent inconsistencies, and omissions made it unclear what makes a phenomenological study phenomenological. There is a need for clarifying how the principles of the phenomenological philosophy are implemented in a particular study before publishing. This should include an articulation of methodological keywords of the investigated phenomenon, and how an open attitude was adopted.

Peer Contexts in Schools: Avenues Toward Behavioral Health in Early Adolescence.

PubMed

Cappella, Elise; Hwang, Sophia H J

2015-01-01

Peer contexts play an important role in the behavioral health of early adolescents in schools. Behavioral health involves the observable academic and social behaviors that relate to and influence youths' subsequent health and development. Setting-level research on peer networks and social norms indicates these aspects of peer contexts vary by peer group, classroom, and school and dynamically relate to individual students' academic and social behaviors. Yet, although peer contexts are both influential and potentially malleable, little research examines the effects of school and classroom interventions on the development and maintenance of positive and productive peer contexts in schools. The current article identifies school structures and classroom processes theorized to directly or indirectly shift peer networks and social norms-and thereby increase the behavioral health of early adolescents in schools. We discuss the need for more rigorous and relevant research to better understand the role of schools and classrooms in strengthening these peer contexts and promoting behavioral health in early adolescence.

Designing Peer Review for Pedagogical Success: What Can We Learn from Professional Science?

ERIC Educational Resources Information Center

Trautmann, Nancy M.

2009-01-01

This article compares peer review in professional versus education settings, summarizing key aspects of scientific peer review and reflecting on how these relate to the process as experienced by students. Consideration of professional peer review benefits educators in two ways. First, systems used for student peer review can employ some of the…

Navigating manuscript assessment: The new practitioner's guide to primary literature peer review.

PubMed

Smith, Devlin V; Stokes, Laura B; Marx, Kayleigh; Aitken, Samuel L

2018-01-01

For pharmacists, the first years after graduation are spent developing their knowledge base, advancing as a practitioner, and honing their abilities as healthcare providers and drug information experts. New practitioners encounter many challenges during this time, which for many include publishing original research or reviewing manuscripts for colleagues and medical journals. Inexperience navigating the publication process, from submission to receipt of (and response to) peer review commentary, is often cited as a major barrier to timely publication of resident and new practitioner research. Serving as a peer reviewer in turn provides the new practitioner with insight on this process and can be an enlightening experience used to garner confidence in subsequently submitting their own formal manuscripts. A number of publications describing steps for peer review are available, however, many of these articles address more experienced reviewers or critique the peer review process itself. No definitive resource exists for new pharmacy practitioners interested in developing their peer review skills. The information presented in this summative guide should be used in conjunction with practice opportunities to help new practitioners develop proficiency at peer review.

The effects of an editor serving as one of the reviewers during the peer-review process.

PubMed

Giordan, Marco; Csikasz-Nagy, Attila; Collings, Andrew M; Vaggi, Federico

2016-01-01

Background Publishing in scientific journals is one of the most important ways in which scientists disseminate research to their peers and to the wider public. Pre-publication peer review underpins this process, but peer review is subject to various criticisms and is under pressure from growth in the number of scientific publications. Methods Here we examine an element of the editorial process at eLife , in which the Reviewing Editor usually serves as one of the referees, to see what effect this has on decision times, decision type, and the number of citations. We analysed a dataset of 8,905 research submissions to eLife since June 2012, of which 2,747 were sent for peer review. This subset of 2747 papers was then analysed in detail.   Results The Reviewing Editor serving as one of the peer reviewers results in faster decision times on average, with the time to final decision ten days faster for accepted submissions (n=1,405) and five days faster for papers that were rejected after peer review (n=1,099). Moreover, editors acting as reviewers had no effect on whether submissions were accepted or rejected, and a very small (but significant) effect on citation rates. Conclusions An important aspect of eLife 's peer-review process is shown to be effective, given that decision times are faster when the Reviewing Editor serves as a reviewer. Other journals hoping to improve decision times could consider adopting a similar approach.

Online Radiology Reporting with Peer Review as a Learning and Feedback Tool in Radiology; Implementation, Validity, and Student Impressions.

PubMed

McEvoy, Fintan J; Shen, Nicholas W; Nielsen, Dorte H; Buelund, Lene E; Holm, Peter

2017-02-01

Communicating radiological reports to peers has pedagogical value. Students may be uneasy with the process due to a lack of communication and peer review skills or to their failure to see value in the process. We describe a communication exercise with peer review in an undergraduate veterinary radiology course. The computer code used to manage the course and deliver images online is reported, and we provide links to the executable files. We tested to see if undergraduate peer review of radiological reports has validity and describe student impressions of the learning process. Peer review scores for student-generated radiological reports were compared to scores obtained in the summative multiple choice (MCQ) examination for the course. Student satisfaction was measured using a bespoke questionnaire. There was a weak positive correlation (Pearson correlation coefficient = 0.32, p < 0.01) between peer review scores students received and the student scores obtained in the MCQ examination. The difference in peer review scores received by students grouped according to their level of course performance (high vs. low) was statistically significant (p < 0.05). No correlation was found between peer review scores awarded by the students and the scores they obtained in the MCQ examination (Pearson correlation coefficient = 0.17, p = 0.14). In conclusion, we have created a realistic radiology imaging exercise with readily available software. The peer review scores are valid in that to a limited degree they reflect student future performance in an examination. Students valued the process of learning to communicate radiological findings but do not fully appreciated the value of peer review.

Peer Review and Surgical Innovation: Robotic Surgery and Its Hurdles.

PubMed

Vyas, Dinesh; Cronin, Sean

2015-12-01

The peer review processes as outlined in the Health Care Quality Improvement Act (HCQIA) is meant ensure quality standard of care through a self-policing mechanism by the medical community. This process grants immunity for people filing a peer review, which is meant to protect whistleblowers. However, it also creates a loophole that can be used maliciously to hinder competition. This is accentuated when surgeons are integrating new technologies, such as robotic surgery, into their practice. With more than 2000 da Vinci robots in use and more than 300 new units being shipped each year, robotic surgery has become a mainstay in the surgical field. The applications for robots continue to expand as surgeons discover their expanding capability. We need a better peer review process. That ensures the peer review is void of competitive bias. Peer reviewers need to be familiar with the procedure and the technology. The current process could stymie innovation in the name of competition.

Peer Review Improves the Quality of MCQ Examinations

ERIC Educational Resources Information Center

Malau-Aduli, Bunmi S.; Zimitat, Craig

2012-01-01

The aim of this study was to assess the effect of the introduction of peer review processes on the quality of multiple-choice examinations in the first three years of an Australian medical course. The impact of the peer review process and overall quality assurance (QA) processes were evaluated by comparing the examination data generated in earlier…

A peer review process as part of the implementation of clinical pathways in radiation oncology: Does it improve compliance?

PubMed

Gebhardt, Brian J; Heron, Dwight E; Beriwal, Sushil

Clinical pathways are patient management plans that standardize evidence-based practices to ensure high-quality and cost-effective medical care. Implementation of a pathway is a collaborative process in our network, requiring the active involvement of physicians. This approach promotes acceptance of pathway recommendations, although a peer review process is necessary to ensure compliance and to capture and approve off-pathway selections. We investigated the peer review process and factors associated with time to completion of peer review. Our cancer center implemented radiation oncology pathways for every disease site throughout a large, integrated network. Recommendations are written based upon national guidelines, published literature, and institutional experience with evidence evaluated hierarchically in order of efficacy, toxicity, and then cost. Physicians enter decisions into an online, menu-driven decision support tool that integrates with medical records. Data were collected from the support tool and included the rate of on- and off-pathway selections, peer review decisions performed by disease site directors, and time to complete peer review. A total of 6965 treatment decisions were entered in 2015, and 605 (8.7%) were made off-pathway and were subject to peer review. The median time to peer review decision was 2 days (interquartile range, 0.2-6.8). Factors associated with time to peer review decision >48 hours on univariate analysis include disease site (P < .0001) with a trend toward significance (P = .066) for radiation therapy modality. There was no difference between recurrent and non-recurrent disease (P = .267). Multivariable analysis revealed disease site was associated with time to peer review (P < .001), with lymphoma and skin/sarcoma most strongly influencing decision time >48 hours. Clinical pathways are an integral tool for standardizing evidence-based care throughout our large, integrated network, with 91.3% of all treatment decisions being made as per pathway. The peer review process was feasible, with <1% selections ultimately rejected, suggesting that awareness of peer review of treatment decisions encourages compliance with clinical pathway recommendations. Copyright © 2017 American Society for Radiation Oncology. Published by Elsevier Inc. All rights reserved.

Systematic review of SMART Recovery: Outcomes, process variables, and implications for research.

PubMed

Beck, Alison K; Forbes, Erin; Baker, Amanda L; Kelly, Peter J; Deane, Frank P; Shakeshaft, Anthony; Hunt, David; Kelly, John F

2017-02-01

Clinical guidelines recommend Self-Management and Recovery Training (SMART Recovery) and 12-step models of mutual aid as important sources of long-term support for addiction recovery. Methodologically rigorous reviews of the efficacy and potential mechanisms of change are available for the predominant 12-step approach. A similarly rigorous exploration of SMART Recovery has yet to be undertaken. We aim to address this gap by providing a systematic overview of the evidence for SMART Recovery in adults with problematic alcohol, substance, and/or behavioral addiction, including (i) a commentary on outcomes assessed, process variables, feasibility, current understanding of mental health outcomes, and (ii) a critical evaluation of the methodology. We searched six electronic peer-reviewed and four gray literature databases for English-language SMART Recovery literature. Articles were classified, assessed against standardized criteria, and checked by an independent assessor. Twelve studies (including three evaluations of effectiveness) were identified. Alcohol-related outcomes were the primary focus. Standardized assessment of nonalcohol substance use was infrequent. Information about behavioral addiction was restricted to limited prevalence data. Functional outcomes were rarely reported. Feasibility was largely indexed by attendance. Economic analysis has not been undertaken. Little is known about the variables that may influence treatment outcome, but attendance represents a potential candidate. Assessment and reporting of mental health status was poor. Although positive effects were found, the modest sample and diversity of methods prevent us from making conclusive remarks about efficacy. Further research is needed to understand the clinical and public health utility of SMART as a viable recovery support option. (PsycINFO Database Record (c) 2017 APA, all rights reserved).

Acquiring Data by Mining the Past: Pairing Communities with Environmental Monitoring Methods through Open Online Collaborative Replication

NASA Astrophysics Data System (ADS)

Lippincott, M.; Lewis, E. S.; Gehrke, G. E.; Wise, A.; Pyle, S.; Sinatra, V.; Bland, G.; Bydlowski, D.; Henry, A.; Gilberts, P. A.

2016-12-01

Community groups are interested in low-cost sensors to monitor their environment. However, many new commercial sensors are unknown devices without peer-reviewed evaluations of data quality or pathways to regulatory acceptance, and the time to achieve these outcomes may be beyond a community's patience and attention. Rather than developing a device from scratch or validating a new commercial product, a workflow is presented whereby existing technologies, especially those that are out of patent, are replicated through open online collaboration between communities affected by environmental pollution, volunteers, academic institutions, and existing open hardware and open source software projects. Technology case studies will be presented, focusing primarily on a passive PM monitor based on the UNC Passive Monitor. Stages of the project will be detailed moving from identifying community needs, reviewing existing technology, partnership development, technology replication, IP review and licensing, data quality assurance (in process), and field evaluation with community partners (in process), with special attention to partnership development and technology review. We have leveraged open hardware and open source software to lower the cost and access barriers of existing technologies for PM10-2.5 and other atmospheric measures that have already been validated through peer review. Existing validation of and regulatory familiarity with a technology enables a rapid pathway towards collecting data, shortening the time it takes for communities to leverage data in environmental management decisions. Online collaboration requires rigorous documentation that aids in spreading research methods and promoting deep engagement by interested community researchers outside academia. At the same time, careful choice of technology and the use of small-scale fabrication through laser cutting, 3D printing, and open, shared repositories of plans and software enables educational engagement that broadens a project's reach.

Peer review versus editorial review and their role in innovative science.

PubMed

Steinhauser, Georg; Adlassnig, Wolfram; Risch, Jesaka Ahau; Anderlini, Serena; Arguriou, Petros; Armendariz, Aaron Zolen; Bains, William; Baker, Clark; Barnes, Martin; Barnett, Jonathan; Baumgartner, Michael; Baumgartner, Thomas; Bendall, Charles A; Bender, Yvonne S; Bichler, Max; Biermann, Teresa; Bini, Ronaldo; Blanco, Eduardo; Bleau, John; Brink, Anthony; Brown, Darin; Burghuber, Christopher; Calne, Roy; Carter, Brian; Castaño, Cesar; Celec, Peter; Celis, Maria Eugenia; Clarke, Nicky; Cockrell, David; Collins, David; Coogan, Brian; Craig, Jennifer; Crilly, Cal; Crowe, David; Csoka, Antonei B; Darwich, Chaza; Del Kebos, Topiciprin; Derinaldi, Michele; Dlamini, Bongani; Drewa, Tomasz; Dwyer, Michael; Eder, Fabienne; de Palma, Raúl Ehrichs; Esmay, Dean; Rött, Catherine Evans; Exley, Christopher; Falkov, Robin; Farber, Celia Ingrid; Fearn, William; Felsmann, Sophie; Flensmark, Jarl; Fletcher, Andrew K; Foster, Michaela; Fountoulakis, Kostas N; Fouratt, Jim; Blanca, Jesus Garcia; Sotelo, Manuel Garrido; Gittler, Florian; Gittler, Georg; Gomez, Juan; Gomez, Juan F; Polar, Maria Grazia Gonzales; Gonzalez, Jossina; Gösselsberger, Christoph; Habermacher, Lynn; Hajek, Michael; Hakala, Faith; Haliburton, Mary-Sue; Hankins, John Robert; Hart, Jason; Hasslberger, Sepp; Hennessey, Donalyn; Herrmann, Andrea; Hersee, Mike; Howard, Connie; Humphries, Suzanne; Isharc, Laeeth; Ivanovski, Petar; Jenuth, Stephen; Jerndal, Jens; Johnson, Christine; Keleta, Yonas; Kenny, Anna; Kidd, Billie; Kohle, Fritz; Kolahi, Jafar; Koller-Peroutka, Marianne; Kostova, Lyubov; Kumar, Arunachalam; Kurosawa, Alejandro; Lance, Tony; Lechermann, Michael; Lendl, Bernhard; Leuchters, Michael; Lewis, Evan; Lieb, Edward; Lloyd, Gloria; Losek, Angelika; Lu, Yao; Maestracci, Saadia; Mangan, Dennis; Mares, Alberto W; Barnett, Juan Mazar; McClain, Valerie; McNair, John Sydney; Michael, Terry; Miller, Lloyd; Monzani, Partizia; Moran, Belen; Morris, Mike; Mößmer, Georg; Mountain, Johny; Phuthe, Onnie Mary Moyo; Muñoz, Marcos; Nakken, Sheri; Wambui, Anne Nduta; Neunteufl, Bettina; Nikolić, Dimitrije; Oberoi, Devesh V; Obmode, Gregory; Ogar, Laura; Ohara, Jo; Rybine, Naion Olej; Owen, Bryan; Owen, Kim Wilson; Parikh, Rakesh; Pearce, Nicholas J G; Pemmer, Bernhard; Piper, Chris; Prince, Ian; Reid, Terence; Rindermann, Heiner; Risch, Stefan; Robbins, Josh; Roberts, Seth; Romero, Ajeandro; Rothe, Michael Thaddäus; Ruiz, Sergio; Sacher, Juliane; Sackl, Wolfgang; Salletmaier, Markus; Sanand, Jairaj; Sauerzopf, Clemens; Schwarzgruber, Thomas; Scott, David; Seegers, Laura; Seppi, David; Shields, Kyle; Siller-Matula, Jolanta; Singh, Beldeu; Sithole, Sibusio; Six, Florian; Skoyles, John R; Slofstra, Jildou; Sole, Daphne Anne; Sommer, Werner F; Sonko, Mels; Starr-Casanova, Chrislie J; Steakley, Marjorie Elizabeth; Steinhauser, Wolfgang; Steinhoff, Konstantin; Sterba, Johannes H; Steppan, Martin; Stindl, Reinhard; Stokely, Joe; Stokely, Karri; St-Pierre, Gilles; Stratford, James; Streli, Christina; Stryg, Carl; Sullivan, Mike; Summhammer, Johann; Tadesse, Amhayes; Tavares, David; Thompson, Laura; Tomlinson, Alison; Tozer, Jack; Trevisanato, Siro I; Trimmel, Michaela; Turner, Nicole; Vahur, Paul; van der Byl, Jennie; van der Maas, Tine; Varela, Leo; Vega, Carlos A; Vermaak, Shiloh; Villasenor, Alex; Vogel, Matt; von Wintzigerode, Georg; Wagner, Christoph; Weinberger, Manuel; Weinberger, Peter; Wilson, Nick; Wolfe, Jennifer Finocchio; Woodley, Michael A; Young, Ian; Zuraw, Glenn; Zwiren, Nicole

2012-10-01

Peer review is a widely accepted instrument for raising the quality of science. Peer review limits the enormous unstructured influx of information and the sheer amount of dubious data, which in its absence would plunge science into chaos. In particular, peer review offers the benefit of eliminating papers that suffer from poor craftsmanship or methodological shortcomings, especially in the experimental sciences. However, we believe that peer review is not always appropriate for the evaluation of controversial hypothetical science. We argue that the process of peer review can be prone to bias towards ideas that affirm the prior convictions of reviewers and against innovation and radical new ideas. Innovative hypotheses are thus highly vulnerable to being "filtered out" or made to accord with conventional wisdom by the peer review process. Consequently, having introduced peer review, the Elsevier journal Medical Hypotheses may be unable to continue its tradition as a radical journal allowing discussion of improbable or unconventional ideas. Hence we conclude by asking the publisher to consider re-introducing the system of editorial review to Medical Hypotheses.

Gender bias in scholarly peer review.

PubMed

Helmer, Markus; Schottdorf, Manuel; Neef, Andreas; Battaglia, Demian

2017-03-21

Peer review is the cornerstone of scholarly publishing and it is essential that peer reviewers are appointed on the basis of their expertise alone. However, it is difficult to check for any bias in the peer-review process because the identity of peer reviewers generally remains confidential. Here, using public information about the identities of 9000 editors and 43000 reviewers from the Frontiers series of journals, we show that women are underrepresented in the peer-review process, that editors of both genders operate with substantial same-gender preference (homophily), and that the mechanisms of this homophily are gender-dependent. We also show that homophily will persist even if numerical parity between genders is reached, highlighting the need for increased efforts to combat subtler forms of gender bias in scholarly publishing.

Peer review of health research funding proposals: A systematic map and systematic review of innovations for effectiveness and efficiency

PubMed Central

Frampton, Geoff K.; Pickett, Karen; Wyatt, Jeremy C.

2018-01-01

Objective To investigate methods and processes for timely, efficient and good quality peer review of research funding proposals in health. Methods A two-stage evidence synthesis: (1) a systematic map to describe the key characteristics of the evidence base, followed by (2) a systematic review of the studies stakeholders prioritised as relevant from the map on the effectiveness and efficiency of peer review ‘innovations’. Standard processes included literature searching, duplicate inclusion criteria screening, study keyword coding, data extraction, critical appraisal and study synthesis. Results A total of 83 studies from 15 countries were included in the systematic map. The evidence base is diverse, investigating many aspects of the systems for, and processes of, peer review. The systematic review included eight studies from Australia, Canada, and the USA, evaluating a broad range of peer review innovations. These studies showed that simplifying the process by shortening proposal forms, using smaller reviewer panels, or expediting processes can speed up the review process and reduce costs, but this might come at the expense of peer review quality, a key aspect that has not been assessed. Virtual peer review using videoconferencing or teleconferencing appears promising for reducing costs by avoiding the need for reviewers to travel, but again any consequences for quality have not been adequately assessed. Conclusions There is increasing international research activity into the peer review of health research funding. The studies reviewed had methodological limitations and variable generalisability to research funders. Given these limitations it is not currently possible to recommend immediate implementation of these innovations. However, many appear promising based on existing evidence, and could be adapted as necessary by funders and evaluated. Where feasible, experimental evaluation, including randomised controlled trials, should be conducted, evaluating impact on effectiveness, efficiency and quality. PMID:29750807

Information Quality in Regulatory Decision Making: Peer Review versus Good Laboratory Practice.

PubMed

McCarty, Lynn S; Borgert, Christopher J; Mihaich, Ellen M

2012-07-01

There is an ongoing discussion on the provenance of toxicity testing data regarding how best to ensure its validity and credibility. A central argument is whether journal peer-review procedures are superior to Good Laboratory Practice (GLP) standards employed for compliance with regulatory mandates. We sought to evaluate the rationale for regulatory decision making based on peer-review procedures versus GLP standards. We examined pertinent published literature regarding how scientific data quality and validity are evaluated for peer review, GLP compliance, and development of regulations. Some contend that peer review is a coherent, consistent evaluative procedure providing quality control for experimental data generation, analysis, and reporting sufficient to reliably establish relative merit, whereas GLP is seen as merely a tracking process designed to thwart investigator corruption. This view is not supported by published analyses pointing to subjectivity and variability in peer-review processes. Although GLP is not designed to establish relative merit, it is an internationally accepted quality assurance, quality control method for documenting experimental conduct and data. Neither process is completely sufficient for establishing relative scientific soundness. However, changes occurring both in peer-review processes and in regulatory guidance resulting in clearer, more transparent communication of scientific information point to an emerging convergence in ensuring information quality. The solution to determining relative merit lies in developing a well-documented, generally accepted weight-of-evidence scheme to evaluate both peer-reviewed and GLP information used in regulatory decision making where both merit and specific relevance inform the process.

Cooperation between referees and authors increases peer review accuracy.

PubMed

Leek, Jeffrey T; Taub, Margaret A; Pineda, Fernando J

2011-01-01

Peer review is fundamentally a cooperative process between scientists in a community who agree to review each other's work in an unbiased fashion. Peer review is the foundation for decisions concerning publication in journals, awarding of grants, and academic promotion. Here we perform a laboratory study of open and closed peer review based on an online game. We show that when reviewer behavior was made public under open review, reviewers were rewarded for refereeing and formed significantly more cooperative interactions (13% increase in cooperation, P = 0.018). We also show that referees and authors who participated in cooperative interactions had an 11% higher reviewing accuracy rate (P = 0.016). Our results suggest that increasing cooperation in the peer review process can lead to a decreased risk of reviewing errors.

Doing a Good Deed or Confounding the Problem? Peer Review and Sociology Textbooks.

ERIC Educational Resources Information Center

Kendall, Diana

1999-01-01

Examines how the peer review process influences the writing and publication of sociology textbooks and the teaching of sociology. States that the peer review process may influence the final textbook in five ways: (1) degree of innovation; (2) length; (3) reading level; (4) cloning ancillaries and accessories; and (5) using reviewers as marketing…

The mechanisms underpinning peer support: a literature review.

PubMed

Watson, Emma

2017-12-20

The employment of Peer Support Workers, who themselves have experience of significant emotional distress, can promote recovery at an individual and organisational level. While research examining the benefits of peer support within mental health services continues to grow, an understanding of how, and through what processes, these benefits are reached remains under-developed. To review the published research literature relating to the process of peer support and its underpinning mechanisms to better understand how and why it works. A scoping review of published literature identified studies relating to peer support mechanisms, processes and relationships. Studies were summarised and findings analysed. Five mechanisms were found to underpin peer support relationships (lived experience, love labour, the liminal position of the peer worker, strengths-focussed social and practical support, and the helper role). The identified mechanisms can underpin both the success and difficulties associated with peer support relationships. Further research should review a broader range of literature and clarify how these mechanisms contribute to peer support in different contexts.

On the evolving open peer review culture for chemical information science.

PubMed

Walters, W Patrick; Bajorath, Jürgen

2015-01-01

Compared to the traditional anonymous peer review process, open post-publication peer review provides additional opportunities -and challenges- for reviewers to judge scientific studies. In this editorial, we comment on the open peer review culture and provide some guidance for reviewers of manuscripts submitted to the Chemical Information Science channel of F1000Research.

Beyond Homophily: A Decade of Advances in Understanding Peer Influence Processes.

PubMed

Brechwald, Whitney A; Prinstein, Mitchell J

2011-03-01

This article reviews empirical and theoretical contributions to a multidisciplinary understanding of peer influence processes in adolescence over the past decade. Five themes of peer influence research from this decade were identified, including a broadening of the range of behaviors for which peer influence occurs, distinguishing the sources of influence, probing the conditions under which influence is amplified/attenuated (moderators), testing theoretically based models of peer influence processes (mechanisms), and preliminary exploration of behavioral neuroscience perspectives on peer influence. This review highlights advances in each of these areas, underscores gaps in current knowledge of peer influence processes, and outlines important challenges for future research.

Beyond Homophily: A Decade of Advances in Understanding Peer Influence Processes

PubMed Central

Brechwald, Whitney A.; Prinstein, Mitchell J.

2013-01-01

This article reviews empirical and theoretical contributions to a multidisciplinary understanding of peer influence processes in adolescence over the past decade. Five themes of peer influence research from this decade were identified, including a broadening of the range of behaviors for which peer influence occurs, distinguishing the sources of influence, probing the conditions under which influence is amplified/attenuated (moderators), testing theoretically based models of peer influence processes (mechanisms), and preliminary exploration of behavioral neuroscience perspectives on peer influence. This review highlights advances in each of these areas, underscores gaps in current knowledge of peer influence processes, and outlines important challenges for future research. PMID:23730122

Rethinking Feedback Practices in Higher Education: A Peer Review Perspective

ERIC Educational Resources Information Center

Nicol, David; Thomson, Avril; Breslin, Caroline

2014-01-01

Peer review is a reciprocal process whereby students produce feedback reviews on the work of peers and receive feedback reviews from peers on their own work. Prior research has primarily examined the learning benefits that result from the receipt of feedback reviews, with few studies specifically exploring the merits of producing feedback reviews…

Misfortunes of War. Press and Public Reactions to Civilian Deaths in Wartime

DTIC Science & Technology

2006-01-01

Although declines in reporting were evident even before the incident, the shootings at Columbine High School in Littleton, Colorado, on April 20...RAND mono- graphs undergo rigorous peer review to ensure high standards for research quality and objectivity. Prepared for the United States Air Force...189 5.13. High -Altitude Diagram Used by MG McChrystal. . . . . . . . . . . . 193 5.14. Reporting on Civilian Casualties, Marketplace Incident

Using EPIC to Find Conflicts, Inconsistencies, and Gaps in Department of Defense Policies

DTIC Science & Technology

2013-01-01

documentation; or deliver preliminary findings. All RAND reports un- dergo rigorous peer review to ensure that they meet high standards for research quality...responsibilities and the products that result from their execution. Once the high -level frame- work was defined, successive lower layers were developed to further...Lead or Chief Engineer Component Acquisition Executive ( CAE ) Managers Configuration Steering Board Materiel developer Contractor Milestone Decision

The JSC Engineering Directorate Product Peer Review Process

NASA Technical Reports Server (NTRS)

Jenks, Kenneth C.

2009-01-01

The JSC Engineering Directorate has developed a Product Peer Review process in support of NASA policies for project management and systems engineering. The process complies with the requirements of NPR 7120.5, NPR 7123.1 and NPR 7150.2 and follows the guidance in NASA/SP-2007-6105. This presentation will give an overview of the process followed by a brief demonstration of an actual peer review, with audience participation.

Writing to Learn: An Evaluation of the Calibrated Peer Review™ Program in Two Neuroscience Courses

PubMed Central

Prichard, J. Roxanne

2005-01-01

Although the majority of scientific information is communicated in written form, and peer review is the primary process by which it is validated, undergraduate students may receive little direct training in science writing or peer review. Here, I describe the use of Calibrated Peer Review™ (CPR), a free, web-based writing and peer review program designed to alleviate instructor workload, in two undergraduate neuroscience courses: an upper- level sensation and perception course (41 students, three assignments) and an introductory neuroscience course (50 students; two assignments). Using CPR online, students reviewed primary research articles on assigned ‘hot’ topics, wrote short essays in response to specific guiding questions, reviewed standard ‘calibration’ essays, and provided anonymous quantitative and qualitative peer reviews. An automated grading system calculated the final scores based on a student’s essay quality (as determined by the average of three peer reviews) and his or her accuracy in evaluating 1) three standard calibration essays, 2) three anonymous peer reviews, and 3) his or her self review. Thus, students were assessed not only on their skill at constructing logical, evidence-based arguments, but also on their ability to accurately evaluate their peers’ writing. According to both student self-reports and instructor observation, students’ writing and peer review skills improved over the course of the semester. Student evaluation of the CPR program was mixed; while some students felt like the peer review process enhanced their understanding of the material and improved their writing, others felt as though the process was biased and required too much time. Despite student critiques of the program, I still recommend the CPR program as an excellent and free resource for incorporating more writing, peer review, and critical thinking into an undergraduate neuroscience curriculum. PMID:23493247

Expanding Group Peer Review: A Proposal for Medical Education Scholarship.

PubMed

Dumenco, Luba; Engle, Deborah L; Goodell, Kristen; Nagler, Alisa; Ovitsh, Robin K; Whicker, Shari A

2017-02-01

After participating in a group peer-review exercise at a workshop presented by Academic Medicine and MedEdPORTAL editors at the 2015 Association of American Medical Colleges Medical Education Meeting, the authors realized that the way their work group reviewed a manuscript was very different from the way by which they each would have reviewed the paper as an individual. Further, the group peer-review process yielded more robust feedback for the manuscript's authors than did the traditional individual peer-review process. This realization motivated the authors to reconvene and collaborate to write this Commentary to share their experience and propose the expanded use of group peer review in medical education scholarship.The authors consider the benefits of a peer-review process for reviewers, including learning how to improve their own manuscripts. They suggest that the benefits of a team review model may be similar to those of teamwork and team-based learning in medicine and medical education. They call for research to investigate this, to provide evidence to support group review, and to determine whether specific paper types would benefit most from team review (e.g., particularly complex manuscripts, those receiving widely disparate initial individual reviews). In addition, the authors propose ways in which a team-based approach to peer review could be expanded by journals and institutions. They believe that exploring the use of group peer review potentially could create a new methodology for skill development in research and scholarly writing and could enhance the quality of medical education scholarship.

The evolution of peer review as a basis for scientific publication: directional selection towards a robust discipline?

PubMed

Ferreira, Catarina; Bastille-Rousseau, Guillaume; Bennett, Amanda M; Ellington, E Hance; Terwissen, Christine; Austin, Cayla; Borlestean, Adrian; Boudreau, Melanie R; Chan, Kevin; Forsythe, Adrian; Hossie, Thomas J; Landolt, Kristen; Longhi, Jessica; Otis, Josée-Anne; Peers, Michael J L; Rae, Jason; Seguin, Jacob; Watt, Cristen; Wehtje, Morgan; Murray, Dennis L

2016-08-01

Peer review is pivotal to science and academia, as it represents a widely accepted strategy for ensuring quality control in scientific research. Yet, the peer-review system is poorly adapted to recent changes in the discipline and current societal needs. We provide historical context for the cultural lag that governs peer review that has eventually led to the system's current structural weaknesses (voluntary review, unstandardized review criteria, decentralized process). We argue that some current attempts to upgrade or otherwise modify the peer-review system are merely sticking-plaster solutions to these fundamental flaws, and therefore are unlikely to resolve them in the long term. We claim that for peer review to be relevant, effective, and contemporary with today's publishing demands across scientific disciplines, its main components need to be redesigned. We propose directional changes that are likely to improve the quality, rigour, and timeliness of peer review, and thereby ensure that this critical process serves the community it was created for. © 2015 Cambridge Philosophical Society.

Peering into peer-review at GigaScience.

PubMed

Edmunds, Scott C

2013-01-24

Fostering and promoting more open and transparent science is one of the goals of GigaScience. One of the ways we have been doing this is by throwing light on the peer-review process and carrying out open peer-review as standard. In this editorial, we provide our rationale for undertaking this policy, give examples of our positive experiences to date, and encourage others to open up the normally opaque publication process.

'Are you siding with a personality or the grant proposal?': observations on how peer review panels function.

PubMed

Coveney, John; Herbert, Danielle L; Hill, Kathy; Mow, Karen E; Graves, Nicholas; Barnett, Adrian

2017-01-01

In Australia, the peer review process for competitive funding is usually conducted by a peer review group in conjunction with prior assessment from external assessors. This process is quite mysterious to those outside it. The purpose of this research was to throw light on grant review panels (sometimes called the 'black box') through an examination of the impact of panel procedures, panel composition and panel dynamics on the decision-making in the grant review process. A further purpose was to compare experience of a simplified review process with more conventional processes used in assessing grant proposals in Australia. This project was one aspect of a larger study into the costs and benefits of a simplified peer review process. The Queensland University of Technology (QUT)-simplified process was compared with the National Health and Medical Research Council's (NHMRC) more complex process. Grant review panellists involved in both processes were interviewed about their experience of the decision-making process that assesses the excellence of an application. All interviews were recorded and transcribed. Each transcription was de-identified and returned to the respondent for review. Final transcripts were read repeatedly and coded, and similar codes were amalgamated into categories that were used to build themes. Final themes were shared with the research team for feedback. Two major themes arose from the research: (1) assessing grant proposals and (2) factors influencing the fairness, integrity and objectivity of review. Issues such as the quality of writing in a grant proposal, comparison of the two review methods, the purpose and use of the rebuttal, assessing the financial value of funded projects, the importance of the experience of the panel membership and the role of track record and the impact of group dynamics on the review process were all discussed. The research also examined the influence of research culture on decision-making in grant review panels. One of the aims of this study was to compare a simplified review process with more conventional processes. Generally, participants were supportive of the simplified process. Transparency in the grant review process will result in better appreciation of the outcome. Despite the provision of clear guidelines for peer review, reviewing processes are likely to be subjective to the extent that different reviewers apply different rules. The peer review process will come under more scrutiny as funding for research becomes even more competitive. There is justification for further research on the process, especially of a kind that taps more deeply into the 'black box' of peer review.

Gender bias in scholarly peer review

PubMed Central

Helmer, Markus; Schottdorf, Manuel; Neef, Andreas; Battaglia, Demian

2017-01-01

Peer review is the cornerstone of scholarly publishing and it is essential that peer reviewers are appointed on the basis of their expertise alone. However, it is difficult to check for any bias in the peer-review process because the identity of peer reviewers generally remains confidential. Here, using public information about the identities of 9000 editors and 43000 reviewers from the Frontiers series of journals, we show that women are underrepresented in the peer-review process, that editors of both genders operate with substantial same-gender preference (homophily), and that the mechanisms of this homophily are gender-dependent. We also show that homophily will persist even if numerical parity between genders is reached, highlighting the need for increased efforts to combat subtler forms of gender bias in scholarly publishing. DOI: http://dx.doi.org/10.7554/eLife.21718.001 PMID:28322725

Most Courses Are Not Born Digital: An Overview of the Quality Matters Peer Review Process for Online Course Design

ERIC Educational Resources Information Center

Varonis, Evageline Marlos

2014-01-01

Purpose: The purpose of this paper is to discuss benefits of and barriers to online learning and describe utilization of the Quality Matters (QM) peer review process as a method to assure the quality of online courses. It outlines the QM higher education rubric, explains how the collaborative QM peer review process facilitates online course design…

Collaborative Learning through Formative Peer Review: Pedagogy, Programs and Potential

ERIC Educational Resources Information Center

Sondergaard, Harald; Mulder, Raoul A.

2012-01-01

We examine student peer review, with an emphasis on formative practice and collaborative learning, rather than peer grading. Opportunities to engage students in such formative peer assessment are growing, as a range of online tools become available to manage and simplify the process of administering student peer review. We consider whether…

Original Research and Peer Review Using Web-Based Collaborative Tools by College Students

ERIC Educational Resources Information Center

Cakir, Mustafa; Carlsen, William S.

2007-01-01

The Environmental Inquiry program supports inquiry based, student-centered science teaching on selected topics in the environmental sciences. Many teachers are unfamiliar with both the underlying science of toxicology, and the process and importance of peer review in scientific method. The protocol and peer review process was tested with college…

Child and youth participatory interventions for addressing lifestyle-related childhood obesity: a systematic review.

PubMed

Frerichs, L; Ataga, O; Corbie-Smith, G; Tessler Lindau, S

2016-12-01

A growing number of childhood obesity interventions involve children and youth in participatory roles, but these types of interventions have not been systematically reviewed. We aimed to identify child and youth participatory interventions in the peer-reviewed literature in order to characterize the approaches and examine their impact on obesity and obesity-related lifestyle behaviours. We searched PubMed/Medline, psychINFO and ERIC for quasi-experimental and randomized trials conducted from date of database initiation through May 2015 that engaged children or youth in implementing healthy eating, physical activity or weight management strategies. Eighteen studies met our eligibility criteria. Most (n = 14) trained youth to implement pre-defined strategies targeting their peers. A few (n = 4) assisted youth to plan and implement interventions that addressed environmental changes. Thirteen studies reported at least one statistically significant weight, physical activity or dietary change outcome. Participatory approaches have potential, but variation in strategies and outcomes leave questions unanswered about the mechanisms through which child and youth engagement impact childhood obesity. Future research should compare child-delivered or youth-delivered to adult-delivered health promotion interventions and more rigorously evaluate natural experiments that engage youth to implement environmental changes. With careful attention to theoretical frameworks, process and outcome measures, these studies could strengthen the effectiveness of child and youth participatory approaches. © 2016 World Obesity Federation.

Analysis of Peer Review Comments: QM Recommendations and Feedback Intervention Theory

ERIC Educational Resources Information Center

Schwegler, Andria F.; Altman, Barbara W.

2015-01-01

Because feedback is a critical component of the continuous improvement cycle of the Quality Matters (QM) peer review process, the present research analyzed the feedback that peer reviewers provided to course developers after a voluntary, nonofficial QM peer review of online courses. Previous research reveals that the effects of feedback on…

Pre-University Chemistry Students in a Mimicked Scholarly Peer Review

ERIC Educational Resources Information Center

van Rens, Lisette; Hermarij, Philip; Pilot, Albert; Beishuizen, Jos; Hofman, Herman; Wal, Marjolein

2014-01-01

Peer review is a significant component in scientific research. Introducing peer review into inquiry processes may be regarded as an aim to develop student understanding regarding quality in inquiries. This study examines student understanding in inquiry peer reviews among pre-university chemistry students, aged 16-17, when they enact a design of a…

Peering into peer-review at GigaScience

PubMed Central

2013-01-01

Fostering and promoting more open and transparent science is one of the goals of GigaScience. One of the ways we have been doing this is by throwing light on the peer-review process and carrying out open peer-review as standard. In this editorial, we provide our rationale for undertaking this policy, give examples of our positive experiences to date, and encourage others to open up the normally opaque publication process. PMID:23587291

The Law Review Approach: What the Humanities Can Learn

ERIC Educational Resources Information Center

Mendenhall, Allen

2013-01-01

Readers of this journal probably know how the peer review process works in the humanities disciplines and at various journals. Therefore the author explains how the law review process generally works and then what the humanities can learn and borrow from the law review process. He ends by advocating for a hybrid law review/peer review approach to…

Some opinions on the review process of research papers destined for publication.

PubMed

Roohi, Ehsan; Mahian, Omid

2015-06-01

The current paper discusses the peer review process in journals that publish research papers purveying new science and understandings (scientific journals). Different aspects of peer review including the selection of reviewers, the review process and the decision policy of editor are discussed in details. Here, the pros and cons of different conventional methods of review processes are mentioned. Finally, a suggestion is presented for the review process of scientific papers.

Unmanned Maritime Systems Incremental Acquisition Approach

DTIC Science & Technology

2016-12-01

We find that current UMS acquisitions are utilizing previous acquisition reforms, but could benefit from additional contractor peer competition and...peer review. Additional cost and schedule benefits could result from contractor competition during build processes in each incremental process. We...acquisitions are utilizing previous acquisition reforms, but could benefit from additional contractor peer competition and peer review. Additional

Clinical peer review program self-evaluation for US hospitals.

PubMed

Edwards, Marc T

2010-01-01

Prior research has shown wide variation in clinical peer review program structure, process, governance, and perceived effectiveness. This study sought to validate the utility of a Peer Review Program Self-Evaluation Tool as a potential guide to physician and hospital leaders seeking greater program value. Data from 330 hospitals show that the total score from the self-evaluation tool is strongly associated with perceived quality impact. Organizational culture also plays a significant role. When controlling for these factors, there was no evidence of benefit from a multispecialty review process. Physicians do not generally use reliable methods to measure clinical performance. A high rate of change since 2007 has not produced much improvement. The Peer Review Program Self-Evaluation Tool reliably differentiates hospitals along a continuum of perceived program performance. The full potential of peer review as a process to improve the quality and safety of care has yet to be realized.

Implementation and evaluation of a peer review process for advanced practice nurses in a university hospital setting.

PubMed

Bergum, Shelly K; Canaan, Talitha; Delemos, Christi; Gall, Elizabeth Funke; McCracken, Bonnie; Rowen, Dave; Salvemini, Steve; Wiens, Kimberly

2017-07-01

Over the past decade, implementation of the peer review process for the development of the advanced practice nurse (APN) has been emphasized. However, little exists in the literature regarding APN peer review. The peer review process is intended to help demonstrate competency of care, enhance quality improvement measures, and foster the professional growth of the APN. APNs serving on a professional governance council within a university teaching hospital developed a model of peer review for APNs. Nine months after the tool was implemented, an anonymous follow-up survey was conducted. A follow-up request was sent 4 weeks later to increase the number of respondents. Likert scales were used to elicit subjective data regarding the process. Of 81 APNs who participated in the survey, more than half (52%) felt that the process would directly improve their professional practice. Survey results show that the peer review process affected APN professional practice positively. Additional research might include pathways for remediation and education of staff, evaluation of alternate methods to improve application to clinical practice, and collection of outcome data. The models presented provide a foundation for future refinement to accommodate different APN practice settings. ©2017 American Association of Nurse Practitioners.

Who benefits from peer review? An analysis of the outcome of 100 requests for review by Plastic and Reconstructive Surgery.

PubMed

Loonen, Martijn P J; Hage, J Joris; Kon, Moshe

2005-10-01

Little is known of what is done with the comments on submitted manuscripts provided by peer reviewers or to what extent these comments benefit the editor in deciding to accept or reject the manuscript, the author(s) in revising their manuscript, or the readership at large. Furthermore, nothing is known of any possible benefits of the process to the peer reviewer. Finally, the peer-review process may even be maleficent because of its implicit delay of publication and a possible bias against manuscripts originating from non-Anglo-American countries. The authors evaluated the benefits of the peer-review process to authors, editor, readers, and reviewers by a bibliometric analysis of the outcome of 100 requests for review made by the editor of Plastic and Reconstructive Surgery from 1992 through 2003. The publication delay and potential geographical bias were evaluated as potential disadvantages. The authors' reviewer advised acceptance of 56 percent of the manuscripts, and the editor mostly agreed with his advice. This suggests that the editor benefited from the review. The authors addressed 48 to 81 percent of the reviewer's constructive suggestions, and this suggests that they and the readers benefited also. Readers of Plastic and Reconstructive Surgery may further benefit because manuscripts rejected by Plastic and Reconstructive Surgery end up in less prestigious journals. The implicit delay of publication is limited, and the authors found no bias against non-Anglo-American submissions. The cost-effectiveness of the process for the peer reviewer remains unclear. The peer-review system of Plastic and Reconstructive Surgery, in general, is beneficial.

Working in Triads: A Case Study of a Peer Review Process

ERIC Educational Resources Information Center

Grainger, Peter; Bridgstock, Martin; Houston, Todd; Drew, Steve

2015-01-01

Peer review of teaching has become an accepted educational procedure in Australia to quality assure the quality of teaching practices. The institutional implementation of the peer review process can be viewed as genuine desire to improve teaching quality or an imposition from above as a measure of accountability and performativity. One approach is…

How the Racial and Socioeconomic Composition of Schools and Classrooms Contributes to Literacy, Behavioral Climate, Instructional Organization and High School Graduation Rates. Research Brief No. 2. Updated

ERIC Educational Resources Information Center

Eaton, Susan

2011-01-01

This is the second in a series of briefs summarizing findings from the newest and most rigorous research related to racial and socioeconomic diversity in public schools. The studies on which this brief is based were published recently in three special issues of the peer-reviewed journal, "Teachers College Record," edited by Professors…

Implementing Head and Neck Contouring Peer Review without Pathway Delay: The On-demand Approach.

PubMed

Fong, C; Sanghera, P; Good, J; Nightingale, P; Hartley, A

2017-12-01

Peer review of contour volume is a priority in the radiotherapy treatment quality assurance process for head and neck cancer. It is essential that incorporation of peer review activity does not introduce additional delays. An on-demand peer review process was piloted to assess the feasibility and efficiency of this approach, as compared with a historic scheduled weekly approach. Between November 2016 and April 2017 four head and neck clinicians in one centre took part in an on-demand peer review process. Cases were of radical or adjuvant intent of any histology and submitted on a voluntary basis. The outcome of contour peer review would be one of unchanged (UC), unchanged with variation or discretion noted (UV), minor change (M) or significant change (S). The time difference between the completion of the on-demand peer review was compared with the time difference to a hypothetical next Monday or Tuesday weekly peer review meeting. The time taken to review each case was also documented in the latter period of the pilot project. In total, 62 cases underwent peer review. Peer review on-demand provided dosimetrists with an average of an extra two working days available per case to meet treatment start dates. The proportion of cases with outcomes UC, UV, M and S were 45%, 16%, 26% and 13%, respectively. The mean peer review time spent per case was 17 min (12 cases). The main reason for S was discrepancy in imaging interpretation (4/8 cases). A lower proportion of oropharyngeal cases were submitted and had S outcomes. A higher proportion of complex cases, e.g. sinonasal/nasopharynx location or previous downstaging chemotherapy had S outcomes. The distribution of S outcomes appears to be similar regardless of clinician experience. The level of peer review activity among individuals differed by workload and job timetable. On-demand peer review of the head and neck contour volume is feasible, reduces delay to the start of dosimetry planning and bypasses the logistical barriers of weekly meetings. An audit of participation will be required to ensure successful implementation. Copyright © 2017 The Royal College of Radiologists. Published by Elsevier Ltd. All rights reserved.

[Improving patient safety through voluntary peer review].

PubMed

Kluge, S; Bause, H

2015-01-01

The intensive care unit (ICU) is one area of the hospital in which processes and communication are of primary importance. Errors in intensive care units can lead to serious adverse events with significant consequences for patients. Therefore quality and risk-management are important measures when treating critically ill patients. A pragmatic approach to support quality and safety in intensive care is peer review. This approach has gained significant acceptance over the past years. It consists of mutual visits by colleagues who conduct standardised peer reviews. These reviews focus on the systematic evaluation of the quality of an ICU's structure, its processes and outcome. Together with different associations, the State Chambers of Physicians and the German Medical Association have developed peer review as a standardized tool for quality improvement. The common goal of all stakeholders is the continuous and sustainable improvement in intensive care with peer reviews significantly increasing and improving communication between professions and disciplines. Peer reviews secure the sustainability of planned change processes and consequently lead the way to an improved culture of quality and safety.

Predicting Academics' Willingness to Participate in Peer Review of Teaching: A Quantitative Investigation

ERIC Educational Resources Information Center

White, Kiri; Boehm, Emilia; Chester, Andrea

2014-01-01

Peer review of teaching is a collegial process designed to help academics reflect on and improve their teaching practice. Considerable research supports the value of peer review of teaching. However, uptake of voluntary programs is typically low. Few studies have examined the predictors of engagement in voluntary peer review. This study surveyed…

Adapting Peer Review to an Online Course: An Exploratory Case Study

ERIC Educational Resources Information Center

Knight, Linda V.; Steinbach, Theresa A.

2011-01-01

With demonstrated benefits to higher level learning, peer review in the classroom has been well researched and popular since at least the 1990s. However, little or no prior studies exist into the peer review process for online courses. Further, we found no prior research specifically addressing the operational aspects of online peer review. This…

Peer Review for EPA's Biologically Based Dose-Response ...

EPA Pesticide Factsheets

EPA is developing a regulation for perchlorate in drinking water. As part the regulatory process EPA must develop a Maximum Contaminant Level Goal (MCLG). FDA and EPA scientists developed a biologically based dose-response (BBDR) model to assist in deriving the MCLG. This model is designed to determine under what conditions of iodine nutrition and exposure to perchlorate across sensitive lifestages would result in low serum free and total thyroxine (hypothyroxinemia). EPA is undertaking a peer review to provide a focused, objective independent peer evaluation of the draft model and its model results report. EPA is undertaking a peer review to provide a focused, objective independent peer evaluation of the draft model and its model results report. Peer review is an important component of the scientific process. The criticism, suggestions, and new ideas provided by the peer reviewers stimulate creative thought, strengthen the interpretation of the reviewed material, and confer credibility on the product. The peer review objective is to provide advice to EPA on steps that will yield a highly credible scientific product that is supported by the scientific community and a defensible perchlorate MCLG.

28 CFR 34.104 - Use of peer review.

Code of Federal Regulations, 2013 CFR

2013-07-01

... the peer review process. (c) Ratings will be in the form of numerical scores assigned by individual... results of peer review for a noncompetitive new or continuation project will be in the form of numerical...

28 CFR 34.104 - Use of peer review.

Code of Federal Regulations, 2014 CFR

2014-07-01

... the peer review process. (c) Ratings will be in the form of numerical scores assigned by individual... results of peer review for a noncompetitive new or continuation project will be in the form of numerical...

28 CFR 34.104 - Use of peer review.

Code of Federal Regulations, 2011 CFR

2011-07-01

... the peer review process. (c) Ratings will be in the form of numerical scores assigned by individual... results of peer review for a noncompetitive new or continuation project will be in the form of numerical...

28 CFR 34.104 - Use of peer review.

Code of Federal Regulations, 2012 CFR

2012-07-01

... the peer review process. (c) Ratings will be in the form of numerical scores assigned by individual... results of peer review for a noncompetitive new or continuation project will be in the form of numerical...

Peering into peer review: Galileo, ESP, Dr Scott Reuben, and advancing our professional evolution.

PubMed

Biddle, Chuck

2011-10-01

The fundamental purpose of peer review is quality control that facilitates the introduction of information into our discipline; information that is essential to the care of patients who require anesthesia services. While the AANA Journal relies heavily on this process to maintain the overall quality of our scholarly literature, it may fail that objective under certain conditions. This editorial serves to inform readers of the nature and goals of the peer review process.

How long is too long in contemporary peer review? Perspectives from authors publishing in conservation biology journals.

PubMed

Nguyen, Vivian M; Haddaway, Neal R; Gutowsky, Lee F G; Wilson, Alexander D M; Gallagher, Austin J; Donaldson, Michael R; Hammerschlag, Neil; Cooke, Steven J

2015-01-01

Delays in peer reviewed publication may have consequences for both assessment of scientific prowess in academics as well as communication of important information to the knowledge receptor community. We present an analysis on the perspectives of authors publishing in conservation biology journals regarding their opinions on the importance of speed in peer-review as well as how to improve review times. Authors were invited to take part in an online questionnaire, of which the data was subjected to both qualitative (open coding, categorizing) and quantitative analyses (generalized linear models). We received 637 responses to a total of 6,547 e-mail invitations sent. Peer-review speed was generally perceived as slow, with authors experiencing a typical turnaround time of 14 weeks while their perceived optimal review time is six weeks. Male and younger respondents seem to have higher expectations of review speed than females and older respondents. Majority of participants attributed lengthy review times to the 'stress' on the peer-review system (i.e., reviewer and editor fatigue), while editor persistence and journal prestige were believed to speed up the review process. Negative consequences of lengthy review times appear to be greater for early career researchers and can also have impact on author morale (e.g. motivation or frustration). Competition among colleagues were also of concern to respondents. Incentivizing peer review was among the top suggested alterations to the system along with training graduate students in peer review, increased editorial persistence, and changes to the norms of peer-review such as opening the peer-review process to the public. It is clear that authors surveyed in this study view the peer-review system as under stress and we encourage scientists and publishers to push the envelope for new peer review models.

Peer-review: An IOP Publishing Perspective

NASA Astrophysics Data System (ADS)

Smith, Timothy

2015-03-01

Online publishing is challenging, and potentially changing, the role of publishers in both managing the peer-review process and disseminating the work that they publish in meeting contrasting needs from diverse groups of research communities. Recognizing the value of peer-review as a fundamental service to authors and the research community, the underlying principles of managing the process for journals published by IOP Publishing remain unchanged and yet the potential and demand for alternative models exists. This talk will discuss the traditional approach to peer-review placed in the context of this changing demand.

Peer Feedback in Anonymous Peer Review in an EFL Writing Class in Spain

ERIC Educational Resources Information Center

Coté, Robert A.

2014-01-01

The present study reports the results of a process of peer feedback through anonymous peer review in an EFL writing class. Numerous studies have reported on the benefits of peer review (PR) in the ESL/EFL writing classroom. However, the literature also identifies social issues that can negatively affect the outcome of face-to-face PR. In this…

Exam High Schools and Academic Achievement: Evidence from New York City. NBER Working Paper No. 17286

ERIC Educational Resources Information Center

Dobbie, Will; Fryer, Roland G., Jr.

2011-01-01

Publicly funded exam schools educate many of the world's most talented students. These schools typically contain higher achieving peers, more rigorous instruction, and additional resources compared to regular public schools. This paper uses a sharp discontinuity in the admissions process at three prominent exam schools in New York City to provide…

Assessing Postgraduate Student Perceptions and Measures of Learning in a Peer Review Feedback Process

ERIC Educational Resources Information Center

Simpson, Genevieve; Clifton, Julian

2016-01-01

Peer review feedback, developed to assist students with increasing the quality of group reports and developing peer review skills, was added to a master's level Climate Change Policy and Planning unit. A pre- and post-survey was conducted to determine whether students found the process a valuable learning opportunity: 87% of students responding to…

Peer Review and the Dilemmas of Quality Control in Programme Accreditation in South African Higher Education: Challenges and Possibilities

ERIC Educational Resources Information Center

Cross, Michael; Naidoo, Devika

2011-01-01

The paper scrutinises the dynamics and the nature of peer review in the programme evaluation and accreditation process within the context of diverse individual and institutional legacies in South Africa. It analyses the peer review process and highlights the contestation at political, policy and epistemological levels. The paper argues that,…

Peer Review Practices for Evaluating Biomedical Research Grants: A Scientific Statement From the American Heart Association.

PubMed

Liaw, Lucy; Freedman, Jane E; Becker, Lance B; Mehta, Nehal N; Liscum, Laura

2017-08-04

The biomedical research enterprise depends on the fair and objective peer review of research grants, leading to the distribution of resources through efficient and robust competitive methods. In the United States, federal funding agencies and foundations collectively distribute billions of dollars annually to support biomedical research. For the American Heart Association, a Peer Review Subcommittee is charged with establishing the highest standards for peer review. This scientific statement reviews the current literature on peer review practices, describes the current American Heart Association peer review process and those of other agencies, analyzes the strengths and weaknesses of American Heart Association peer review practices, and recommends best practices for the future. © 2017 American Heart Association, Inc.

Content and communication: How can peer review provide helpful feedback about the writing?

PubMed Central

Shashok, Karen

2008-01-01

Background Peer review is assumed to improve the quality of research reports as tools for scientific communication, yet strong evidence that this outcome is obtained consistently has been elusive. Failure to distinguish between aspects of discipline-specific content and aspects of the writing or use of language may account for some deficiencies in current peer review processes. Discussion The process and outcomes of peer review may be analyzed along two dimensions: 1) identifying scientific or technical content that is useful to other researchers (i.e., its "screening" function), and 2) improving research articles as tools for communication (i.e., its "improving" function). However, editors and reviewers do not always distinguish clearly between content criteria and writing criteria. When peer reviewers confuse content and writing, their feedback can be misunderstood by authors, who may modify texts in ways that do not make the readers' job easier. When researchers in peer review confuse the two dimensions, this can lead to content validity problems that foil attempts to define informative variables and outcome measures, and thus prevent clear trends from emerging. Research on writing, revising and editing suggests some reasons why peer review is not always as effective as it might be in improving what is written. Summary Peer review could be improved if stakeholders were more aware of variations in gatekeepers' (reviewers' and editors') ability to provide feedback about the content or the writing. Gatekeepers, academic literacy researchers, and wordface professionals (author's editors, medical writers and translators) could work together to discover the types of feedback authors find most useful. I offer suggestions to help editologists design better studies of peer review which could make the process an even stronger tool for manuscript improvement than it is now. PMID:18237378

Content and communication: how can peer review provide helpful feedback about the writing?

PubMed

Shashok, Karen

2008-01-31

Peer review is assumed to improve the quality of research reports as tools for scientific communication, yet strong evidence that this outcome is obtained consistently has been elusive. Failure to distinguish between aspects of discipline-specific content and aspects of the writing or use of language may account for some deficiencies in current peer review processes. The process and outcomes of peer review may be analyzed along two dimensions: 1) identifying scientific or technical content that is useful to other researchers (i.e., its "screening" function), and 2) improving research articles as tools for communication (i.e., its "improving" function). However, editors and reviewers do not always distinguish clearly between content criteria and writing criteria. When peer reviewers confuse content and writing, their feedback can be misunderstood by authors, who may modify texts in ways that do not make the readers' job easier. When researchers in peer review confuse the two dimensions, this can lead to content validity problems that foil attempts to define informative variables and outcome measures, and thus prevent clear trends from emerging. Research on writing, revising and editing suggests some reasons why peer review is not always as effective as it might be in improving what is written. Peer review could be improved if stakeholders were more aware of variations in gatekeepers' (reviewers' and editors') ability to provide feedback about the content or the writing. Gatekeepers, academic literacy researchers, and wordface professionals (author's editors, medical writers and translators) could work together to discover the types of feedback authors find most useful. I offer suggestions to help editologists design better studies of peer review which could make the process an even stronger tool for manuscript improvement than it is now.

A systematic review of peer teaching and learning in clinical education.

PubMed

Secomb, Jacinta

2008-03-01

The purpose of this review is to provide a framework for peer teaching and learning in the clinical education of undergraduate health science students in clinical practice settings and make clear the positive and negative aspects of this teaching and learning strategy. The practice of using peers incidentally or purposefully in the clinical education of apprentice or undergraduate health science students is a well-established tradition and commonly practiced, but lacks definition in its implementation. The author conducted a search of health science and educational electronic databases using the terms peer, clinical education and undergraduate. The set limitations were publications after 1980 (2005 inclusive), English language and research papers. Selection of studies occurred: based on participant, intervention, research method and learning outcomes, following a rigorous critical and quality appraisal with a purposefully developed tool. The results have been both tabled and collated in a narrative summary. Twelve articles met the inclusion criteria, representing five countries and four health science disciplines. This review reported mostly positive outcomes on the effectiveness of peer teaching and learning; it can increase student's confidence in clinical practice and improve learning in the psychomotor and cognitive domains. Negative aspects were also identified; these include poor student learning if personalities or learning styles are not compatible and students spending less individualized time with the clinical instructor. Peer teaching and learning is an effective educational intervention for health science students on clinical placements. Preclinical education of students congruent with the academic timetable increases student educational outcomes from peer teaching and learning. Strategies are required prior to clinical placement to accommodate incompatible students or poor student learning. The findings from this systematic review, although not statistically significant, do have pragmatic implications for clinical practice. It can increase clinical placement opportunities for undergraduate health students, assist clinical staff with workload pressures and increase clinician time with clients, while further developing students' knowledge, skills and attitudes.

Acknowledging Students' Collaborations through Peer Review: A Footnoting Practice

ERIC Educational Resources Information Center

Poe, Shelli M.; Gravett, Emily O.

2016-01-01

Student-to-student peer review or peer feedback is commonly used in student-centered or active-learning classrooms. In this article, we describe a footnoting exercise that we implemented in two of our undergraduate courses as one way to encourage students to acknowledge collaborations and contributions made during peer-review processes. This…

Challenges in the Ethical Review of Peer Support Interventions

PubMed Central

Simmons, David; Bunn, Christopher; Nakwagala, Fred; Safford, Monika M.; Ayala, Guadalupe X.; Riddell, Michaela; Graffy, Jonathan; Fisher, Edwin B.

2015-01-01

PURPOSE Ethical review processes have become increasingly complex. We have examined how 8 collaborating diabetes peer-support clinical trials were assessed by ethics committees. METHODS The ethical reviews from the 8 peer-support studies were collated and subjected to a thematic analysis. We mapped the recommendations of local Institutional Review Boards and ethics committees onto the “4+1 ethical framework” (autonomy, beneficence, non-maleficence, and justice, along with concern for their scope of application). RESULTS Ethics committees did not consistently focus on tasks within the 4+1 framework: many conducted reviews of scientific, organizational, and administrative activities. Of the 20 themes identified across the ethical reviews, only 4 fell within the scope of the 4+1 framework. Variation in processes and requirements for ethics committees were particularly evident between study countries. Some of the consent processes mandated by ethical review boards were disproportionate for peer support, increased participant burden, and reduced the practicality of testing an ethical intervention. Across the 8 studies, ethics committees’ reviews included the required elements to ensure participant safety; however, they created a range of hurdles that in some cases delayed the research and required consent processes that could hinder the spontaneity and/or empathy of peer support. CONCLUSION Ethics committees should avoid repeating the work of other trusted agencies and consider the ethical validity of “light touch” consent procedures for peer-support interventions. The investigators propose an ethical framework for research on peer support. PMID:26304976

Identifying and Remediating Student Misconceptions in Introductory Biology via Writing-to-Learn Assignments and Peer Review.

PubMed

Halim, Audrey S; Finkenstaedt-Quinn, Solaire A; Olsen, Laura J; Gere, Anne Ruggles; Shultz, Ginger V

2018-06-01

Student misconceptions are an obstacle in science, technology, engineering, and mathematics courses and unless remediated may continue causing difficulties in learning as students advance in their studies. Writing-to-learn assignments (WTL) are characterized by their ability to promote in-depth conceptual learning by allowing students to explore their understanding of a topic. This study sought to determine whether and what types of misconceptions are elicited by WTL assignments and how the process of peer review and revision leads to remediation or propagation of misconceptions. We examined four WTL assignments in an introductory biology course in which students first wrote about content by applying it to a realistic scenario, then participated in a peer-review process before revising their work. Misconceptions were identified in all four assignments, with the greatest number pertaining to protein structure and function. Additionally, in certain contexts, students used scientific terminology incorrectly. Analysis of the drafts and peer-review comments generated six profiles by which misconceptions were addressed through the peer-review process. The prevalent mode of remediation arose through directed peer-review comments followed by correction during revision. It was also observed that additional misconceptions were elicited as students revised their writing in response to general peer-review suggestions.

How Long Is Too Long in Contemporary Peer Review? Perspectives from Authors Publishing in Conservation Biology Journals

PubMed Central

Nguyen, Vivian M.; Haddaway, Neal R.; Gutowsky, Lee F. G.; Wilson, Alexander D. M.; Gallagher, Austin J.; Donaldson, Michael R.; Hammerschlag, Neil; Cooke, Steven J.

2015-01-01

Delays in peer reviewed publication may have consequences for both assessment of scientific prowess in academia as well as communication of important information to the knowledge receptor community. We present an analysis on the perspectives of authors publishing in conservation biology journals regarding their opinions on the importance of speed in peer-review as well as how to improve review times. Authors were invited to take part in an online questionnaire, of which the data was subjected to both qualitative (open coding, categorizing) and quantitative analyses (generalized linear models). We received 637 responses to 6,547 e-mail invitations sent. Peer-review speed was generally perceived as slow, with authors experiencing a typical turnaround time of 14 weeks while their perceived optimal review time was six weeks. Male and younger respondents seem to have higher expectations of review speed than females and older respondents. The majority of participants attributed lengthy review times to reviewer and editor fatigue, while editor persistence and journal prestige were believed to speed up the review process. Negative consequences of lengthy review times were perceived to be greater for early career researchers and to have impact on author morale (e.g. motivation or frustration). Competition among colleagues was also of concern to respondents. Incentivizing peer-review was among the top suggested alterations to the system along with training graduate students in peer-review, increased editorial persistence, and changes to the norms of peer-review such as opening the peer-review process to the public. It is clear that authors surveyed in this study viewed the peer-review system as under stress and we encourage scientists and publishers to push the envelope for new peer-review models. PMID:26267491

Exploration and practice of methods and processes of evidence-based rapid review on peer review of WHO EML application.

PubMed

Li, Youping; Yu, Jiajie; Du, Liang; Sun, Xin; Kwong, Joey S W; Wu, Bin; Hu, Zhiqiang; Lu, Jing; Xu, Ting; Zhang, Lingli

2015-11-01

After 38 years of development, the procedure of selection and evaluation of the World Health Organization Essential Medicine List (WHO EML) is increasingly scientific and formal. However, peer review for the applications of World Health Organization Essential Medicine List is always required in a short period. It is necessary to build up a set of methods and processes for rapid review. We identified the process of evidenced-based rapid review on WHO EML application for peer reviews according to 11 items which were required during reporting of the peer review results of the proposals. The most important items for the rapid review of World Health Organization Essential Medicine List peer reviewers are (1) to confirm the requirements and identify the purposes; (2) to establish the research questions and translate the questions into the 'Participants, Interventions, Comparators, Outcomes, Study design' (PICOS) format; (3) to search and screen available evidence, for which high-level evidence is preferred, such as systematic reviews or meta-analyses, health technology assessment, clinical guidelines; (4) to extract data, where we extract primary information based on the purposes; (5) to synthesize data by qualitative methods, assess the quality of evidence, and compare the results; (6) to provide the answers to the applications, quality of evidences and strength of recommendations. Our study established a set of methods and processes for the rapid review of World Health Organization Essential Medicine List peer review, and our findings were used to guide the reviewers to fulfill the 19(th) World Health Organization Essential Medicine List peer review. The methods and processes were feasible and met the necessary requirements in terms of time and quality. Continuous improvement and evaluation in practice are warranted. © 2015 Chinese Cochrane Center, West China Hospital of Sichuan University and Wiley Publishing Asia Pty Ltd.

Perspectives on Validation of High-Throughput Assays Supporting 21st Century Toxicity Testing1

PubMed Central

Judson, Richard; Kavlock, Robert; Martin, Matt; Reif, David; Houck, Keith; Knudsen, Thomas; Richard, Ann; Tice, Raymond R.; Whelan, Maurice; Xia, Menghang; Huang, Ruili; Austin, Christopher; Daston, George; Hartung, Thomas; Fowle, John R.; Wooge, William; Tong, Weida; Dix, David

2014-01-01

Summary In vitro, high-throughput screening (HTS) assays are seeing increasing use in toxicity testing. HTS assays can simultaneously test many chemicals, but have seen limited use in the regulatory arena, in part because of the need to undergo rigorous, time-consuming formal validation. Here we discuss streamlining the validation process, specifically for prioritization applications in which HTS assays are used to identify a high-concern subset of a collection of chemicals. The high-concern chemicals could then be tested sooner rather than later in standard guideline bioassays. The streamlined validation process would continue to ensure the reliability and relevance of assays for this application. We discuss the following practical guidelines: (1) follow current validation practice to the extent possible and practical; (2) make increased use of reference compounds to better demonstrate assay reliability and relevance; (3) deemphasize the need for cross-laboratory testing, and; (4) implement a web-based, transparent and expedited peer review process. PMID:23338806

The US Army War College: Gearing Up for the 21st Century

DTIC Science & Technology

1988-12-01

modality. The Committee also identified a need for increased emphasis on active learning as well as greater academic rigor and challenge...and to involve them more directly in an active learning process, case studies, exercises, gaming, and analytical discussions have been increased...in the active learning process; that most challenging test which occurs when the student is perform- ing or reciting in front of his or her peers as

A Program Manager’s Guide for Program Improvement in Ongoing Psychological Health and Traumatic Brain Injury Programs. The RAND Toolkit, Volume 4

DTIC Science & Technology

2014-01-01

Hughes EFX, Boerstler H, O’Connor EJ. “Assessing the Impact of Continuous Quality Improvement/ Total Quality Management : Concept versus...facing the public and private sectors. All RAND reports undergo rigorous peer review to ensure high standards for research quality and objectivity. Gery...RAND Program Manager’s Guide helps managers assess program performance, consider options for improvement, implement solutions, then assess whether the

Imprecise Probability Methods for Weapons UQ

DOE Office of Scientific and Technical Information (OSTI.GOV)

Picard, Richard Roy; Vander Wiel, Scott Alan

Building on recent work in uncertainty quanti cation, we examine the use of imprecise probability methods to better characterize expert knowledge and to improve on misleading aspects of Bayesian analysis with informative prior distributions. Quantitative approaches to incorporate uncertainties in weapons certi cation are subject to rigorous external peer review, and in this regard, certain imprecise probability methods are well established in the literature and attractive. These methods are illustrated using experimental data from LANL detonator impact testing.

Effectiveness of Guided Peer Review of Student Essays in a Large Undergraduate Biology Course

ERIC Educational Resources Information Center

Kelly, Lauren

2015-01-01

Instructors and researchers often consider peer review an integral part of the writing process, providing myriad benefits for both writers and reviewers. Few empirical studies, however, directly address the relationship between specific methodological changes and peer review effectiveness, especially outside the composition classroom. To…

Overcoming pitfalls: Results from a mandatory peer review process for written examinations.

PubMed

Wilby, Kyle John; El Hajj, Maguy S; El-Bashir, Marwa; Mraiche, Fatima

2018-04-01

Written assessments are essential components of higher education practices. However, faculty members encounter common pitfalls when designing questions intended to evaluate student-learning outcomes. The objective of this project was to determine the impact of a mandatory examination peer review process on question accuracy, alignment with learning objectives, use of best practices in question design, and language/grammar. A mandatory peer review process was implemented for all midterm (before phase) and final (after phase) examinations. Peer review occurred by two reviewers and followed a pre-defined guidance document. Non-punitive feedback given to faculty members served as the intervention. Frequencies of flagged questions according to guidance categories were compared between phases. A total of 21 midterm and 21 final exam reviews were included in the analysis. A total of 637 questions were reviewed across all midterms and 1003 questions were reviewed across all finals. Few questions were flagged for accuracy and alignment with learning outcomes. The median total proportion of questions flagged for best practices was significantly lower for final exams versus midterm exams (15.8 vs. 6.45%, p = 0.014). The intervention did not influence language and grammar errors (9.68 vs. 10.0% of questions flagged before and after, respectively, p = 0.305). A non-punitive peer review process for written examinations can overcome pitfalls in exam creation and improve best practices in question writing. The peer-review process had a substantial effect at flagging language/grammar errors but error rate did not differ between midterm and final exams. Copyright © 2017 Elsevier Inc. All rights reserved.

Intersubjectivity in Theoretical and Practical Online Courses

ERIC Educational Resources Information Center

Lim, Janine; Hall, Barbara M.

2015-01-01

Rigorous interaction between peers has been an elusive goal in online asynchronous discussions. Intersubjectivity, the goal of peer-to-peer interaction, is a representation of a higher quality of synthesis. It is the representation of knowledge construction achieved through a synergistic progression from individual contributions to sequences of…

Detailed prospective peer review in a community radiation oncology clinic.

PubMed

Mitchell, James D; Chesnut, Thomas J; Eastham, David V; Demandante, Carlo N; Hoopes, David J

In 2012, we instituted detailed prospective peer review of new cases. We present the outcomes of peer review on patient management and time required for peer review. Peer review rounds were held 3 to 4 days weekly and required 2 physicians to review pertinent information from the electronic medical record and treatment planning system. Eight aspects were reviewed for each case: 1) workup and staging; 2) treatment intent and prescription; 3) position, immobilization, and simulation; 4) motion assessment and management; 5) target contours; 6) normal tissue contours; 7) target dosimetry; and 8) normal tissue dosimetry. Cases were marked as, "Meets standard of care," "Variation," or "Major deviation." Changes in treatment plan were noted. As our process evolved, we recorded the time spent reviewing each case. From 2012 to 2014, we collected peer review data on 442 of 465 (95%) radiation therapy patients treated in our hospital-based clinic. Overall, 91 (20.6%) of the cases were marked as having a variation, and 3 (0.7%) as major deviation. Forty-two (9.5%) of the cases were altered after peer review. An overall peer review score of "Variation" or "Major deviation" was highly associated with a change in treatment plan (P < .01). Changes in target contours were recommended in 10% of cases. Gastrointestinal cases were significantly associated with a change in treatment plan after peer review. Indicators on position, immobilization, simulation, target contours, target dosimetry, motion management, normal tissue contours, and normal tissue dosimetry were significantly associated with a change in treatment plan. The mean time spent on each case was 7 minutes. Prospective peer review is feasible in a community radiation oncology practice. Our process led to changes in 9.5% of cases. Peer review should focus on technical factors such as target contours and dosimetry. Peer review required 7 minutes per case. Published by Elsevier Inc.

The effect of peer influence and selection processes on adolescent alcohol use: a systematic review of longitudinal studies.

PubMed

Leung, Rachel K; Toumbourou, John W; Hemphill, Sheryl A

2014-01-01

Adolescent alcohol use remains an important public health concern. One of the most salient and consistent predictors for drinking behaviour among young people is peer influence. A systematic review of longitudinal studies that examined the effect of peer influence on adolescent alcohol use between January 1997 and February 2011 is presented. Twenty-two studies fulfilled inclusion criteria and were reviewed. All but one study confirmed affiliation with alcohol-using or deviant peers as prospective predictors for the development of adolescent alcohol use. Findings revealed that existing longitudinal studies that have used multivariate analytic techniques to segregate peer influence (whereby adolescents start drinking after exposure to alcohol-using friends) and peer selection (whereby adolescents that start drinking without alcohol-using friends subsequently seek out drinking peers) effects consistently report significant peer influence effects. However, studies are unable to elucidate the relative contribution and developmental sequence of peer influence and selection. Existing research is synthesised to model the developmental influence of peer processes on adolescent alcohol use. Future research directions are recommended to inform better designed investigations that can lead to more effective endeavours to address peer processes in prevention efforts.

Confronting inequities: A scoping review of the literature on pharmacist practice and health-related disparities.

PubMed

Wenger, Lisa M; Rosenthal, Meagen; Sharpe, Jane Pearson; Waite, Nancy

2016-01-01

An expanding body of literature is exploring the presence and impact of health and health care disparities among marginalized populations. This research challenges policy makers, health professionals, and scholars to examine how unjust and avoidable inequities are created at the societal, institutional, and individual level, and explore strategies for mitigating challenges. Recognizing the significance of this broader conversation, this scoping review provides an overview of pharmacy-specific research attentive to health-related disparities. Following Arksey and O'Malley's framework, a rigorous screening process yielded 93 peer-reviewed and 23 grey literature articles, each analyzed for core themes. Lending critical insight to how pharmacy practice researchers are conceptualizing and measuring health inequities, this review highlights three paths of inquiry evident across this literature, including research focused on what pharmacists know about marginalized groups, how pharmacists perceive these groups, and how they provide services. Striving to drive research and practice forward, this review details research gaps and opportunities, including a need to expand the scope of research and integrate knowledge. As pharmacists endeavor to provide equitable and impactful patient care, it is essential to understand challenges, and build strong evidence for meaningful action. Copyright © 2016 Elsevier Inc. All rights reserved.

Maintaining live discussion in two-stage open peer review.

PubMed

Sandewall, Erik

2012-01-01

Open peer review has been proposed for a number of reasons, in particular, for increasing the transparency of the article selection process for a journal, and for obtaining a broader basis for feedback to the authors and for the acceptance decision. The review discussion may also in itself have a value for the research community. These goals rely on the existence of a lively review discussion, but several experiments with open-process peer review in recent years have encountered the problem of faltering review discussions. The present article addresses the question of how lively review discussion may be fostered by relating the experience of the journal Electronic Transactions on Artificial Intelligence (ETAI) which was an early experiment with open peer review. Factors influencing the discussion activity are identified. It is observed that it is more difficult to obtain lively discussion when the number of contributed articles increases, which implies difficulties for scaling up the open peer review model. Suggestions are made for how this difficulty may be overcome.

Maintaining Live Discussion in Two-Stage Open Peer Review

PubMed Central

Sandewall, Erik

2011-01-01

Open peer review has been proposed for a number of reasons, in particular, for increasing the transparency of the article selection process for a journal, and for obtaining a broader basis for feedback to the authors and for the acceptance decision. The review discussion may also in itself have a value for the research community. These goals rely on the existence of a lively review discussion, but several experiments with open-process peer review in recent years have encountered the problem of faltering review discussions. The present article addresses the question of how lively review discussion may be fostered by relating the experience of the journal Electronic Transactions on Artificial Intelligence (ETAI) which was an early experiment with open peer review. Factors influencing the discussion activity are identified. It is observed that it is more difficult to obtain lively discussion when the number of contributed articles increases, which implies difficulties for scaling up the open peer review model. Suggestions are made for how this difficulty may be overcome. PMID:22363282

Giving Feedback: Preparing Students for Peer Review and Self-Evaluation

ERIC Educational Resources Information Center

Philippakos, Zoi A.

2017-01-01

Revision is an important aspect of the writing process but is often challenging for students. Peer review can be helpful, but training is needed for it to work effectively. This article suggests an approach to preparing students for peer review by teaching specific evaluation criteria and leading collaborative practice in reviewing papers written…

The Problem of Humiliation in Peer Review

ERIC Educational Resources Information Center

Comer, Debra R.; Schwartz, Michael

2014-01-01

This paper examines the problem of vituperative feedback from peer reviewers. We argue that such feedback is morally unacceptable, insofar as it humiliates authors and damages their dignity. We draw from social-psychological research to explore those aspects of the peer-review process in general and the anonymity of blind reviewing in particular…

Impartial judgment by the "gatekeepers" of science: fallibility and accountability in the peer review process.

PubMed

Hojat, Mohammadreza; Gonnella, Joseph S; Caelleigh, Addeane S

2003-01-01

High publication demands and the low acceptance rate of peer review journals place the journal editors and their reviewers in a powerful position. Journal reviewers have a vital role not only in influencing the journal editor's publication decisions, but also in the very nature and direction of scientific research. Because of their influence in peer review outcomes, journal reviewers are aptly described as the "gatekeepers of science." In this article we describe several pitfalls that can impede reviewers' impartial judgement. These include such issues as confirmatory bias, the negative results bias (the file drawer problem), the Matthew effect, the Doctor Fox effect, and gender, race, theoretical orientation, and "political correctness." We argue that procedures currently used by many professional journals, such as blind or masked review, may not completely alleviate the effects of these pitfalls. Instead, we suggest that increasing reviewers' awareness of the pitfalls, accountability, and vigilance can improve fairness in the peer review process. The ultimate responsibilities belong to the journal editors who are confronted with the difficult task of satisfying journal readers, contributors, reviewers, and owners. We recommend that the journal editors conduct periodic internal and external evaluations of their journals' peer review process and outcomes, with participation of reviewers, contributors, readers and owners.

Ancient texts to PubMed: a brief history of the peer-review process.

PubMed

Farrell, P R; Magida Farrell, L; Farrell, M K

2017-01-01

The formal evaluation of scientific literature by invited referees (peer reviewers) is a relatively recent phenomenon and now is considered a cornerstone of modern science. However, its roots can be traced back to antiquity. As the speed and complexity of scientific information and publishing increases in the digital age, peer review must continue to evolve. To understand the future direction of peer review, we must understand its past. Here, we briefly explore the history of scientific peer review. This may help us predict and design appropriate peer review for the new era. This work was originally presented at the Pediatric Academic Societies Annual Meeting in Baltimore, Maryland in the Spring of 2016.

The effect of peer review on mortality rates.

PubMed

Krahwinkel, W; Schuler, E; Liebetrau, M; Meier-Hellmann, A; Zacher, J; Kuhlen, R

2016-10-01

Lowering of mortality rates in hospitals with mortality rates higher than accepted reference values for acute myocardial infarction (AMI), congestive heart failure (CHF), pneumonia, stroke, mechanical ventilation (MV) and colorectal surgery by using an external peer review process that identifies areas requiring rectification and implements protocols directed at improving these areas. Retrospective, observational, quality management study using administrative data to compare in-hospital mortality rates (pre and post an external peer review process that included adoption of improvement protocols) with reference values. German general hospitals of a large, private group. Hospitals with mortality rates higher than reference values. Peer review of medical records by experienced, outside physicians triggered by in-hospital mortality rates higher than expected. Inadequacies were identified, improvement protocols enforced and mortality rates subsequently re-examined. Mortality rates 1 year before and 1 year after peer review and protocol use. For AMI, CHF, pneumonia, stroke, MV and colorectal surgery, the mortality rates 1 year post-peer review were significantly decreased as compared to pre-peer review mortality rates. The standardized mortality ratio for all of the above diagnoses was 1.45, 1 year before peer review, and 0.97, 1 year after peer review. The absolute risk reduction of 7.3% translates into 710 deaths in this population which could have been prevented. Peer review triggered and conducted in the manner described here is associated with a significant lowering of in-hospital mortality rates in hospitals that previously had higher than expected mortality rates. © The Author 2016. Published by Oxford University Press in association with the International Society for Quality in Health Care.

Labor Unions: A Public Health Institution

PubMed Central

Malinowski, Beth; Stock, Laura

2015-01-01

Using a social–ecological framework, we drew on a targeted literature review and historical and contemporary cases from the US labor movement to illustrate how unions address physical and psychosocial conditions of work and the underlying inequalities and social determinants of health. We reviewed labor involvement in tobacco cessation, hypertension control, and asthma, limiting articles to those in English published in peer-reviewed public health or medical journals from 1970 to 2013. More rigorous research is needed on potential pathways from union membership to health outcomes and the facilitators of and barriers to union–public health collaboration. Despite occasional challenges, public health professionals should increase their efforts to engage with unions as critical partners. PMID:25521905

Letter to the editor regarding "GRAS from the ground up: Review of the Interim Pilot Program for GRAS notification" by.

PubMed

Sewalt, Vincent; LaMarta, James; Shanahan, Diane; Gregg, Lori; Carrillo, Roberto

2017-09-01

Present letter is aimed at clarifying some critical points highlighted by Hanlon et al. regarding the common knowledge element of the safety of food enzymes in support of their GRAS designation. Particularly, we outline the development of peer-reviewed, generally recognized safety evaluation methodology for microbial enzymes and its adoption by the enzyme industry, which provides the US FDA with a review framework for enzyme GRAS Notices. This approach may serve as a model to other food ingredient categories for a scientifically sound, rigorous, and transparent application of the GRAS concept. Copyright © 2017 Elsevier Ltd. All rights reserved.

Food insecurity, sexual risk behavior, and adherence to antiretroviral therapy among women living with HIV: A systematic review.

PubMed

Chop, Elisabeth; Duggaraju, Avani; Malley, Angela; Burke, Virginia; Caldas, Stephanie; Yeh, Ping Teresa; Narasimhan, Manjulaa; Amin, Avni; Kennedy, Caitlin E

2017-09-01

Gender inequalities shape the experience of food insecurity among women living with HIV (WLHIV). We systematically reviewed the impact of food insecurity on sexual risk behaviors and antiretroviral therapy (ART) adherence among WLHIV. We included qualitative or quantitative peer-reviewed articles, extracted data in duplicate, and assessed rigor. Seven studies, from sub-Saharan Africa, North America, and Europe, met inclusion criteria. Food insecurity was associated with increased sexual risk through transactional sex and inability to negotiate safer sex. Hunger and food insecurity were barriers to ART initiation/adherence. Multidimensional programming and policies should simultaneously address poverty, gender inequality, food insecurity, and HIV.

Labor unions: a public health institution.

PubMed

Malinowski, Beth; Minkler, Meredith; Stock, Laura

2015-02-01

Using a social-ecological framework, we drew on a targeted literature review and historical and contemporary cases from the US labor movement to illustrate how unions address physical and psychosocial conditions of work and the underlying inequalities and social determinants of health. We reviewed labor involvement in tobacco cessation, hypertension control, and asthma, limiting articles to those in English published in peer-reviewed public health or medical journals from 1970 to 2013. More rigorous research is needed on potential pathways from union membership to health outcomes and the facilitators of and barriers to union-public health collaboration. Despite occasional challenges, public health professionals should increase their efforts to engage with unions as critical partners.

Peer review in design: Understanding the impact of collaboration on the review process and student perception

NASA Astrophysics Data System (ADS)

Mandala, Mahender Arjun

A cornerstone of design and design education is frequent situated feedback. With increasing class sizes, and shrinking financial and human resources, providing rich feedback to students becomes increasingly difficult. In the field of writing, web-based peer review--the process of utilizing equal status learners within a class to provide feedback to each other on their work using networked computing systems--has been shown to be a reliable and valid source of feedback in addition to improving student learning. Designers communicate in myriad ways, using the many languages of design and combining visual and descriptive information. This complex discourse of design intent makes peer reviews by design students ambiguous and often not helpful to the receivers of this feedback. Furthermore, engaging students in the review process itself is often difficult. Teams can complement individual diversity and may assist novice designers collectively resolve complex task. However, teams often incur production losses and may be impacted by individual biases. In the current work, we look at utilizing a collaborative team of reviewers, working collectively and synchronously, in generating web based peer reviews in a sophomore engineering design class. Students participated in a cross-over design, conducting peer reviews as individuals and collaborative teams in parallel sequences. Raters coded the feedback generated on the basis of their appropriateness and accuracy. Self-report surveys and passive observation of teams conducting reviews captured student opinion on the process, its value, and the contrasting experience they had conducting team and individual reviews. We found team reviews generated better quality feedback in comparison to individual reviews. Furthermore, students preferred conducting reviews in teams, finding the process 'fun' and engaging. We observed several learning benefits of using collaboration in reviewing including improved understanding of the assessment criteria, roles, expectations, and increased team reflection. These results provide insight into how to improve the review process for instructors and researchers, and forms a basis for future research work in this area. With respect to facilitating peer review process in design based classrooms, we also present recommendations for creating effective review system design and implementation in classroom supported by research and practical experience.

In ... and out: open access publishing in scientific journals.

PubMed

Boumil, Marcia M; Salem, Deeb N

2014-01-01

Open access (OA) journals are a growing phenomenon largely of the past decade wherein readers can access the content of scientific journals without paying for a subscription. The costs are borne by authors (or their institutions) who pay a fee to be published, thus allowing readers to access, search, print, and cite the journals without cost. Although the OA model, in and of itself, need not diminish scientific rigor, selectivity, or peer review, the "author pays" model creates an inherent conflict of interest: it operates with the incentive on the part of the journal to publish more and reject less. This is coupled with cost containment measures that affect the journals' ability to engage experienced editors and professional staff to scrutinize data, data analyses, and author conflicts of interest. While some OA journals appear to be comparable to their print competitors, others are "predatory" and have no legitimacy at all. Two recent "scams"--one recently published in Science--highlight the urgency of addressing the issues raised by OA publication so that OA does not lose its credibility just as it begins to gather substantial momentum. High-quality journals develop their reputations over time, and OA outlets will be no exception. For this to occur, however, the OA audience will need to be satisfied that OA can deliver high-quality publications utilizing rigorous peer review, editing, and conflict of interest scrutiny. Academic tenure and promotion committees that review scholarly credentials are understandably skeptical of publications in unrecognized journals, and the large number of new OA outlets contributes to this urgency from their perspective as well.

Collaborative peer review process as an informal interprofessional learning tool: Findings from an exploratory study.

PubMed

Kwon, Jae Yung; Bulk, Laura Yvonne; Giannone, Zarina; Liva, Sarah; Chakraborty, Bubli; Brown, Helen

2018-01-01

Despite numerous studies on formal interprofessional education programes, less attention has been focused on informal interprofessional learning opportunities. To provide such an opportunity, a collaborative peer review process (CPRP) was created as part of a peer-reviewed journal. Replacing the traditional peer review process wherein two or more reviewers review the manuscript separately, the CPRP brings together students from different professions to collaboratively review a manuscript. The aim of this study was to assess whether the CPRP can be used as an informal interprofessional learning tool using an exploratory qualitative approach. Eight students from Counselling Psychology, Occupational and Physical Therapy, Nursing, and Rehabilitation Sciences were invited to participate in interprofessional focus groups. Data were analysed inductively using thematic analysis. Two key themes emerged, revealing that the CPRP created new opportunities for interprofessional learning and gave practice in negotiating feedback. The results reveal that the CPRP has the potential to be a valuable interprofessional learning tool that can also enhance reviewing and constructive feedback skills.

Peer review.

PubMed

Twaij, H; Oussedik, S; Hoffmeyer, P

2014-04-01

The maintenance of quality and integrity in clinical and basic science research depends upon peer review. This process has stood the test of time and has evolved to meet increasing work loads, and ways of detecting fraud in the scientific community. However, in the 21st century, the emphasis on evidence-based medicine and good science has placed pressure on the ways in which the peer review system is used by most journals. This paper reviews the peer review system and the problems it faces in the digital age, and proposes possible solutions.

Peer Assessment with Online Tools to Improve Student Modeling

NASA Astrophysics Data System (ADS)

Atkins, Leslie J.

2012-11-01

Introductory physics courses often require students to develop precise models of phenomena and represent these with diagrams, including free-body diagrams, light-ray diagrams, and maps of field lines. Instructors expect that students will adopt a certain rigor and precision when constructing these diagrams, but we want that rigor and precision to be an aid to sense-making rather than meeting seemingly arbitrary requirements set by the instructor. By giving students the authority to develop their own models and establish requirements for their diagrams, the sense that these are arbitrary requirements diminishes and students are more likely to see modeling as a sense-making activity. The practice of peer assessment can help students take ownership; however, it can be difficult for instructors to manage. Furthermore, it is not without risk: students can be reluctant to critique their peers, they may view this as the job of the instructor, and there is no guarantee that students will employ greater rigor and precision as a result of peer assessment. In this article, we describe one approach for peer assessment that can establish norms for diagrams in a way that is student driven, where students retain agency and authority in assessing and improving their work. We show that such an approach does indeed improve students' diagrams and abilities to assess their own work, without sacrificing students' authority and agency.

Applying Peer Reviews in Software Engineering Education: An Experiment and Lessons Learned

ERIC Educational Resources Information Center

Garousi, V.

2010-01-01

Based on the demonstrated value of peer reviews in the engineering industry, numerous industry experts have listed it at the top of the list of desirable development practices. Experience has shown that problems (defects) are eliminated earlier if a development process incorporates peer reviews and that these reviews are as effective as or even…

SU-E-T-211: Peer Review System for Ensuring Quality of Radiation Therapy Treatments.

PubMed

Kapoor, R; Kapur, P; Kumar, S A; Alex, D; Ranka, S; Palta, J

2012-06-01

To demonstrate a Web-based electronic peer review system that has the potential to improve quality of care for radiation therapy patients. The system provides tools that allow radiation oncologists to seek peer review of target and critical structure delineation, treatment plans, and share clinical data with peers to optimize radiation therapy treatments. Peer review of radiation therapy treatment planning data prior to its initiation improves the quality of radiation therapy and clinical outcomes. Web-based access to radiation therapy treatment planning data and medical records mitigate existing geographical and temporal constraints. With internet access, the healthcare provider can access the data from any location and review it in an interactive and collaborative manner. Interoperability standard like DICOM-RT and IHE-RO compliant RT Systems have facilitated the design and implementation of PRS with Silverlight Web technology, .net Framework and SQL Server. Local DICOM-RT archive and cloud based services are deployed to facilitate remote peer reviews. To validate the PRS system, we tested the system for 100 patients with Philips Pinnacle v 9.0 and Varian Eclipse v 8.9 treatment planning system (TPS). We transmitted the DICOM RT data from the TPS to the cloud based services via the PRS local DICOM RT Archive. Various CT simulation based parameters such as orientation of CT, properties of RT structures etc. were compared between the TPS and PRS system. Data integrity of other parameters such as patient demographics (patient name, ID, attending physician etc.) and dose volume related parameters were also evaluated. Such rigorous testing allowed us to optimize the functionalities and clinical implementation of the PRS. We believe that the PRS will improve the quality and safety of a broad spectrum of radiation therapy patients treated in underserved areas while discouraging the overutilization of expensive radiation treatment modalities. This research and development project is supported by the James and Ester King Biomedical Research Program grant # RC1-09KW-09-26829. © 2012 American Association of Physicists in Medicine.

Studying the Study Section: How Group Decision Making in Person and via Videoconferencing Affects the Grant Peer Review Process. WCER Working Paper No. 2015-6

ERIC Educational Resources Information Center

Pier, Elizabeth L.; Raclaw, Joshua; Nathan, Mitchell J.; Kaatz, Anna; Carnes, Molly; Ford, Cecilia E.

2015-01-01

Grant peer review is a foundational component of scientific research. In the context of grant review meetings, the review process is a collaborative, socially mediated, locally constructed decision-making task. The current study examines how collaborative discussion affects reviewers' scores of grant proposals, how different review panels score…

Critical Analysis of Strategies for Determining Rigor in Qualitative Inquiry.

PubMed

Morse, Janice M

2015-09-01

Criteria for determining the trustworthiness of qualitative research were introduced by Guba and Lincoln in the 1980s when they replaced terminology for achieving rigor, reliability, validity, and generalizability with dependability, credibility, and transferability. Strategies for achieving trustworthiness were also introduced. This landmark contribution to qualitative research remains in use today, with only minor modifications in format. Despite the significance of this contribution over the past four decades, the strategies recommended to achieve trustworthiness have not been critically examined. Recommendations for where, why, and how to use these strategies have not been developed, and how well they achieve their intended goal has not been examined. We do not know, for example, what impact these strategies have on the completed research. In this article, I critique these strategies. I recommend that qualitative researchers return to the terminology of social sciences, using rigor, reliability, validity, and generalizability. I then make recommendations for the appropriate use of the strategies recommended to achieve rigor: prolonged engagement, persistent observation, and thick, rich description; inter-rater reliability, negative case analysis; peer review or debriefing; clarifying researcher bias; member checking; external audits; and triangulation. © The Author(s) 2015.

Dyads versus Groups: Using Different Social Structures in Peer Review to Enhance Online Collaborative Learning Processes

ERIC Educational Resources Information Center

Pozzi, Francesca; Ceregini, Andrea; Ferlino, Lucia; Persico, Donatella

2016-01-01

The Peer Review (PR) is a very popular technique to support socio-constructivist and connectivist learning processes, online or face-to-face, at all educational levels, in both formal and informal contexts. The idea behind this technique is that sharing views and opinions with others by discussing with peers and receiving and providing formative…

A Review of Sex Differences in Peer Relationship Processes: Potential Trade-Offs for the Emotional and Behavioral Development of Girls and Boys

ERIC Educational Resources Information Center

Rose, Amanda J.; Rudolph, Karen D.

2006-01-01

Theory and research on sex differences in adjustment focus largely on parental, societal, and biological influences. However, it also is important to consider how peers contribute to girls' and boys' development. This article provides a critical review of sex differences in several peer relationship processes, including behavioral and…

Peer review of human studies run amok: a break in the fiduciary relation between scientists and the public.

PubMed

Feldstein Ewing, Sarah W; Saitz, Richard

2015-02-01

Peer review aims to ensure the quality and credibility of research reporting. Conducted by volunteer scientists who receive no guidance or direction, peer review widely varies from fast and facilitative, to unclear and obstructive. Poor quality is an issue because most science research is publicly funded, whereby scientists must make an effort to quickly disseminate their findings back to the public. An unfortunately not uncommon barrier in this process is ineffective peer review. Most scientists agree that when done well, editors and reviewers drive and maintain the high standards of science. At the same time, ineffective peer review can cause great delay with no introduced improvement in final product. These delays and requests interfere with the path of communication between scientist and public, at a great cost to editors, reviewers, authors and those who stand to benefit from application of the results of the studies. We offer a series of concrete recommendations to improve this process.

The "peer" in "peer review"

USGS Publications Warehouse

Perry, Gad; Bertoluci, Jaime; Bury, R. Bruce; Hansen, Robert W.; Jehle, Robert; Measey, John; Moon, Brad R.; Muths, Erin L.; Zuffi, Marco A.L.

2011-01-01

Peer review is the best available mechanism for assessing and improving the quality of scientific work. As herpetology broadens its disciplinary and geographic boundaries, high-quality external review is ever more essential. We are writing this editorial jointly because the review process has become increasingly difficult. The resulting delays slow publication times, negatively affect performance reviews, tenure, promotions, and grant proposal success. It harms authors, agencies, and institutions (Ware 2011).

Validity of peer grading using Calibrated Peer Review in a guided-inquiry, conceptual physics course

NASA Astrophysics Data System (ADS)

Price, Edward; Goldberg, Fred; Robinson, Steve; McKean, Michael

2016-12-01

Constructing and evaluating explanations are important science practices, but in large classes it can be difficult to effectively engage students in these practices and provide feedback. Peer review and grading are scalable instructional approaches that address these concerns, but which raise questions about the validity of the peer grading process. Calibrated Peer Review (CPR) is a web-based system that scaffolds peer evaluation through a "calibration" process where students evaluate sample responses and receive feedback on their evaluations before evaluating their peers. Guided by an activity theory framework, we developed, implemented, and evaluated CPR-based tasks in guided-inquiry, conceptual physics courses for future teachers and general education students. The tasks were developed through iterative testing and revision. Effective tasks had specific and directed prompts and evaluation instructions. Using these tasks, over 350 students at three universities constructed explanations or analyzed physical phenomena, and evaluated their peers' work. By independently assessing students' responses, we evaluated the CPR calibration process and compared students' peer reviews with expert evaluations. On the tasks analyzed, peer scores were equivalent to our independent evaluations. On a written explanation item included on the final exam, students in the courses using CPR outperformed students in similar courses using traditional writing assignments without a peer evaluation element. Our research demonstrates that CPR can be an effective way to explicitly include the science practices of constructing and evaluating explanations into large classes without placing a significant burden on the instructor.

Reporting and publishing guidelines: article 12 in Integrating and coordinating efforts in COPD guideline development. An official ATS/ERS workshop report.

PubMed

Wilson, Kevin C; Irwin, Richard S; File, Thomas M; Schünemann, Holger J; Guyatt, Gordon H; Rabe, Klaus F

2012-12-01

Professional societies, like many other organizations around the world, have recognized the need to use rigorous processes to ensure that health care recommendations are informed by the best available research evidence. This is the twelfth of a series of 14 articles that were prepared to advise guideline developers in respiratory and other diseases. This article discusses the reporting and publishing of guidelines. The authors formulated and discussed the following questions on the reporting and publishing of guidelines. (1) What should be reported in guidelines? (2) How should guidelines be written? (3) How should the bottom-line message be conveyed? (4) How should guidelines be packaged? (5) Where should guidelines be published? (6) Who benefits from the publication of guidelines? (7) What information should be vetted by the editor(s)? (8) How should guidelines be peer reviewed? We conducted a review of the literature, looking for systematic reviews and methodological research that addressed these questions, but we did not conduct a full systematic review. Our conclusions are based on the available evidence from the published literature and logical arguments from experienced guideline developers. There is little empirical evidence that addresses the reporting and publishing of guidelines. A standard format for reporting guidelines is desirable to ensure that guidelines are comprehensive and that all of the information necessary to judge their quality is presented. In addition, guidelines should contain concise evidence-based recommendations. To facilitate the use of guidelines by consumers, it is preferable to publish them in journals that serve the target audience and to package them in multiple ways. Editors and peer reviewers should ensure that reporting standards have been met, potential conflicts of interest have been adequately addressed and made public, and that the recommendations address important clinical questions.

Duration and quality of the peer review process: the author's perspective.

PubMed

Huisman, Janine; Smits, Jeroen

2017-01-01

To gain insight into the duration and quality of the scientific peer review process, we analyzed data from 3500 review experiences submitted by authors to the SciRev.sc website. Aspects studied are duration of the first review round, total review duration, immediate rejection time, the number, quality, and difficulty of referee reports, the time it takes authors to revise and resubmit their manuscript, and overall quality of the experience. We find clear differences in these aspects between scientific fields, with Medicine, Public health, and Natural sciences showing the shortest durations and Mathematics and Computer sciences, Social sciences, Economics and Business, and Humanities the longest. One-third of journals take more than 2 weeks for an immediate (desk) rejection and one sixth even more than 4 weeks. This suggests that besides the time reviewers take, inefficient editorial processes also play an important role. As might be expected, shorter peer review processes and those of accepted papers are rated more positively by authors. More surprising is that peer review processes in the fields linked to long processes are rated highest and those in the fields linked to short processes lowest. Hence authors' satisfaction is apparently influenced by their expectations regarding what is common in their field. Qualitative information provided by the authors indicates that editors can enhance author satisfaction by taking an independent position vis-à-vis reviewers and by communicating well with authors.

Networking and knowledge exchange to promote the formation of transdisciplinary coalitions and levels of agreement among transdisciplinary peer reviewers.

PubMed

Lobb, Rebecca; Petermann, Lisa; Manafo, Elizabeth; Keen, Deb; Kerner, Jon

2013-01-01

Funding for transdisciplinary chronic disease prevention research has increased over the past decade. However, few studies have evaluated whether networking and knowledge exchange activities promote the creation of transdisciplinary teams to successfully respond to requests for proposals (RFPs). Such evaluations are critical to understanding how to accelerate the integration of research with practice and policy to improve population health. To examine (1) the extent of participation in pre-RFP activities among funded and nonfunded transdisciplinary coalitions that responded to a RFP for cancer and chronic disease prevention initiatives and (2) levels of agreement in proposal ratings among research, practice, and policy peer reviewers. Descriptive report of a Canadian funding initiative to increase the integration of evidence with action. Four hundred forty-nine representatives in 41 research, practice, and policy coalitions who responded to a RFP and whose proposals were peer reviewed by a transdisciplinary adjudication panel. The funder hosted 6 national meetings and issued a letter of intent (LOI) to foster research, practice, and policy collaborations before issuing a RFP. All provinces and territories in Canada were represented by the coalitions. Funded coalitions were 2.5 times more likely than nonfunded coalitions to submit a LOI. A greater proportion of funded coalitions were exposed to the pre-RFP activities (100%) compared with coalitions that were not funded (68%). Overall research, practice, and policy peer reviewer agreement was low (intraclass correlation 0.12). There is widespread interest in transdisciplinary collaborations to improve cancer and chronic disease prevention. Engagement in networking and knowledge exchange activities, and feedback from LOIs prior to submission of a final application, may contribute to stronger proposals and subsequent funding success. Future evaluations should examine best practices for transdisciplinary peer review to facilitate funding of proposals that on balance have both scientific rigor and are relevant to the real world.

Influence of Peer Effects on Learning Outcomes: A Review of the Literature.

ERIC Educational Resources Information Center

Wilkinson, Ian A. G.; Hattie, John A.; Parr, Judy M.; Townsend, Michael A. R.; Fung, Irene; Ussher, Charlotte; Thrupp, Martin; Lauder, Hugh; Robinson, Tony

This report presents a literature review and conceptual model summarizing the influence of peer effects on learning outcomes. The report describes the approach to the review and provides a theoretical account of the environments, mechanisms, and processes that mediate learning among peers. It then summarizes the literature on compositional effects…

Peer Review: The CHAMPUS Program.

ERIC Educational Resources Information Center

Stricker, George

This paper examines the use of the peer review system in evaluating out-patient clinical services for a third-party payer seeking justification for payment of services. Peer review is defined as a process by which one professional, in an official capacity, makes a judgment about a co-professional in a matter involving professional functioning. The…

Fairness in peer review

NASA Astrophysics Data System (ADS)

Adams, Bob

2014-06-01

In reply to Penny Gowland's article “Turning a double-blind eye” (Forum, May p17), which argued that a paper's authors, as well as its reviewers, should be anonymous during the peer-review process.

Do peer review models affect clinicians' trust in journals? A survey of junior doctors.

PubMed

Patel, Jigisha; Pierce, Mary; Boughton, Stephanie L; Baldeweg, Stephanie E

2017-01-01

The aim of this survey was to determine the level of awareness and understanding of peer review and peer review models amongst junior hospital doctors and whether this influences clinical decision-making. A 30-question online anonymous survey was developed aimed at determining awareness of peer review models and the purpose of peer review, perceived trustworthiness of different peer review models and the role of peer review in clinical decision-making. It was sent to 800 trainee doctors in medical specialties on the University College London Partners trainee database. The response rate was (178/800) 22%. Most respondents were specialist registrars. Checking that research is conducted correctly (152/178, 85%) and the data interpreted correctly (148/178, 83%) were viewed as the most important purposes of peer review. Most respondents were aware of open (133/178, 75%), double-blind (125/178, 70%) and single-blind peer review (121/178, 68%). 101/178 (57%) had heard of collaborative, 87/178 (49%) of post publication and 29/178 (16%) of decoupled peer review. Of those who were aware of double-blind, single-blind open and collaborative peer review, 85 (68%), 82 (68%), 74 (56%) and 24 (24%), respectively, understood how they worked. The NEJM , Lancet and The BMJ were deemed to have most trustworthy peer review, 137/178 (77%), 129/178 (72%) and 115/178 (65%), respectively. That peer review had taken place was important for a journal content to be used for clinical decision-making 152/178 (85%), but the ability to see peer review reports was not as important 22/178 (12%). Most felt there was a need for peer review training and that this should be at the specialist registrar stage of training. Junior hospital doctors view peer review to be important as a means of quality control, but do not value the ability to scrutinize peer review themselves. The unquestioning acceptance of peer review as final validation in the field of medicine emphasises not only the responsibility held by medical journals to ensure peer review is done well but also the need to raise awareness amongst the medical community of the limitations of the current peer review process.

Writing and Publishing a Research Paper in a Peer-Reviewed Journal

ERIC Educational Resources Information Center

Porter, Stephen R.

2007-01-01

Writing and publishing a research paper in a peer-reviewed journal is a complicated process. This paper tries to take some of the mystery out of that process by describing how a good research paper should be structured, and how the journal submission process works.

The Peer Review Process: Confidentiality and Disclosure.

ERIC Educational Resources Information Center

Weeks, Kent M.

1990-01-01

This article focuses on techniques some courts have utilized to balance the tensions between the aggrieved faculty members who allege discrimination--sex, race, national origin, handicap, age--in the promotion process and who seek disclosure of the peer review process and the colleges at which the charges are levied. (MLW)

Why Are Chemists and Other Scientists Afraid of the Peer Review of Teaching?

NASA Astrophysics Data System (ADS)

Atwood, Charles H.; Taylor, James W.; Hutchings, Pat A.

2000-02-01

This paper presents a series of arguments that teaching should be subjected to the similar review standards that chemical research employs. Through peer review, the hope is to elevate the status of teaching in academe. The paper also describes a national effort through the American Association for Higher Education and the Carnegie Foundation for the Advancement of Teaching to establish a peer-review process appropriate for teaching. Finally, an examination of some of the perceived barriers to peer review, including fear, is detailed.

A Method for Improving the Integrity of Peer Review.

PubMed

Dadkhah, Mehdi; Kahani, Mohsen; Borchardt, Glenn

2017-08-15

Peer review is the most important aspect of reputable journals. Without it, we would be unsure about whether the material published was as valid and reliable as is possible. However, with the advent of the Internet, scientific literature has now become subject to a relatively new phenomenon: fake peer reviews. Some dishonest researchers have been manipulating the peer review process to publish what are often inferior papers. There are even papers that explain how to do it. This paper discusses one of those methods and how editors can defeat it by using a special review ID. This method is easy to understand and can be added to current peer review systems easily.

A Systematic Appraisal of Peer Review Guidelines for Special Education Journals

ERIC Educational Resources Information Center

Maggin, Daniel M.; Chafouleas, Sandra M.; Berggren, Melissa; Sugai, George

2013-01-01

The evidence-based practice movement in special education has emphasized the use of the scientific process to assist with the identification of effective academic and behavioral strategies. An important but often overlooked aspect of this system is the peer review process in which manuscripts submitted for publication are reviewed by experts to…

Old boy network?

NASA Astrophysics Data System (ADS)

Friebele, Elaine

Ideally, peer review is an objective process. In reality, scientists who are male or have a connection to the reviewer receive higher peer review scores than their counterparts with equal qualifications. These findings were published in the May 22 issue of Nature, by Swedish researchers Christine Wennerås and Agnes Wold, who obtained access to peer-reviewers'scores for postdoctoral fellowship applications to the Swedish Medical Research Council in 1995. Using six independent, objective criteria of “scientific productivity,”Wennerås and Wold, of the University of Goteborg, Sweden, found that women systematically scored significantly lower in the peer review process than men for the same level of scientific productivity. Applicants who were associated with reviewers also scored consistently better than those who were not. Scores were not significantly affected by the education, nationality, field of research, or postdoctoral experience of the applicant.

IAU astroEDU: an open-access platform for peer-reviewed astronomy education activities

NASA Astrophysics Data System (ADS)

Heenatigala, Thilina; Russo, Pedro; Strubbe, Linda; Gomez, Edward

2015-08-01

astroEDU is an open access platform for peer-reviewed astronomy education activities. It addresses key problems in educational repositories such as variability in quality, not maintained or updated regularly, limited content review, and more. This is achieved through a peer-review process similar to what scholarly articles are based on. Activities submitted are peer-reviewed by an educator and a professional astronomer which gives the credibility to the activities. astroEDU activities are open-access in order to make the activities accessible to educators around the world while letting them discover, review, distribute and remix the activities. The activity submission process allows authors to learn how to apply enquiry-based learning into the activity, identify the process skills required, how to develop core goals and objectives, and how to evaluate the activity to determine the outcome. astroEDU is endorsed by the International Astronomical Union meaning each activity is given an official stamp by the international organisation for professional astronomers.

A Study of Technical Engineering Peer Reviews at NASA

NASA Technical Reports Server (NTRS)

Chao, Lawrence P.; Tumer, Irem Y.; Bell, David G.

2003-01-01

This report describes the state of practices of design reviews at NASA and research into what can be done to improve peer review practices. There are many types of reviews at NASA: required and not, formalized and informal, programmatic and technical. Standing project formal reviews such as the Preliminary Design Review and Critical Design Review are a required part of every project and mission development. However, the technical, engineering peer reviews that support teams' work on such projects are informal, some times ad hoc, and inconsistent across the organization. The goal of this work is to identify best practices and lessons learned from NASA's experience, supported by academic research and methodologies to ultimately improve the process. This research has determined that the organization, composition, scope, and approach of the reviews impact their success. Failure Modes and Effects Analysis (FMEA) can identify key areas of concern before or in the reviews. Product definition tools like the Project Priority Matrix, engineering-focused Customer Value Chain Analysis (CVCA), and project or system-based Quality Function Deployment (QFD) help prioritize resources in reviews. The use of information technology and structured design methodologies can strengthen the engineering peer review process to help NASA work towards error-proofing the design process.

Peer Acceptance and Friendship in Early Childhood: The Conceptual Distinctions between Them

ERIC Educational Resources Information Center

Beazidou, Eleftheria; Botsoglou, Kafenia

2016-01-01

This paper reviews previous literature about peer acceptance and friendship, two of the most critical aspects of peer relations that have received most of research attention during the past years. In this review, we will focus on the processes explaining the way children use the ability to socialise with peers; explore the hypothesis that certain…

Peer Response to L2 Student Writing: Patterns and Expectations

ERIC Educational Resources Information Center

Abdalla Salih, Abdel Rahman

2013-01-01

This paper reports the corrective feedback patterns in L2 writing and the student writers' preferences for peer feedback. The study examines the actual focus of peer review and the types of corrective feedback provided in L2 composing process. Sixteen L2 matriculation students at a Malaysian university took part in five peer review sessions,…

Extending Marine Species Distribution Maps Using Non-Traditional Sources

PubMed Central

Moretzsohn, Fabio; Gibeaut, James

2015-01-01

Abstract Background Traditional sources of species occurrence data such as peer-reviewed journal articles and museum-curated collections are included in species databases after rigorous review by species experts and evaluators. The distribution maps created in this process are an important component of species survival evaluations, and are used to adapt, extend and sometimes contract polygons used in the distribution mapping process. New information During an IUCN Red List Gulf of Mexico Fishes Assessment Workshop held at The Harte Research Institute for Gulf of Mexico Studies, a session included an open discussion on the topic of including other sources of species occurrence data. During the last decade, advances in portable electronic devices and applications enable 'citizen scientists' to record images, location and data about species sightings, and submit that data to larger species databases. These applications typically generate point data. Attendees of the workshop expressed an interest in how that data could be incorporated into existing datasets, how best to ascertain the quality and value of that data, and what other alternate data sources are available. This paper addresses those issues, and provides recommendations to ensure quality data use. PMID:25941453

Animal-assisted intervention for autism spectrum disorder: a systematic literature review.

PubMed

O'Haire, Marguerite E

2013-07-01

The inclusion of animals in therapeutic activities, known as animal-assisted intervention (AAI), has been suggested as a treatment practice for autism spectrum disorder (ASD). This paper presents a systematic review of the empirical research on AAI for ASD. Fourteen studies published in peer-reviewed journals qualified for inclusion. The presentation of AAI was highly variable across the studies. Reported outcomes included improvements for multiple areas of functioning known to be impaired in ASD, namely increased social interaction and communication as well as decreased problem behaviors, autistic severity, and stress. Yet despite unanimously positive outcomes, most studies were limited by many methodological weaknesses. This review demonstrates that there is preliminary "proof of concept" of AAI for ASD and highlights the need for further, more rigorous research.

Bound by Tradition? Peer Review and New Scholarship: An Institutional Case Study

ERIC Educational Resources Information Center

White, Barbara Jo; Cruz, Laura; Ellern, Jill; Ford, George; Moss, Hollye

2012-01-01

Peer review is by no means a routine process for traditional, or basic, research. Even so, peer review is even less routinized for other forms of scholarship. In 1990, Ernest Boyer called for a reconsideration of scholarship and extended the definition to be inclusive of non-traditional modes of scholarly production and delivery. However, peer…

Redefining the Practice of Peer Review Through Intelligent Automation-Part 3: Automated Report Analysis and Data Reconciliation.

PubMed

Reiner, Bruce I

2018-02-01

One method for addressing existing peer review limitations is the assignment of peer review cases on a completely blinded basis, in which the peer reviewer would create an independent report which can then be cross-referenced with the primary reader report of record. By leveraging existing computerized data mining techniques, one could in theory automate and objectify the process of report data extraction, classification, and analysis, while reducing time and resource requirements intrinsic to manual peer review report analysis. Once inter-report analysis has been performed, resulting inter-report discrepancies can be presented to the radiologist of record for review, along with the option to directly communicate with the peer reviewer through an electronic data reconciliation tool aimed at collaboratively resolving inter-report discrepancies and improving report accuracy. All associated report and reconciled data could in turn be recorded in a referenceable peer review database, which provides opportunity for context and user-specific education and decision support.

Research Integrity and Peer Review-past highlights and future directions.

PubMed

Boughton, Stephanie L; Kowalczuk, Maria K; Meerpohl, Joerg J; Wager, Elizabeth; Moylan, Elizabeth C

2018-01-01

In May 2016, we launched Research Integrity and Peer Review , an international, open access journal with fully open peer review (reviewers are identified on their reports and named reports are published alongside the article) to provide a home for research on research and publication ethics, research reporting, and research on peer review. As the journal enters its third year, we reflect on recent events and highlights for the journal and explore how the journal is faring in terms of gender and diversity in peer review. We also share the particular interests of our Editors-in-Chief regarding models of peer review, reporting quality, common research integrity issues that arise during the publishing process, and how people interact with the published literature. We continue to encourage further research into peer review, research and publication ethics and research reporting, as we believe that all new initiatives should be evidence-based. We also remain open to constructive discussions of the developments in the field that offer new solutions.

Taking peer victimization research to the next level: complex interactions among genes, teacher attitudes/behaviors, peer ecologies, & classroom characteristics.

PubMed

Espelage, Dorothy L

2015-01-01

This commentary reviews research findings of the five papers in the special entitled "School-related Factors in the Development of Bullying Perpetration and Victimization", which represent critical areas that are often overlooked in the literature. First, one paper points to the complex interaction between a genetic disposition for aggression and classroom norms toward aggression. Second, an intervention paper unpacks the underlying mechanisms of an efficacious school-wide bully prevention program by opening the "black box" and testing for mediators. Third, the remaining studies employ a wide range of rigorous designs to identify how teachers' attitudes, behaviors, and classroom practices play a critical role in the prevalence of victimization and bullying in the classroom. Further, teachers' attitudes and behaviors are shown to be predictive of youth's willingness to intervene to assist a peer who is being victimized. Results are situated in what is known about bullying prevention, and how the findings from these studies could maximize the sensitivity of future prevention efforts.

Validity and reliability of instruments aimed at measuring Evidence-Based Practice in Physical Therapy: a systematic review of the literature.

PubMed

Fernández-Domínguez, Juan Carlos; Sesé-Abad, Albert; Morales-Asencio, Jose Miguel; Oliva-Pascual-Vaca, Angel; Salinas-Bueno, Iosune; de Pedro-Gómez, Joan Ernest

2014-12-01

Our goal is to compile and analyse the characteristics - especially validity and reliability - of all the existing international tools that have been used to measure evidence-based clinical practice in physiotherapy. A systematic review conducted with data from exclusively quantitative-type studies synthesized in narrative format. An in-depth search of the literature was conducted in two phases: initial, structured, electronic search of databases and also journals with summarized evidence; followed by a residual-directed search in the bibliographical references of the main articles found in the primary search procedure. The studies included were assigned to members of the research team who acted as peer reviewers. Relevant information was extracted from each of the selected articles using a template that included the general characteristics of the instrument as well as an analysis of the quality of the validation processes carried out, by following the criteria of Terwee. Twenty-four instruments were found to comply with the review screening criteria; however, in all cases, they were found to be limited as regards the 'constructs' included. Besides, they can all be seen to be lacking as regards comprehensiveness associated to the validation process of the psychometric tests used. It seems that what constitutes a rigorously developed assessment instrument for EBP in physical therapy continues to be a challenge. © 2014 John Wiley & Sons, Ltd.

Optimal strategies to consider when peer reviewing a systematic review and meta-analysis.

PubMed

Moher, David

2015-11-02

Systematic reviews are popular. A recent estimate indicates that 11 new systematic reviews are published daily. Nevertheless, evidence indicates that the quality of reporting of systematic reviews is not optimal. One likely reason is that the authors' reports have received inadequate peer review. There are now many different types of systematic reviews and peer reviewing them can be enhanced by using a reporting guideline to supplement whatever template the journal editors have asked you, as a peer reviewer, to use. Additionally, keeping up with the current literature, whether as a content expert or being aware of advances in systematic review methods is likely be make for a more comprehensive and effective peer review. Providing a brief summary of what the systematic review has reported is an important first step in the peer review process (and not performed frequently enough). At its core, it provides the authors with some sense of what the peer reviewer believes was performed (Methods) and found (Results). Importantly, it also provides clarity regarding any potential problems in the methods, including statistical approaches for meta-analysis, results, and interpretation of the systematic review, for which the peer reviewer can seek explanations from the authors; these clarifications are best presented as questions to the authors.

The Central Asian Journal of Global Health to Increase Scientific Productivity.

PubMed

Freese, Kyle; Shubnikov, Eugene; LaPorte, Ron; Adambekov, Shalkar; Askarova, Sholpan; Zhumadilov, Zhaxybay; Linkov, Faina

2013-01-01

The WHO Collaborating Center at the University of Pittsburgh, USA partnering with Nazarbayev University, developed the Central Asian Journal of Global Health (CAJGH, cajgh.pitt.edu) in order to increase scientific productivity in Kazakhstan and Central Asia. Scientists in this region often have difficulty publishing in upper tier English language scientific journals due to language barriers, high publication fees, and a lack of access to mentoring services. CAJGH seeks to help scientists overcome these challenges by providing peer-reviewed publication free of change with English and research mentoring services available to selected authors. CAJGH began as a way to expand the Supercourse scientific network (www.pitt.edu/~super1) in the Central Asian region in order to rapidly disseminate educational materials. The network began with approximately 60 individuals in five Central Asian countries and has grown to over 1,300 in a few short years. The CAJGH website receives nearly 900 visits per month. The University of Pittsburgh's "open access publishing system" was utilized to create CAJGH in 2012. There are two branches of the CAJGH editorial board: Astana (at the Center for Life Sciences, Nazarbayev University) and Pittsburgh (WHO Collaborating Center). Both are comprised of leading scientists and expert staff who work together throughout the review and publication process. Two complete issues have been published since 2012 and a third is now underway. Even though CAJGH is a new journal, the editorial board uses a rigorous review process; fewer than 50% of all submitted articles are forwarded to peer review or accepted for publication. Furthermore, in 2014, CAJGH will apply to be cross referenced in PubMed and Scopes. CAJGH is one of the first English language journals in the Central Asian region that reaches a large number of scientists. This journal fills a unique niche that will assist scientists in Kazakhstan and Central Asia publish their research findings and share their knowledge with others around the region and the world.

Review & Peer Review of “Parameters for Properly Designed and Operated Flares” Documents

EPA Pesticide Factsheets

This page contains two 2012 memoranda on the review of EPA's parameters for properly designed and operated flares. One details the process of peer review, and the other provides background information and specific charge questions to the panel.

Beyond Homophily: A Decade of Advances in Understanding Peer Influence Processes

ERIC Educational Resources Information Center

Brechwald, Whitney A.; Prinstein, Mitchell J.

2011-01-01

This article reviews empirical and theoretical contributions to a multidisciplinary understanding of peer influence processes in adolescence over the past decade. Five themes of peer influence research from this decade were identified, including a broadening of the range of behaviors for which peer influence occurs, distinguishing the sources of…

The Peer Education Approach in Adolescents- Narrative Review Article.

PubMed

Abdi, Fatemeh; Simbar, Masoumeh

2013-11-01

Adolescence is an important stage of human life span, which crucial developmental processes occur. Since peers play a critical role in the psychosocial development of most adolescents, peer education is currently considered as a health promotion strategy in adolescents. Peer education is defined as a system of delivering knowledge that improves social learning and provides psychosocial support. As identifying the outcomes of different educational approaches will be beneficial in choosing the most effective programs for training adolescents, the present article reviewed the impact of the peer education approach on adolescents. In this review, databases such as PubMed, EMBASE, ISI, and Iranian databases, from 1999 to 2013, were searched using a number of keywords. Peer education is an effective tool for promoting healthy behaviors among adolescents. The development of this social process depends on the settings, context, and the values and expectations of the participants. Therefore, designing such programs requires proper preparation, training, supervision, and evaluation.

The objective impact of clinical peer review on hospital quality and safety.

PubMed

Edwards, Marc T

2011-01-01

Despite its importance, the objective impact of clinical peer review on the quality and safety of care has not been studied. Data from 296 acute care hospitals show that peer review program and related organizational factors can explain up to 18% of the variation in standardized measures of quality and patient safety. The majority of programs rely on an outmoded and dysfunctional process model. Adoption of best practices informed by the continuing study of peer review program effectiveness has the potential to significantly improve patient outcomes.

Sodium Bearing Waste Processing Alternatives Analysis

DOE Office of Scientific and Technical Information (OSTI.GOV)

Murphy, James Anthony; Palmer, Brent J; Perry, Keith Joseph

2003-12-01

A multidisciplinary team gathered to develop a BBWI recommendation to DOE-ID on the processing alternatives for the sodium bearing waste in the INTEC Tank Farm. Numerous alternatives were analyzed using a rigorous, systematic approach. The data gathered were evaluated through internal and external peer reviews for consistency and validity. Three alternatives were identified to be top performers: Risk-based Calcination, MACT to WIPP Calcination and Cesium Ion Exchange. A dual-path through early Conceptual design is recommended for MACT to WIPP Calcination and Cesium Ion Exchange since Risk-based Calcination does not require design. If calcination alternatives are not considered based on givingmore » Type of Processing criteria significantly greater weight, the CsIX/TRUEX alternative follows CsIX in ranking. However, since CsIX/TRUEX shares common uncertainties with CsIX, reasonable backups, which follow in ranking, are the TRUEX and UNEX alternatives. Key uncertainties must be evaluated by the decision-makers to choose one final alternative. Those key uncertainties and a path forward for the technology roadmapping of these alternatives is provided.« less

Using Peer Reviews to Examine Micropolitics and Disciplinary Development of Engineering Education: A Case Study

ERIC Educational Resources Information Center

Beddoes, Kacey

2014-01-01

This article presents a case study of the peer review process for a feminist article submitted to an engineering education journal. It demonstrates how an examination of peer review can be a useful approach to further understanding the development of feminist thought in education fields. Rather than opposition to feminist thought per se, my…

Adding Value to the Learning Process by Online Peer Review Activities: Towards the Elaboration of a Methodology to Promote Critical Thinking in Future Engineers

ERIC Educational Resources Information Center

Dominguez, Caroline; Nascimento, Maria M.; Payan-Carreira, Rita; Cruz, Gonçalo; Silva, Helena; Lopes, José; Morais, Maria da Felicidade A.; Morais, Eva

2015-01-01

Considering the results of research on the benefits and difficulties of peer review, this paper describes how teaching faculty, interested in endorsing the acquisition of communication and critical thinking (CT) skills among engineering students, has been implementing a learning methodology throughout online peer review activities. While…

Vasectomy

MedlinePlus

... NICHD Contacts for Funding Information Peer Review Small Business Programs About the Programs NICHD Priorities Funding Opportunities ... Opportunities Grants Process, Policies & Strategies Peer Review Small Business Programs Training & Career Development For Applicants Sample Applications ...

Interconnected or disconnected? Promotion of mental health and prevention of mental disorder in the digital age

PubMed Central

Hayes, Joseph F; Maughan, Daniel L; Grant-Peterkin, Hugh

2016-01-01

Summary To date there have been few peer-reviewed studies on the feasibility, acceptability and effectiveness of digital technologies for mental health promotion and disorder prevention. Any evaluation of these evolving technologies is complicated by a lack of understanding about the specific risks and possible benefits of the many forms of internet use on mental health. In order to adequately meet the mental health needs of today’s society, psychiatry must engage in rigorous assessment of the impact of digital technologies. PMID:26932479

Interconnected or disconnected? Promotion of mental health and prevention of mental disorder in the digital age.

PubMed

Hayes, Joseph F; Maughan, Daniel L; Grant-Peterkin, Hugh

2016-03-01

To date there have been few peer-reviewed studies on the feasibility, acceptability and effectiveness of digital technologies for mental health promotion and disorder prevention. Any evaluation of these evolving technologies is complicated by a lack of understanding about the specific risks and possible benefits of the many forms of internet use on mental health. To adequately meet the mental health needs of today's society, psychiatry must engage in rigorous assessment of the impact of digital technologies. © The Royal College of Psychiatrists 2016.

Retrospective: lessons learned from the Santa Barbara project and their implications for health information exchange.

PubMed

Frohlich, Jonah; Karp, Sam; Smith, Mark D; Sujansky, Walter

2007-01-01

Despite its closure in December 2006, the Santa Barbara County Care Data Exchange helped focus national attention on the value of health information exchange (HIE). This in turn led to the federal government's plan to establish regional health information organizations (RHIOs). During its existence, the project pioneered innovative approaches, including certification of health information technology vendors, a community-wide governance model, and deployment of a peer-to-peer technical model now in wider use. RHIO efforts will benefit from the project's lessons about the need for an incremental development approach, rigorous implementation processes, early attention to privacy and liability concerns, and planning for a sustainable business model.

A scoping review protocol on the roles and tasks of peer reviewers in the manuscript review process in biomedical journals.

PubMed

Glonti, Ketevan; Cauchi, Daniel; Cobo, Erik; Boutron, Isabelle; Moher, David; Hren, Darko

2017-10-22

The primary functions of peer reviewers are poorly defined. Thus far no body of literature has systematically identified the roles and tasks of peer reviewers of biomedical journals. A clear establishment of these can lead to improvements in the peer review process. The purpose of this scoping review is to determine what is known on the roles and tasks of peer reviewers. We will use the methodological framework first proposed by Arksey and O'Malley and subsequently adapted by Levac et al and the Joanna Briggs Institute. The scoping review will include all study designs, as well as editorials, commentaries and grey literature. The following eight electronic databases will be searched (from inception to May 2017): Cochrane Library, Cumulative Index to Nursing and Allied Health Literature, Educational Resources Information Center, EMBASE, MEDLINE, PsycINFO, Scopus and Web of Science. Two reviewers will use inclusion and exclusion criteria based on the 'Population-Concept-Context' framework to independently screen titles and abstracts of articles considered for inclusion. Full-text screening of relevant eligible articles will also be carried out by two reviewers. The search strategy for grey literature will include searching in websites of existing networks, biomedical journal publishers and organisations that offer resources for peer reviewers. In addition we will review journal guidelines to peer reviewers on how to perform the manuscript review. Journals will be selected using the 2016 journal impact factor. We will identify and assess the top five, middle five and lowest-ranking five journals across all medical specialties. This scoping review will undertake a secondary analysis of data already collected and does not require ethical approval. The results will be disseminated through journals and conferences targeting stakeholders involved in peer review in biomedical research. © Article author(s) (or their employer(s) unless otherwise stated in the text of the article) 2017. All rights reserved. No commercial use is permitted unless otherwise expressly granted.

Peer review statement

NASA Astrophysics Data System (ADS)

2018-02-01

All papers published in this volume of Journal of Physics: Conference Series have been peer reviewed through processes administered by the proceedings Editors. Reviews were conducted by expert referees to the professional and scientific standards expected of a proceedings journal published by IOP Publishing.

Peer review statement

NASA Astrophysics Data System (ADS)

2018-04-01

All papers published in this volume of Journal of Physics: Conference Series have been peer reviewed through processes administered by the proceedings Editors. Reviews were conducted by expert referees to the professional and scientific standards expected of a proceedings journal published by IOP Publishing.

Peer review statement

NASA Astrophysics Data System (ADS)

2018-05-01

All papers published in this volume of Journal of Physics: Conference Series have been peer reviewed through processes administered by the proceedings Editors. Reviews were conducted by expert referees to the professional and scientific standards expected of a proceedings journal published by IOP Publishing.

Peer review statement

NASA Astrophysics Data System (ADS)

2018-03-01

All papers published in this volume of Journal of Physics: Conference Series have been peer reviewed through processes administered by the proceedings Editors. Reviews were conducted by expert referees to the professional and scientific standards expected of a proceedings journal published by IOP Publishing.

Real-Time Peer Review: An Innovative Feature to an Evidence-Based Practice Conference

PubMed Central

Eldredge, Jonathan D.; Phillips, Holly E.; Kroth, Philip J.

2013-01-01

Many health sciences librarians as well as other professionals attend conferences on a regular basis. This study sought to link an innovative peer review process of presented research papers to long-term conference outcomes in the peer-reviewed professional journal literature. An evidence-based conference included a proof-of-concept study to gauge the long-term outcomes from research papers presented during the program. Real-time peer review recommendations from the conference were linked to final versions of articles published in the peer-reviewed literature. The real-time peer review feedback served as the basis for further mentoring to guide prospective authors toward publishing their research results. These efforts resulted in the publication of two of the four research papers in the peer-viewed literature. A third presented paper appeared in a blog because the authors wanted to disseminate their findings more quickly than through the journal literature. The presenters of the fourth paper never published their study. Real-time peer review from this study can be adapted to other professional conferences that include presented research papers. PMID:24180649

Understanding Peer Review of Scientific Research

ERIC Educational Resources Information Center

Association of American Universities, 2011

2011-01-01

An important factor in the success of America's national research system is that federal funds for university-based research are awarded primarily through peer review, which uses panels of scientific experts, or "peers," to evaluate the quality of grant proposals. In this competitive process, proposals compete for resources based on their…

A Developmental Perspective on Peer Rejection, Deviant Peer Affiliation, and Conduct Problems Among Youth.

PubMed

Chen, Diane; Drabick, Deborah A G; Burgers, Darcy E

2015-12-01

Peer rejection and deviant peer affiliation are linked consistently to the development and maintenance of conduct problems. Two proposed models may account for longitudinal relations among these peer processes and conduct problems: the (a) sequential mediation model, in which peer rejection in childhood and deviant peer affiliation in adolescence mediate the link between early externalizing behaviors and more serious adolescent conduct problems; and (b) parallel process model, in which peer rejection and deviant peer affiliation are considered independent processes that operate simultaneously to increment risk for conduct problems. In this review, we evaluate theoretical models and evidence for associations among conduct problems and (a) peer rejection and (b) deviant peer affiliation. We then consider support for the sequential mediation and parallel process models. Next, we propose an integrated model incorporating both the sequential mediation and parallel process models. Future research directions and implications for prevention and intervention efforts are discussed.

A Developmental Perspective on Peer Rejection, Deviant Peer Affiliation, and Conduct Problems among Youth

PubMed Central

Chen, Diane; Drabick, Deborah A. G.; Burgers, Darcy E.

2015-01-01

Peer rejection and deviant peer affiliation are linked consistently to the development and maintenance of conduct problems. Two proposed models may account for longitudinal relations among these peer processes and conduct problems: the (a) sequential mediation model, in which peer rejection in childhood and deviant peer affiliation in adolescence mediate the link between early externalizing behaviors and more serious adolescent conduct problems; and (b) parallel process model, in which peer rejection and deviant peer affiliation are considered independent processes that operate simultaneously to increment risk for conduct problems. In this review, we evaluate theoretical models and evidence for associations among conduct problems and (a) peer rejection and (b) deviant peer affiliation. We then consider support for the sequential mediation and parallel process models. Next, we propose an integrated model incorporating both the sequential mediation and parallel process models. Future research directions and implications for prevention and intervention efforts are discussed. PMID:25410430

JOURNAL CLUB: Assessment of Interobserver Variability in the Peer Review Process: Should We Agree to Disagree?

PubMed

Verma, Nupur; Hippe, Daniel S; Robinson, Jeffrey D

2016-12-01

Peer review is an important and necessary part of radiology. There are several options to perform the peer review process. This study examines the reproducibility of peer review by comparing two scoring systems. American Board of Radiology-certified radiologists from various practice environments and subspecialties were recruited to score deidentified examinations on a web-based PACS with two scoring systems, RADPEER and Cleareview. Quantitative analysis of the scores was performed for interrater agreement. Interobserver variability was high for both the RADPEER and Cleareview scoring systems. The interobserver correlations (kappa values) were 0.17-0.23 for RADPEER and 0.10-0.16 for Cleareview. Interrater correlation was not statistically significantly different when comparing the RADPEER and Cleareview systems (p = 0.07-0.27). The kappa values were low for the Cleareview subscores when we evaluated for missed findings (0.26), satisfaction of search (0.17), and inadequate interpretation of findings (0.12). Our study confirms the previous report of low interobserver correlation when using the peer review process. There was low interobserver agreement seen when using both the RADPEER and the Cleareview scoring systems.

What Is Endometriosis?

MedlinePlus

... NICHD Contacts for Funding Information Peer Review Small Business Programs About the Programs NICHD Priorities Funding Opportunities ... Opportunities Grants Process, Policies & Strategies Peer Review Small Business Programs Training & Career Development For Applicants Sample Applications ...

Self-management programs for Aboriginal and Torres Strait Islander Peoples with chronic conditions: A rapid review.

PubMed

Moore, Ellie; Lawn, Sharon; Oster, Candice; Morello, Andrea

2017-01-01

Objectives Review the evidence for the effectiveness of chronic condition self-management programs applied to Aboriginal and Torres Strait Islander Peoples. Methods A rapid review methodology was followed to develop an evidence summary from peer-reviewed and grey literature. Results Only seven peer-reviewed studies were identified. The evidence indicated that group programs, particularly the Stanford Program, and structured individual chronic condition self-management programs were of good quality for Aboriginal and Torres Strait Islander Peoples, although these need to be integrated into practice in order to see the greatest benefits. The Flinders Program showed promise as a standardised program with content designed specifically with and for these populations. Numerous grey literature sources were identified, many using strong participatory approaches developed locally within Aboriginal and Torres Strait Islander Peoples. However, few of these programs have been subject to rigorous evaluation. Discussion Despite the significant focus on chronic condition self-management programs to help address the burden of disease for Aboriginal and Torres Strait Islander Peoples, few studies exist that have been properly evaluated. The Closing the Gap Principles developed by the Australian Institute of Health and Welfare offer important guidance for how to proceed to maximise engagement, cultural appropriateness and ownership of program initiatives.

The ups and downs of peer review.

PubMed

Benos, Dale J; Bashari, Edlira; Chaves, Jose M; Gaggar, Amit; Kapoor, Niren; LaFrance, Martin; Mans, Robert; Mayhew, David; McGowan, Sara; Polter, Abigail; Qadri, Yawar; Sarfare, Shanta; Schultz, Kevin; Splittgerber, Ryan; Stephenson, Jason; Tower, Cristy; Walton, R Grace; Zotov, Alexander

2007-06-01

This article traces the history of peer review of scientific publications, plotting the development of the process from its inception to its present-day application. We discuss the merits of peer review and its weaknesses, both perceived and real, as well as the practicalities of several major proposed changes to the system. It is our hope that readers will gain a better appreciation of the complexities of the process and, when serving as reviewers themselves, will do so in a manner that will enhance the utility of the exercise. We also propose the development of an international on-line training program for accreditation of potential referees.

Report: Examination of Pilot Peer Review Process for Inspectors General That Follow “Blue Book” Quality Standards for Inspection and Evaluation

EPA Pesticide Factsheets

Report #16-N-0317, Sept 21, 2016. A peer review process that measures adherence to all the quality standards for federal Inspector General Inspection and Evaluation offices provides assurance that participating offices are being adequately evaluated.

Thank you to our 2016 peer reviewers

NASA Astrophysics Data System (ADS)

Hauck, Steven A.; Baratoux, David; Stanley, Sabine

2017-02-01

Peer review is one of most fundamental aspects of the modern practice of science. As scientists we hold our own work up to scrutiny by experts among our peers in order to encourage the best practices in scientific conduct and communication. Thorough consideration and review by professional colleagues of scientific papers are critical aspects of ensuring that the manuscripts published by JGR-Planets are accurate, valuable, and clearly communicated. Peer review is an essential element of the process of refining understanding and sharing science, and the effort and expertise shared by each reviewer are crucial to the advancement of planetary science. In 2016, JGR Planets benefited from more than 451 reviews provided by 337 of our peers for papers submitted to the journal. Thank you all for your dedication to advancing planetary science.

A Review of Sex Differences in Peer Relationship Processes: Potential Trade-offs for the Emotional and Behavioral Development of Girls and Boys

PubMed Central

Rose, Amanda J.; Rudolph, Karen D.

2011-01-01

Theory and research on sex differences in adjustment focus largely on parental, societal, and biological influences. However, it also is important to consider how peers contribute to girls’ and boys’ development. This paper provides a critical review of sex differences in: several peer-relationship processes, including behavioral and social-cognitive styles, stress and coping, and relationship provisions. Based on this review, a speculative peer-socialization model is presented that considers the implications of these sex differences for girls’ and boys’ emotional and behavioral development. Central to this model is the idea that sex-linked relationship processes have costs and benefits for girls’ and boys’ adjustment. Finally, we present recent research testing certain model components and propose approaches for testing understudied aspects of the model. PMID:16435959

Argument-Driven Inquiry: Using the Laboratory to Improve Undergraduates' Science Writing Skills through Meaningful Science Writing, Peer-Review, and Revision

ERIC Educational Resources Information Center

Walker, Joi Phelps; Sampson, Victor

2013-01-01

This paper presents preliminary evidence supporting the use of peer review in undergraduate science as a means to improve student writing and to alleviate barriers, such as lost class time, by incorporation of the peer-review process into the laboratory component of the course. The study was conducted in a single section of an undergraduate…

Peer review statement

NASA Astrophysics Data System (ADS)

2018-03-01

All papers published in this volume of IOP Conference Series: Earth and Environmental Science have been peer reviewed through processes administered by the proceedings Editors. Reviews were conducted by expert referees to the professional and scientific standards expected of a proceedings journal published by IOP Publishing.

Peer review statement

NASA Astrophysics Data System (ADS)

2018-05-01

All papers published in this volume of IOP Conference Series: Materials Science and Engineering have been peer reviewed through processes administered by the proceedings Editors. Reviews were conducted by expert referees to the professional and scientific standards expected of a proceedings journal published by IOP Publishing.

Peer review statement

NASA Astrophysics Data System (ADS)

2017-11-01

All papers published in this volume of IOP Conference Series: Materials Science and Engineering have been peer reviewed through processes administered by the proceedings Editors. Reviews were conducted by expert referees to the professional and scientific standards expected of a proceedings journal published by IOP Publishing.

Peer review statement

NASA Astrophysics Data System (ADS)

2017-10-01

All papers published in this volume of IOP Conference Series: Materials Science and Engineering have been peer reviewed through processes administered by the proceedings Editors. Reviews were conducted by expert referees to the professional and scientific standards expected of a proceedings journal published by IOP Publishing.

Peer review statement

NASA Astrophysics Data System (ADS)

2017-09-01

All papers published in this volume of IOP Conference Series: Materials Science and Engineering have been peer reviewed through processes administered by the proceedings Editors. Reviews were conducted by expert referees to the professional and scientific standards expected of a proceedings journal published by IOP Publishing.

Peer review statement

NASA Astrophysics Data System (ADS)

2018-02-01

All papers published in this volume of IOP Conference Series: Materials Science and Engineering have been peer reviewed through processes administered by the proceedings Editors. Reviews were conducted by expert referees to the professional and scientific standards expected of a proceedings journal published by IOP Publishing.

Peer review statement

NASA Astrophysics Data System (ADS)

2017-12-01

All papers published in this volume of IOP Conference Series: Materials Science and Engineering have been peer reviewed through processes administered by the proceedings Editors. Reviews were conducted by expert referees to the professional and scientific standards expected of a proceedings journal published by IOP Publishing.

Peer review statement

NASA Astrophysics Data System (ADS)

2018-03-01

All papers published in this volume of IOP Conference Series: Materials Science and Engineering have been peer reviewed through processes administered by the proceedings Editors. Reviews were conducted by expert referees to the professional and scientific standards expected of a proceedings journal published by IOP Publishing.

Preterm Labor and Birth

MedlinePlus

... NICHD Contacts for Funding Information Peer Review Small Business Programs About the Programs NICHD Priorities Funding Opportunities ... Opportunities Grants Process, Policies & Strategies Peer Review Small Business Programs Training & Career Development For Applicants Sample Applications ...

Sexually Transmitted Diseases (STDs)

MedlinePlus

... NICHD Contacts for Funding Information Peer Review Small Business Programs About the Programs NICHD Priorities Funding Opportunities ... Opportunities Grants Process, Policies & Strategies Peer Review Small Business Programs Training & Career Development For Applicants Sample Applications ...

What Is Fertility Preservation?

MedlinePlus

... NICHD Contacts for Funding Information Peer Review Small Business Programs About the Programs NICHD Priorities Funding Opportunities ... Opportunities Grants Process, Policies & Strategies Peer Review Small Business Programs Training & Career Development For Applicants Sample Applications ...

Surgical Treatments for Fibroids

MedlinePlus

... NICHD Contacts for Funding Information Peer Review Small Business Programs About the Programs NICHD Priorities Funding Opportunities ... Opportunities Grants Process, Policies & Strategies Peer Review Small Business Programs Training & Career Development For Applicants Sample Applications ...

Contraception and Birth Control

MedlinePlus

... NICHD Contacts for Funding Information Peer Review Small Business Programs About the Programs NICHD Priorities Funding Opportunities ... Opportunities Grants Process, Policies & Strategies Peer Review Small Business Programs Training & Career Development For Applicants Sample Applications ...

"I sleep better at night:" How peer review of radiation treatment plans indirectly improves quality of care across radiation treatment programs.

PubMed

Brundage, Michael D; Hart, Margaret; O'Donnell, Jennifer; Reddeman, Lindsay; Gutierrez, Eric; Foxcroft, Sophie; Warde, Padraig

Peer review of radiation oncology treatment plans is increasingly recognized as an important component of quality assurance in radiation treatment planning and delivery. Peer review of treatment plans can directly improve the quality of those plans and can also have indirect effects on radiation treatment programs. We undertook a systematic, qualitative approach to describing the indirect benefits of peer review, factors that were seen to facilitate or act as barriers to the implementation of peer review, and strategies to address these barriers across a provincial jurisdiction of radiation oncology programs (ROPs). Semistructured qualitative interviews were held with radiation oncology department heads and radiation therapy managers (or delegates) in all 14 ROPs in Ontario, Canada. We used a theoretically guided phenomenological qualitative approach to design and analyze the interview content. Themes were recorded by 2 independent reviewers, and any discordance was resolved by consensus. A total of 28 interviews were completed with 32 interviewees. Twenty-two unique themes addressed perceived benefits of peer review, relating to either peer review structure (n = 3), process (n = 9), or outcome (n = 10). Of these 22 themes, 19 related to indirect benefits to ROPs. In addition, 18 themes related to factors that facilitated peer review activities and 30 themes related to key barriers to implementing peer review were identified. Findings were consistent with, and enhanced the understanding of, previous survey-based assessments of the benefits and challenges of implementing peer review programs. Although challenges and concerns regarding the implementation of peer review were evident, the indirect benefits to radiation programs are numerous, far outweigh the implementation challenges, and strongly complement the direct individual-patient benefits that result from peer review quality assurance of radiation treatment plans. Copyright © 2016. Published by Elsevier Inc.

Improving your journal article using feedback from peer review.

PubMed

Price, Bob

2014-09-30

While preparation of a journal article for submission may often include informal review by colleagues, an article is not accepted for publication until it has been formally peer reviewed. Peer review is the process whereby journal editors ask expert reviewers to examine the work submitted and prepare a report on its suitability for publication. Two or more revisions of the article may be required following peer review, with the author reworking the article in the light of feedback received on each occasion. This can be challenging for some authors, but used well, it offers a chance to improve the work to the required standard of the journal, and help the author present a more precise and coherent account of the arguments. The extent to which the author responds to the critical commentary of peer reviewers is important, because this may determine whether or not the article is published. This article explores the aims of peer reviewers and recommends ways in which authors can respond to the feedback provided.

How Is a Vasectomy Done?

MedlinePlus

... NICHD Contacts for Funding Information Peer Review Small Business Programs About the Programs NICHD Priorities Funding Opportunities ... Opportunities Grants Process, Policies & Strategies Peer Review Small Business Programs Training & Career Development For Applicants Sample Applications ...

How Effective Is Male Contraception?

MedlinePlus

... NICHD Contacts for Funding Information Peer Review Small Business Programs About the Programs NICHD Priorities Funding Opportunities ... Opportunities Grants Process, Policies & Strategies Peer Review Small Business Programs Training & Career Development For Applicants Sample Applications ...

Structural barriers in access to medical marijuana in the USA-a systematic review protocol.

PubMed

Valencia, Celina I; Asaolu, Ibitola O; Ehiri, John E; Rosales, Cecilia

2017-08-07

There are 43 state medical marijuana programs in the USA, yet limited evidence is available on the demographic characteristics of the patient population accessing these programs. Moreover, insights into the social and structural barriers that inform patients' success in accessing medical marijuana are limited. A current gap in the scientific literature exists regarding generalizable data on the social, cultural, and structural mechanisms that hinder access to medical marijuana among qualifying patients. The goal of this systematic review, therefore, is to identify the aforementioned mechanisms that inform disparities in access to medical marijuana in the USA. This scoping review protocol outlines the proposed study design for the systematic review and evaluation of peer-reviewed scientific literature on structural barriers to medical marijuana access. The protocol follows the guidelines set forth by the Preferred Reporting Items for Systematic review and Meta-Analysis Protocols (PRISMA-P) checklist. The overarching goal of this study is to rigorously evaluate the existing peer-reviewed data on access to medical marijuana in the USA. Income, ethnic background, stigma, and physician preferences have been posited as the primary structural barriers influencing medical marijuana patient population demographics in the USA. Identification of structural barriers to accessing medical marijuana provides a framework for future policies and programs. Evidence-based policies and programs for increasing medical marijuana access help minimize the disparity of access among qualifying patients.

Lean interventions in healthcare: do they actually work? A systematic literature review.

PubMed

Moraros, John; Lemstra, Mark; Nwankwo, Chijioke

2016-04-01

Lean is a widely used quality improvement methodology initially developed and used in the automotive and manufacturing industries but recently expanded to the healthcare sector. This systematic literature review seeks to independently assess the effect of Lean or Lean interventions on worker and patient satisfaction, health and process outcomes, and financial costs. We conducted a systematic literature review of Medline, PubMed, Cochrane Library, CINAHL, Web of Science, ABI/Inform, ERIC, EMBASE and SCOPUS. Peer reviewed articles were included if they examined a Lean intervention and included quantitative data. Methodological quality was assessed using validated critical appraisal checklists. Publically available data collected by the Saskatchewan Health Quality Council and the Saskatchewan Union of Nurses were also analysed and reported separately. Data on design, methods, interventions and key outcomes were extracted and collated. Our electronic search identified 22 articles that passed methodological quality review. Among the accepted studies, 4 were exclusively concerned with health outcomes, 3 included both health and process outcomes and 15 included process outcomes. Our study found that Lean interventions have: (i) no statistically significant association with patient satisfaction and health outcomes; (ii) a negative association with financial costs and worker satisfaction and (iii) potential, yet inconsistent, benefits on process outcomes like patient flow and safety. While some may strongly believe that Lean interventions lead to quality improvements in healthcare, the evidence to date simply does not support this claim. More rigorous, higher quality and better conducted scientific research is required to definitively ascertain the impact and effectiveness of Lean in healthcare settings. © The Author 2016. Published by Oxford University Press in association with the International Society for Quality in Health Care.

Lean interventions in healthcare: do they actually work? A systematic literature review

PubMed Central

Moraros, John; Lemstra, Mark; Nwankwo, Chijioke

2016-01-01

Purpose Lean is a widely used quality improvement methodology initially developed and used in the automotive and manufacturing industries but recently expanded to the healthcare sector. This systematic literature review seeks to independently assess the effect of Lean or Lean interventions on worker and patient satisfaction, health and process outcomes, and financial costs. Data sources We conducted a systematic literature review of Medline, PubMed, Cochrane Library, CINAHL, Web of Science, ABI/Inform, ERIC, EMBASE and SCOPUS. Study selection Peer reviewed articles were included if they examined a Lean intervention and included quantitative data. Methodological quality was assessed using validated critical appraisal checklists. Publically available data collected by the Saskatchewan Health Quality Council and the Saskatchewan Union of Nurses were also analysed and reported separately. Data extraction Data on design, methods, interventions and key outcomes were extracted and collated. Results of data synthesis Our electronic search identified 22 articles that passed methodological quality review. Among the accepted studies, 4 were exclusively concerned with health outcomes, 3 included both health and process outcomes and 15 included process outcomes. Our study found that Lean interventions have: (i) no statistically significant association with patient satisfaction and health outcomes; (ii) a negative association with financial costs and worker satisfaction and (iii) potential, yet inconsistent, benefits on process outcomes like patient flow and safety. Conclusion While some may strongly believe that Lean interventions lead to quality improvements in healthcare, the evidence to date simply does not support this claim. More rigorous, higher quality and better conducted scientific research is required to definitively ascertain the impact and effectiveness of Lean in healthcare settings. PMID:26811118

Mitigation of Disagreement in Peer Review among L2 Learners and Native Speakers in a College Writing Class (Mitigación del Impacto de las Opiniones de Desacuerdo en el Proceso de Revisión por Pares entre Estudiantes de una Segunda Lengua y Hablantes Nativos en una Clase de Escritura a Nivel Universitario)

ERIC Educational Resources Information Center

Christoffersen, Katherine O'Donnell

2015-01-01

Peer review is now a commonplace practice in process-oriented writing instruction. A crucial aspect of peer review is assessing another classmate's work, which encompasses the act of disagreement. Given its prevalence in the classroom, it is necessary to analyze how L2 learners mitigate disagreement in the context of peer review with other L2…

Eyes wide open: reader and author responsibility in understanding the limits of peer review.

PubMed

Benson, P J

2015-10-01

'Medical science can only flourish in a free society and dies under totalitarian repression.' (1) Peer review post-publication is relatively easy to define: when the world decides the importance of publication. Peer review pre-publication is what the scientific community frequently means when using the term 'peer review'. But what it is it? Few will agree on an exact definition; generally speaking, it refers to an independent, third party scrutiny of a manuscript by scientific experts (called peers) who advise on its suitability for publication. Peer review is expensive; although reviewers are unpaid, the cost in time is enormous and it is slow. There is often little agreement among reviewers about whether an article should be published and peer review can be a lottery. Often referred to as a quality assurance process, there are many examples of when peer review failed. Many will be aware of Woo-Suk Hwang's shocking stem cell research misconduct at Seoul National University. (2) Science famously published two breakthrough articles that were found subsequently to be completely fabricated and this happened in spite of peer review. Science is not unique in making this error. However, love it or hate it, peer review, for the present time at least, is here to stay. In this article, Philippa Benson, Managing Editor of Science Advances (the first open access journal of the American Association for the Advancement of Science), discusses the merits of peer review. Dr Benson has extensive experience in the publishing world and was Executive Director of PJB Consulting, a not-for-profit organisation supporting clients on issues related to converting to full electronic publishing workflows as well as challenges working with international authors and publishers. Her clients included the Public Library of Science journals, the American Society for Nutrition and the de Beaumont Foundation. She recently co-authored a book, What Editors Want: An Author's Guide to Scientific Journal Publishing (University of Chicago Press), which helps readers understand and navigate the publishing process in high impact science and technical journals. Her master's and doctorate degrees are from Carnegie Mellon University. JYOTI SHAH Commissioning Editor References 1. Eaton KK . Editorial: when is a peer review journal not a peer review journal? J Nutr Environ Med 1997 ; 7 : 139 - 144 . 2. van der Heyden MA , van de Ven T , Opthof T . Fraud and misconduct in science: the stem cell seduction . Neth Heart J 2009 ; 17 : 25 - 29 .

What is open peer review? A systematic review.

PubMed

Ross-Hellauer, Tony

2017-01-01

Background : "Open peer review" (OPR), despite being a major pillar of Open Science, has neither a standardized definition nor an agreed schema of its features and implementations. The literature reflects this, with numerous overlapping and contradictory definitions. While for some the term refers to peer review where the identities of both author and reviewer are disclosed to each other, for others it signifies systems where reviewer reports are published alongside articles. For others it signifies both of these conditions, and for yet others it describes systems where not only "invited experts" are able to comment. For still others, it includes a variety of combinations of these and other novel methods. Methods : Recognising the absence of a consensus view on what open peer review is, this article undertakes a systematic review of definitions of "open peer review" or "open review", to create a corpus of 122 definitions. These definitions are systematically analysed to build a coherent typology of the various innovations in peer review signified by the term, and hence provide the precise technical definition currently lacking. Results : This quantifiable data yields rich information on the range and extent of differing definitions over time and by broad subject area. Quantifying definitions in this way allows us to accurately portray exactly how ambiguously the phrase "open peer review" has been used thus far, for the literature offers 22 distinct configurations of seven traits, effectively meaning that there are 22 different definitions of OPR in the literature reviewed. Conclusions : I propose a pragmatic definition of open peer review as an umbrella term for a number of overlapping ways that peer review models can be adapted in line with the aims of Open Science, including making reviewer and author identities open, publishing review reports and enabling greater participation in the peer review process.

How peer-review constrains cognition: on the frontline in the knowledge sector.

PubMed

Cowley, Stephen J

2015-01-01

Peer-review is neither reliable, fair, nor a valid basis for predicting 'impact': as quality control, peer-review is not fit for purpose. Endorsing the consensus, I offer a reframing: while a normative social process, peer-review also shapes the writing of a scientific paper. In so far as 'cognition' describes enabling conditions for flexible behavior, the practices of peer-review thus constrain knowledge-making. To pursue cognitive functions of peer-review, however, manuscripts must be seen as 'symbolizations', replicable patterns that use technologically enabled activity. On this bio-cognitive view, peer-review constrains knowledge-making by writers, editors, reviewers. Authors are prompted to recursively re-aggregate symbolizations to present what are deemed acceptable knowledge claims. How, then, can recursive re-embodiment be explored? In illustration, I sketch how the paper's own content came to be re-aggregated: agonistic review drove reformatting of argument structure, changes in rhetorical ploys and careful choice of wordings. For this reason, the paper's knowledge-claims can be traced to human activity that occurs in distributed cognitive systems. Peer-review is on the frontline in the knowledge sector in that it delimits what can count as knowing. Its systemic nature is therefore crucial to not only discipline-centered 'real' science but also its 'post-academic' counterparts.

What Are the Risks of Vasectomy?

MedlinePlus

... NICHD Contacts for Funding Information Peer Review Small Business Programs About the Programs NICHD Priorities Funding Opportunities ... Opportunities Grants Process, Policies & Strategies Peer Review Small Business Programs Training & Career Development For Applicants Sample Applications ...

Yoga for Arthritis: A Scoping Review

PubMed Central

Haaz, Steffany; Bartlett, Susan J.

2010-01-01

Synopsis The aim of this article was to systematically review the existing literature on the use of yoga for persons with arthritis. We included peer-reviewed research from clinical trials (published from 1980-2010) that used yoga as an intervention for arthritis patients and reported quantitative findings. Eleven studies were identified, including four RCTs and four NRCTs. All trials were small and control groups varied. No adverse events were reported and attrition was comparable or better than typical for exercise interventions. Evidence was strongest for reduction in disease symptoms (tender/swollen joints, pain) and disability, as well as improved self-efficacy and mental health. Interventions, research methods and disease diagnoses were heterogeneous. Larger, rigorous RCTs are necessary to more effectively quantify the effects of yoga for arthritic populations PMID:21220084

On the Need for Quantitative Bias Analysis in the Peer-Review Process.

PubMed

Fox, Matthew P; Lash, Timothy L

2017-05-15

Peer review is central to the process through which epidemiologists generate evidence to inform public health and medical interventions. Reviewers thereby act as critical gatekeepers to high-quality research. They are asked to carefully consider the validity of the proposed work or research findings by paying careful attention to the methodology and critiquing the importance of the insight gained. However, although many have noted problems with the peer-review system for both manuscripts and grant submissions, few solutions have been proposed to improve the process. Quantitative bias analysis encompasses all methods used to quantify the impact of systematic error on estimates of effect in epidemiologic research. Reviewers who insist that quantitative bias analysis be incorporated into the design, conduct, presentation, and interpretation of epidemiologic research could substantially strengthen the process. In the present commentary, we demonstrate how quantitative bias analysis can be used by investigators and authors, reviewers, funding agencies, and editors. By utilizing quantitative bias analysis in the peer-review process, editors can potentially avoid unnecessary rejections, identify key areas for improvement, and improve discussion sections by shifting from speculation on the impact of sources of error to quantification of the impact those sources of bias may have had. © The Author 2017. Published by Oxford University Press on behalf of the Johns Hopkins Bloomberg School of Public Health. All rights reserved. For permissions, please e-mail: journals.permissions@oup.com.

Peer Assessment with Online Tools to Improve Student Modeling

ERIC Educational Resources Information Center

Atkins, Leslie J.

2012-01-01

Introductory physics courses often require students to develop precise models of phenomena and represent these with diagrams, including free-body diagrams, light-ray diagrams, and maps of field lines. Instructors expect that students will adopt a certain rigor and precision when constructing these diagrams, but we want that rigor and precision to…

Scientific and Regulatory Policy Committee Review: Review of the Organisation for Economic Co-operation and Development (OECD) Guidance on the GLP Requirements for Peer Review of Histopathology.

PubMed

Fikes, James D; Patrick, Daniel J; Francke, Sabine; Frazier, Kendall S; Reindel, James F; Romeike, Annette; Spaet, Robert H; Tomlinson, Lindsay; Schafer, Kenneth A

2015-10-01

In 2014, the Organisation for Economic Co-operation and Development (OECD) issued guidance no. 16, Guidance on the GLP Requirements for Peer Review of Histopathology. The stated purpose of the guidance document is "to provide guidance to pathologists, test facility management, study directors and quality assurance personnel on how the peer review of histopathology should be planned, managed, documented, and reported in order to meet Good Laboratory Practice (GLP) expectations and requirements." On behalf of and in collaboration with the global societies of toxicologic pathology, the Society of Toxicologic Pathology initiated a review of OECD guidance no. 16. The objectives of this review are to provide a unified interpretation of the guidance, to recommend compliant processes for organizations to implement, and to avoid inconsistent process adaptations across the industry. This review of the guidance document is the product of a global collaboration with other societies of toxicologic pathology and provides a section-by-section international consensus view and interpretation of the OECD guidance on peer review. © 2015 by The Author(s).

Medical students as peer tutors: a systematic review

PubMed Central

2014-01-01

Background While Peer Assisted Learning (PAL) has long occurred informally in medical education, in the past ten years, there has been increasing international interest in formally organised PAL, with many benefits for both the students and institutions. We conducted a systematic review of the literature to establish why and how PAL has been implemented, focussing on the recruitment and training process for peer tutors, the benefits for peer tutors, and the competency of peer tutors. Method A literature search was conducted in three electronic databases. Selection of titles and abstracts were made based on pre-determined eligibility criteria. We utilized the ‘AMEE Peer assisted learning: a planning and implementation framework: AMEE Guide no. 30’ to assist us in establishing the review aims in a systematic review of the literature between 2002 and 2012. Six key questions were developed and used in our analysis of particular aspects of PAL programs within medical degree programs. Results We found nineteen articles that satisfied our inclusion criteria. The PAL activities fell into three broad categories of teacher training, peer teaching and peer assessment. Variability was found in the reporting of tutor recruitment and training processes, tutor outcomes, and tutor competencies. Conclusion Results from this review suggest that there are many perceived learning benefits for student tutors. However, there were mixed results regarding the accuracy of peer assessment and feedback, and no substantial evidence to conclude that participation as a peer tutor improves one’s own examination performance. Further research into PAL in medicine is required if we are to better understand the relative impact and benefits for student tutors. PMID:24912500

Teaching undergraduates the process of peer review: learning by doing.

PubMed

Rangachari, P K

2010-09-01

An active approach allowed undergraduates in Health Sciences to learn the dynamics of peer review at first hand. A four-stage process was used. In stage 1, students formed self-selected groups to explore specific issues. In stage 2, each group posted their interim reports online on a specific date. Each student read all the other reports and prepared detailed critiques. In stage 3, each report was discussed at sessions where the lead discussant was selected at random. All students participated in the peer review process. The written critiques were collated and returned to each group, who were asked to resubmit their revised reports within 2 wk. In stage 4, final submissions accompanied by rebuttals were graded. Student responses to a questionnaire were highly positive. They recognized the individual steps in the standard peer review, appreciated the complexities involved, and got a first-hand experience of some of the inherent variabilities involved. The absence of formal presentations and the opportunity to read each other's reports permitted them to study issues in greater depth.

Using Nominal Group Technique to Develop a Consensus Derived Model for Peer Review of Teaching across a Multi-School Faculty

ERIC Educational Resources Information Center

Burrows, Tracy; Findlay, Naomi; Killen, Chloe; Dempsey, Shane E.; Hunter, Sharyn; Chiarelli, Pauline; Snodgrass, Suzanne

2011-01-01

This paper describes the development of a peer review of teaching model for the Faculty of Health at the University of Newcastle, Australia. The process involved using the nominal group technique to engage Faculty academic staff to consider seven key decision points that informed the development of the peer review of teaching model. Use of the…

[Quality Assurance in Sociomedical Evaluation by Peer Review: A Pilot Project of the German Statutory Pension Insurance].

PubMed

Strahl, A; Gerlich, C; Wolf, H-D; Gehrke, J; Müller-Garnn, A; Vogel, H

2016-03-01

The sociomedical evaluation by the German Pension Insurance serves the purpose of determining entitlement to disability pensions. A quality assurance concept for the sociomedical evaluation was developed, which is based on a peer Review process. Peer review is an established process of external quality assurance in health care. The review is based on a hierarchically constructed manual that was evaluated in this pilot project. The database consists of 260 medical reports for disability pension of 12 pension insurance agencies. 771 reviews from 19 peers were included in the evaluation of the inter-rater reliability. Kendall's coefficient of concordance W for more than 2 raters is used as primary measure of inter-rater reliability. Reliability appeared to be heterogeneous. Kendalls W varies for the particular criteria from 0.09 to 0.88 and reached for primary criterion reproducibility a value of 0.37. The reliability of the manual seemed acceptable in the context of existing research data and is in line with existing peer review research outcomes. Nevertheless, the concordance is limited and requires optimisation. Starting points for improvement can be seen in a systematic training and regular user meetings of the peers involved. © Georg Thieme Verlag KG Stuttgart · New York.

Variability of Reviewers' Comments in the Peer Review Process for Orthopaedic Research.

PubMed

Iantorno, Stephanie E; Andras, Lindsay M; Skaggs, David L

2016-07-01

Retrospective analysis of peer review comments. To assess the likelihood that comments provided by peer reviewers of one orthopaedic journal would be similar to comments of reviewers from the same journal and a second journal. The consistency of the peer review process in orthopedic research has not been objectively examined. Nine separate clinical papers related to spinal deformity were submitted for publication in major peer-reviewed journals and initially rejected. The exact same manuscripts were then submitted to different journals. All papers were returned with comments from two to three reviewers from each journal. Reviews were divided into distinct conceptual criticisms that were regarded as separate comments. Comments were compared between reviewers of the same journal and to comments from reviewers of the second journal. When comparing comments from reviewers of the same journal, an average of 11% of comments were repeated (range 0% [0/12] to 23% [3/13]). On average, 20% of comments from the first journal were repeated by a reviewer at the second journal (range 10% [1/10] to 33% [6/18]). If a comment was made by two or more reviewers from the first journal, it had a higher likelihood (43% [6/14]) of being repeated by a reviewer from the second journal. When an identical manuscript is submitted to a second journal after being rejected, 80% of peer review comments from the first journal are not repeated by reviewers from the second journal. One may question if addressing every peer review comment in a rejected manuscript prior to resubmission is an efficient use of resources. Comments that appear twice or more in the first journal review are more likely to reappear and may warrant special attention from the researcher. Level IV. Copyright © 2016 Scoliosis Research Society. Published by Elsevier Inc. All rights reserved.

The Relationship of Previous Training and Experience of Journal Peer Reviewers to Subsequent Review Quality

PubMed Central

Callaham, Michael L; Tercier, John

2007-01-01

Background Peer review is considered crucial to the selection and publication of quality science, but very little is known about the previous experiences and training that might identify high-quality peer reviewers. The reviewer selection processes of most journals, and thus the qualifications of their reviewers, are ill defined. More objective selection of peer reviewers might improve the journal peer review process and thus the quality of published science. Methods and Findings 306 experienced reviewers (71% of all those associated with a specialty journal) completed a survey of past training and experiences postulated to improve peer review skills. Reviewers performed 2,856 reviews of 1,484 separate manuscripts during a four-year study period, all prospectively rated on a standardized quality scale by editors. Multivariable analysis revealed that most variables, including academic rank, formal training in critical appraisal or statistics, or status as principal investigator of a grant, failed to predict performance of higher-quality reviews. The only significant predictors of quality were working in a university-operated hospital versus other teaching environment and relative youth (under ten years of experience after finishing training). Being on an editorial board and doing formal grant (study section) review were each predictors for only one of our two comparisons. However, the predictive power of all variables was weak. Conclusions Our study confirms that there are no easily identifiable types of formal training or experience that predict reviewer performance. Skill in scientific peer review may be as ill defined and hard to impart as is “common sense.” Without a better understanding of those skills, it seems unlikely journals and editors will be successful in systematically improving their selection of reviewers. This inability to predict performance makes it imperative that all but the smallest journals implement routine review ratings systems to routinely monitor the quality of their reviews (and thus the quality of the science they publish). PMID:17411314

A protocol of a cross-sectional study evaluating an online tool for early career peer reviewers assessing reports of randomised controlled trials.

PubMed

Chauvin, Anthony; Moher, David; Altman, Doug; Schriger, David L; Alam, Sabina; Hopewell, Sally; Shanahan, Daniel R; Recchioni, Alessandro; Ravaud, Philippe; Boutron, Isabelle

2017-09-15

Systematic reviews evaluating the impact of interventions to improve the quality of peer review for biomedical publications highlighted that interventions were limited and have little impact. This study aims to compare the accuracy of early career peer reviewers who use an innovative online tool to the usual peer reviewer process in evaluating the completeness of reporting and switched primary outcomes in completed reports. This is a cross-sectional study of individual two-arm parallel-group randomised controlled trials (RCTs) published in the BioMed Central series medical journals, BMJ , BMJ Open and Annals of Emergency Medicine and indexed with the publication type 'Randomised Controlled Trial'. First, we will develop an online tool and training module based (a) on the Consolidated Standards of Reporting Trials (CONSORT) 2010 checklist and the Explanation and Elaboration document that would be dedicated to junior peer reviewers for assessing the completeness of reporting of key items and (b) the Centre for Evidence-Based Medicine Outcome Monitoring Project process used to identify switched outcomes in completed reports of the primary results of RCTs when initially submitted. Then, we will compare the performance of early career peer reviewers who use the online tool to the usual peer review process in identifying inadequate reporting and switched outcomes in completed reports of RCTs at initial journal submission. The primary outcome will be the mean number of items accurately classified per manuscript. The secondary outcomes will be the mean number of items accurately classified per manuscript for the CONSORT items and the sensitivity, specificity and likelihood ratio to detect the item as adequately reported and to identify a switch in outcomes. We aim to include 120 RCTs and 120 early career peer reviewers. The research protocol was approved by the ethics committee of the INSERM Institutional Review Board (21 January 2016). The study is based on voluntary participation and informed written consent. NCT03119376. © Article author(s) (or their employer(s) unless otherwise stated in the text of the article) 2017. All rights reserved. No commercial use is permitted unless otherwise expressly granted.

Interventional radiology peer, a newly developed peer-review scoring system designed for interventional radiology practice.

PubMed

d'Othée, Bertrand Janne; Haskal, Ziv J

2013-10-01

Existing diagnostic radiology peer-review systems do not address the specificities of interventional radiology (IR) practice. The purpose of this study was to assess the feasibility of a specifically developed interventional peer review method, IR Peer. Retrospective review of a prospectively encoded pilot database aimed at demonstrating the feasibility of IR Peer in a multiphysician practice was performed. This scoring system used morning peer review of selected IR cases from the previous day in the form of a five-item questionnaire and an ordinal answer scale that grades reviewers' agreement with imaging findings, procedural/technical management, early outcomes, and follow-up plan. Patient lists from IR Peer and morbidity and mortality (M&M) conferences were compared to evaluate the amount of overlap and capability of IR Peer to help detect adverse events (AEs). A total of 417 consecutive reviews of IR attending physician cases by peers were performed in 163 consecutive patients over 18 months, and 94% of cases were reviewed by two or three IR attending physicians. Each question was answered 99%-100% of the time. Answers showed disagreement in 10% of cases (2% by a single reviewer, 8% by several), most related to procedural technique. Overall AE incidence was 1.8%. IR Peer contributed 10.7% of cases to the M&M list. IR Peer is feasible, relevant, and easy to implement in a multiphysician IR practice. When used along with other quality-assurance processes, it might help in the detection of AEs for M&M; the latter will require further confirmatory research. © SIR, 2013.

Enhancing calibrated peer review for improved engineering communication education.

DOT National Transportation Integrated Search

2008-01-01

The objectives of this study are to extend Calibrated Peer Review (CPR) to allow for the input and review of visual and verbal components to the process, develop assignments in a set of core engineering courses that use these facilities, assess the i...

What do we know about grant peer review in the health sciences?

PubMed

Guthrie, Susan; Ghiga, Ioana; Wooding, Steven

2017-01-01

 Peer review decisions award >95% of academic medical research funding, so it is crucial to understand how well they work and if they could be improved.  This paper summarises evidence from 105 relevant papers identified through a literature search on the effectiveness and burden of peer review for grant funding.  There is a remarkable paucity of evidence about the overall efficiency of peer review for funding allocation, given its centrality to the modern system of science. From the available evidence, we can identify some conclusions around the effectiveness and burden of peer review. The strongest evidence around effectiveness indicates a bias against innovative research. There is also fairly clear evidence that peer review is, at best, a weak predictor of future research performance, and that ratings vary considerably between reviewers. There is some evidence of age bias and cronyism. Good evidence shows that the burden of peer review is high and that around 75% of it falls on applicants. By contrast, many of the efforts to reduce burden are focused on funders and reviewers/panel members.  We suggest funders should acknowledge, assess and analyse the uncertainty around peer review, even using reviewers' uncertainty as an input to funding decisions. Funders could consider a lottery element in some parts of their funding allocation process, to reduce both burden and bias, and allow better evaluation of decision processes. Alternatively, the distribution of scores from different reviewers could be better utilised as a possible way to identify novel, innovative research. Above all, there is a need for open, transparent experimentation and evaluation of different ways to fund research. This also requires more openness across the wider scientific community to support such investigations, acknowledging the lack of evidence about the primacy of the current system and the impossibility of achieving perfection.

Feasible, Rigorous, and Relevant: Validation of a Measure of Friendship Homophily for Diverse Classrooms

ERIC Educational Resources Information Center

McCormick, Meghan P.; Cappella, Elise; Hughes, Diane L.; Gallagher, Emily K.

2015-01-01

Peers become increasingly influential in children's development during late childhood and early adolescence. A large body of research has documented children's proclivity for forming friendships with peers who share similar attributes to themselves, a phenomenon termed homophily. Researchers have used multiple procedures to operationalize…

How Do Health Care Providers Diagnose Birth Defects?

MedlinePlus

... NICHD Contacts for Funding Information Peer Review Small Business Programs About the Programs NICHD Priorities Funding Opportunities ... Opportunities Grants Process, Policies & Strategies Peer Review Small Business Programs Training & Career Development For Applicants Sample Applications ...

What Are the Treatments for Primary Ovarian Insufficiency (POI)?

MedlinePlus

... NICHD Contacts for Funding Information Peer Review Small Business Programs About the Programs NICHD Priorities Funding Opportunities ... Opportunities Grants Process, Policies & Strategies Peer Review Small Business Programs Training & Career Development For Applicants Sample Applications ...

Issues in Peer Review.

ERIC Educational Resources Information Center

Sawamura, Mark H.

2001-01-01

Based on concerns raised at a workshop at the Southern California College of Optometry, addresses critical issues in the process of peer review of faculty teaching and possible alternatives to these issues as applied to an optometric institution. (EV)

Retrospective analysis of the quality of reports by author-suggested and non-author-suggested reviewers in journals operating on open or single-blind peer review models

PubMed Central

Kowalczuk, Maria K; Dudbridge, Frank; Nanda, Shreeya; Harriman, Stephanie L; Patel, Jigisha; Moylan, Elizabeth C

2015-01-01

Objectives To assess whether reports from reviewers recommended by authors show a bias in quality and recommendation for editorial decision, compared with reviewers suggested by other parties, and whether reviewer reports for journals operating on open or single-blind peer review models differ with regard to report quality and reviewer recommendations. Design Retrospective analysis of the quality of reviewer reports using an established Review Quality Instrument, and analysis of reviewer recommendations and author satisfaction surveys. Setting BioMed Central biology and medical journals. BMC Infectious Diseases and BMC Microbiology are similar in size, rejection rates, impact factors and editorial processes, but the former uses open peer review while the latter uses single-blind peer review. The Journal of Inflammation has operated under both peer review models. Sample Two hundred reviewer reports submitted to BMC Infectious Diseases, 200 reviewer reports submitted to BMC Microbiology and 400 reviewer reports submitted to the Journal of Inflammation. Results For each journal, author-suggested reviewers provided reports of comparable quality to non-author-suggested reviewers, but were significantly more likely to recommend acceptance, irrespective of the peer review model (p<0.0001 for BMC Infectious Diseases, BMC Microbiology and the Journal of Inflammation). For BMC Infectious Diseases, the overall quality of reviewer reports measured by the Review Quality Instrument was 5% higher than for BMC Microbiology (p=0.042). For the Journal of Inflammation, the quality of reports was the same irrespective of the peer review model used. Conclusions Reviewers suggested by authors provide reports of comparable quality to non-author-suggested reviewers, but are significantly more likely to recommend acceptance. Open peer review reports for BMC Infectious Diseases were of higher quality than single-blind reports for BMC Microbiology. There was no difference in quality of peer review in the Journal of Inflammation under open peer review compared with single blind. PMID:26423855

Evaluating alternative systems of peer review: a large-scale agent-based modelling approach to scientific publication.

PubMed

Kovanis, Michail; Trinquart, Ludovic; Ravaud, Philippe; Porcher, Raphaël

2017-01-01

The debate on whether the peer-review system is in crisis has been heated recently. A variety of alternative systems have been proposed to improve the system and make it sustainable. However, we lack sufficient evidence and data related to these issues. Here we used a previously developed agent-based model of the scientific publication and peer-review system calibrated with empirical data to compare the efficiency of five alternative peer-review systems with the conventional system. We modelled two systems of immediate publication, with and without online reviews (crowdsourcing), a system with only one round of reviews and revisions allowed (re-review opt-out) and two review-sharing systems in which rejected manuscripts are resubmitted along with their past reviews to any other journal (portable) or to only those of the same publisher but of lower impact factor (cascade). The review-sharing systems outperformed or matched the performance of the conventional one in all peer-review efficiency, reviewer effort and scientific dissemination metrics we used. The systems especially showed a large decrease in total time of the peer-review process and total time devoted by reviewers to complete all reports in a year. The two systems with immediate publication released more scientific information than the conventional one but provided almost no other benefit. Re-review opt-out decreased the time reviewers devoted to peer review but had lower performance on screening papers that should not be published and relative increase in intrinsic quality of papers due to peer review than the conventional system. Sensitivity analyses showed consistent findings to those from our main simulations. We recommend prioritizing a system of review-sharing to create a sustainable scientific publication and peer-review system.

Peer review: a tool to enhance clinical teaching.

PubMed

Gusic, Maryellen; Hageman, Heather; Zenni, Elisa

2013-10-01

The system used by academic health centres to evaluate teaching must be valued by the large number of faculty staff that teach in clinical settings. Peer review can be used to evaluate and enhance clinical teaching. The objective of this study was to determine the perceptions of clinical faculty about the effects of participating in peer review. Faculty members were observed teaching in a clinical setting by trained peer observers. Feedback was provided using a checklist of behaviours and descriptive comments. Afterwards, semi-structured interviews were conducted to assess the faculty member's perception about the process. Notes from the interviews were analysed using a grounded theory approach. The study was approved by the institutional review boards of all the institutions involved. Three themes emerged from the interviews with faculty members: (1) they found the process to be valuable - they received information that affirmed "good" teaching behaviours, and were prompted to be more focused on their teaching; (2) they were motivated to enhance their teaching by being more deliberate, interactive and learner-centred; and (3) they were inspired to explore other opportunities to improve their teaching skills. Peer review is a process that promotes the open discussion and exchange of ideas. This conversation advances clinical teaching skills and allows high-quality teaching behaviours to be strengthened. © 2013 John Wiley & Sons Ltd.

Transition From Peer Review to Peer Learning: Experience in a Radiology Department.

PubMed

Donnelly, Lane F; Dorfman, Scott R; Jones, Jeremy; Bisset, George S

2017-10-18

To describe the process by which a radiology department moved from peer review to peer collaborative improvement (PCI) and review data from the first 16 months of the PCI process. Data from the first 16 months after PCI were reviewed: number of case reviews performed, number of learning opportunities identified, percentage yield of learning opportunities identified, type of learning opportunities identified, and comparison of the previous parameters between case randomly reviewed versus actively pushed (issues actively identified and entered). Changes in actively pushed cases were also assessed as volume per month over the 16 months (run chart). Faculty members were surveyed about their perception of the conversion to PCI. In all, 12,197 cases were peer reviewed, yielding 1,140 learning opportunities (9.34%). The most common types of learning opportunities for all reviewed cases included perception (5.1%) and reporting (1.9%). The yield of learning opportunities from actively pushed cases was 96.3% compared with 3.88% for randomly reviewed cases. The number of actively pushed cases per month increased over the course of the period and established two new confidence intervals. The faculty survey revealed that the faculty perceived the new PCI process as positive, nonpunitive, and focused on improvement. The study demonstrates that a switch to PCI is perceived as nonpunitive and associated with increased radiologist submission of learning opportunities. Active entering of identified learning opportunities had a greater yield and perceived value, compared with random review of cases. Copyright © 2017 American College of Radiology. Published by Elsevier Inc. All rights reserved.

What do we know about grant peer review in the health sciences?

PubMed Central

Guthrie, Susan; Ghiga, Ioana; Wooding, Steven

2018-01-01

Background: Peer review decisions award an estimated >95% of academic medical research funding, so it is crucial to understand how well they work and if they could be improved. Methods: This paper summarises evidence from 105 papers identified through a literature search on the effectiveness and burden of peer review for grant funding. Results: There is a remarkable paucity of evidence about the efficiency of peer review for funding allocation, given its centrality to the modern system of science. From the available evidence, we can identify some conclusions around the effectiveness and burden of peer review. The strongest evidence around effectiveness indicates a bias against innovative research. There is also fairly clear evidence that peer review is, at best, a weak predictor of future research performance, and that ratings vary considerably between reviewers. There is some evidence of age bias and cronyism. Good evidence shows that the burden of peer review is high and that around 75% of it falls on applicants. By contrast, many of the efforts to reduce burden are focused on funders and reviewers/panel members. Conclusions: We suggest funders should acknowledge, assess and analyse the uncertainty around peer review, even using reviewers’ uncertainty as an input to funding decisions. Funders could consider a lottery element in some parts of their funding allocation process, to reduce both burden and bias, and allow better evaluation of decision processes. Alternatively, the distribution of scores from different reviewers could be better utilised as a possible way to identify novel, innovative research. Above all, there is a need for open, transparent experimentation and evaluation of different ways to fund research. This also requires more openness across the wider scientific community to support such investigations, acknowledging the lack of evidence about the primacy of the current system and the impossibility of achieving perfection. PMID:29707193

Artificial intelligence in peer review: How can evolutionary computation support journal editors?

PubMed

Mrowinski, Maciej J; Fronczak, Piotr; Fronczak, Agata; Ausloos, Marcel; Nedic, Olgica

2017-01-01

With the volume of manuscripts submitted for publication growing every year, the deficiencies of peer review (e.g. long review times) are becoming more apparent. Editorial strategies, sets of guidelines designed to speed up the process and reduce editors' workloads, are treated as trade secrets by publishing houses and are not shared publicly. To improve the effectiveness of their strategies, editors in small publishing groups are faced with undertaking an iterative trial-and-error approach. We show that Cartesian Genetic Programming, a nature-inspired evolutionary algorithm, can dramatically improve editorial strategies. The artificially evolved strategy reduced the duration of the peer review process by 30%, without increasing the pool of reviewers (in comparison to a typical human-developed strategy). Evolutionary computation has typically been used in technological processes or biological ecosystems. Our results demonstrate that genetic programs can improve real-world social systems that are usually much harder to understand and control than physical systems.

Evaluation of the Inhalation Carcinogenicity of Ethylene Oxide ...

EPA Pesticide Factsheets

On September 22, 2006, the draft Evaluation of the Carinogenicity of Ethylene Oxide (EPA/635/R-06/003) and the draft charge to external peer reviewers were released for external peer review and public comment. This draft was reviewed by EPA’s Science Advisory Board (SAB) and the expert panel’s final report was made available December 21, 2007. Since that time the Agency implemented the May 2009 IRIS assessment development process in which other federal agencies and the Executive Offices of the President are provided two opportunities to comment on IRIS human health assessments; Interagency Science Consultation (Step 3) prior to public comment/peer review and Interagency Science Discussion (Step 6b) following peer review. In July, 2011, the draft assessment incorporating the SAB recommendations (December 2007) was sent to other federal agencies and Executive Offices of the President as part of Step 6 of the IRIS process. Following the May 2009 process, all written comments submitted by other agencies will be made publicly available. Accordingly, the interagency comments for ethylene oxide and the interagency science discussion materials provided to the other agencies are posted on this site. Note: After further consideration EPA has decided to undertake an additional peer review of the revised draft assessment on how the Agency responded to the SAB panel recommendations (December 2007), the exposure-response modeling of epidemiologic data, including n

How Do Health Care Providers Diagnose Pregnancy Loss or Miscarriage?

MedlinePlus

... NICHD Contacts for Funding Information Peer Review Small Business Programs About the Programs NICHD Priorities Funding Opportunities ... Opportunities Grants Process, Policies & Strategies Peer Review Small Business Programs Training & Career Development For Applicants Sample Applications ...

How Do Health Care Providers Diagnose Intellectual & Developmental Disabilities (IDDs)?

MedlinePlus

... NICHD Contacts for Funding Information Peer Review Small Business Programs About the Programs NICHD Priorities Funding Opportunities ... Opportunities Grants Process, Policies & Strategies Peer Review Small Business Programs Training & Career Development For Applicants Sample Applications ...

How Do Health Care Providers Diagnose Polycystic Ovary Syndrome (PCOS)?

MedlinePlus

... NICHD Contacts for Funding Information Peer Review Small Business Programs About the Programs NICHD Priorities Funding Opportunities ... Opportunities Grants Process, Policies & Strategies Peer Review Small Business Programs Training & Career Development For Applicants Sample Applications ...

A Descriptive Study of Nursing Peer-Review Programs in US Magnet® Hospitals.

PubMed

Roberts, Holli; Cronin, Sherill Nones

2017-04-01

The goal of this study was to assess the types of nursing peer review (NPR) programs in US Magnet® organizations. The 2 most predominant models of NPR programs in the literature are performance evaluation and clinical peer review. The literature on clinical peer review is primarily descriptive, outlining structures and anecdotal outcomes. Participants from hospitals holding Magnet recognition were selected using a stratified random-sampling method. A survey developed by the researchers assessed the presence of NPR. If clinical NPR was in place, program design, evaluation measurements, and barriers were explored. Findings suggest wide variability in NPR models. More than one-third of the respondents conduct peer evaluation as the only mechanism of NPR. Most hospitals with a clinical peer-review program reported a case review structure and process measurements not supported by data. The variations noted in this study suggest more research is needed to measure the effectiveness of NPR models and associated outcomes.

Print vs. Online Scholarly Publishing: Notes and Reflections on the Peer Review Process.

ERIC Educational Resources Information Center

Ryder, Martin

This paper addresses some of the major shifts in thinking about the nature of publishing and in basic beliefs regarding the peer review process in scholarly communication. Changes in the notion of ownership in the an age of technology are considered. Differences between the referee system with print publications and electronic text are outlined…

Useful, Used, and Peer Approved: The Importance of Rigor and Accessibility in Postsecondary Research and Evaluation. WISCAPE Viewpoints

ERIC Educational Resources Information Center

Vaade, Elizabeth; McCready, Bo

2012-01-01

Traditionally, researchers, policymakers, and practitioners have perceived a tension between rigor and accessibility in quantitative research and evaluation in postsecondary education. However, this study indicates that both producers and consumers of these studies value high-quality work and clear findings that can reach multiple audiences. The…

How peer-review constrains cognition: on the frontline in the knowledge sector

PubMed Central

Cowley, Stephen J.

2015-01-01

Peer-review is neither reliable, fair, nor a valid basis for predicting ‘impact’: as quality control, peer-review is not fit for purpose. Endorsing the consensus, I offer a reframing: while a normative social process, peer-review also shapes the writing of a scientific paper. In so far as ‘cognition’ describes enabling conditions for flexible behavior, the practices of peer-review thus constrain knowledge-making. To pursue cognitive functions of peer-review, however, manuscripts must be seen as ‘symbolizations’, replicable patterns that use technologically enabled activity. On this bio-cognitive view, peer-review constrains knowledge-making by writers, editors, reviewers. Authors are prompted to recursively re-aggregate symbolizations to present what are deemed acceptable knowledge claims. How, then, can recursive re-embodiment be explored? In illustration, I sketch how the paper’s own content came to be re-aggregated: agonistic review drove reformatting of argument structure, changes in rhetorical ploys and careful choice of wordings. For this reason, the paper’s knowledge-claims can be traced to human activity that occurs in distributed cognitive systems. Peer-review is on the frontline in the knowledge sector in that it delimits what can count as knowing. Its systemic nature is therefore crucial to not only discipline-centered ‘real’ science but also its ‘post-academic’ counterparts. PMID:26579064

Where is the trust in the peer review dynamic?

NASA Astrophysics Data System (ADS)

Ucko, Daniel

The motto of the Royal Society is ``nullius in verba'', which translates roughly as ``take nobody's word for it'', and this motto is furthermore emblematic of the conduct of science. We want facts and not opinions, verified results and not conjecture. From the time that we first started communicating scientific results, it has been recognized that scientific claims must be verified by someone who is not the maker of those claims, and who furthermore has no stake in the matter, in other words, a claim needs to be evaluated objectively. Peer review as a method of evaluation can be thought of as akin to an experiment, where the review process tests the hypothesis of a submitted paper. Peer review is however also a social process with human actors: authors, referees, and editors. As a process, peer review depends on trust, but in what way does that manifest? There are many agents in peer review: in addition to the human actors, there is also the institution that is the journal, as well as the publisher (e.g. APS) that stands behind the journal. People can also have trust in the very concept of peer review. If we accept as a proposition that publications are witnesses to science in the same way that people who attend scientific demonstrations are witnesses of an experiment, then how much do we trust this witness? A few further questions arise: If referees (and sometimes authors) are anonymous, what does this do to the mechanisms of trust? Is trust only possible between human agents, or can you trust a process or a journal in a similar way to trusting a certain car brand? Is an absence of trust the same as distrust? Is trust rational, or cognitive, or is it a practice? In this paper I will attempt to locate the trust and ask how trust is earned, and, conversely, how it can be lost, using peer review as example. I have a joint affiliation with Stony Brook University and APS and would like both listed, in that order, in the abstract.

Negotiation on the Assessment of Research Articles with Academic Reviewers: Application of Peer-Review Approach of Teaching

ERIC Educational Resources Information Center

Kumar, Prashant; Rafiq, Imran; Imam, Boulent

2011-01-01

This study provides an insight into the dominant negotiation processes that occur between the authors of research articles and academic reviewers at the peer reviewing stage. Data of reviewers comments and authors responses on 32 science and engineering based journal articles covering four decision categories (accept as is, accept with minor…

Automated Assessment of the Quality of Peer Reviews Using Natural Language Processing Techniques

ERIC Educational Resources Information Center

Ramachandran, Lakshmi; Gehringer, Edward F.; Yadav, Ravi K.

2017-01-01

A "review" is textual feedback provided by a reviewer to the author of a submitted version. Peer reviews are used in academic publishing and in education to assess student work. While reviews are important to e-commerce sites like Amazon and e-bay, which use them to assess the quality of products and services, our work focuses on…

The Most Preferred and Effective Reviewer of L2 Writing among Automated Grading System, Peer Reviewer and Teacher

ERIC Educational Resources Information Center

Tsai, Min-Hsiu

2017-01-01

Who is the most preferred and deemed the most helpful reviewer in improving student writing? This study exercised a blended teaching method which consists of three currently prevailing reviewers: the automated grading system (AGS, a web-based method), the peer review (a process-oriented approach), and the teacher grading technique (the…

IRIS Toxicological Review of Libby Amphibole Asbestos ...

EPA Pesticide Factsheets

On August 25, 2011, the draft Toxicological Review of Libby Amphibole Asbestos and the charge to external peer reviewers were released for external peer review and public comment. The Toxicological Review and charge were reviewed internally by EPA and by other federal agencies and White House Offices before public release. In the new IRIS process (May 2009), introduced by the EPA Administrator, all written comments on IRIS assessments submitted by other federal agencies and White House Offices will be made publicly available. Accordingly, interagency comments and the interagency science consultation draft of the IRIS Toxicological Review of Libby Amphibole Asbestos and the charge to external peer reviewers are posted on this site. The project supports OSWER and Region 8 site clean-up and related risk management initiatives at this Superfund site. As with all IRIS assessments, the draft document will undergo agency review, OMB/interagency review and independent external peer review before being included on the IRIS data base.

NIH Peer Review: Scored Review Criteria and Overall Impact

ERIC Educational Resources Information Center

Lindner, Mark D.; Vancea, Adrian; Chen, Mei-Ching; Chacko, George

2016-01-01

The National Institutes of Health (NIH) is the largest source of funding for biomedical research in the world. Funding decisions are made largely based on the outcome of a peer review process that is intended to provide a fair, equitable, timely, and unbiased review of the quality, scientific merit, and potential impact of the research. There have…

Geophysical information for teachers: Wave tanks, homemade clouds, glacial goo, and more!

NASA Astrophysics Data System (ADS)

Adamec, Bethany Holm

2012-02-01

AGU is deeply committed to fostering the next generation of Earth and space scientists. Union activities contribute to this effort in many ways, one of which is partnering with the National Earth Science Teacher's Association (NESTA) to hold the Annual Geophysical Information for Teachers (GIFT) workshop at AGU's annual Fall Meeting. GIFT allows K-12 science teachers to hear about the latest geoscience research from the scientists making the discoveries, explore new classroom resources for their students, and visit exhibits and technical sessions of the AGU meeting for free. In 2011 AGU worked with NESTA to develop an improved rigorous and open application process for scientists and education professionals who wished to work as a team and present their Earth and space science work to teachers, as well as lead the educators in a hands-on, classroom- ready activity. Twenty-four applications were received for five slots, so the selected presentations (on tsunamis, clouds, field campaigns, glaciers, and volcanoes), chosen through a peer- review process, truly represented the best ways of getting cutting-edge science into the classroom.

How Can Men Reduce the Risk of Getting a Sexually Transmitted Disease (STD)?

MedlinePlus

... NICHD Contacts for Funding Information Peer Review Small Business Programs About the Programs NICHD Priorities Funding Opportunities ... Opportunities Grants Process, Policies & Strategies Peer Review Small Business Programs Training & Career Development For Applicants Sample Applications ...

Review and Reward within the Computerised Peer-Assessment of Essays

ERIC Educational Resources Information Center

Davies, Phil

2009-01-01

This article details the implementation and use of a "Review Stage" within the CAP (computerised assessment by peers) tool as part of the assessment process for a post-graduate module in e-learning. It reports upon the effect of providing the students with a "second chance" in marking and commenting their peers' essays having been able to view the…

Changing the Peer Review or Changing the Peers--Recent Development in Assessment of Large Research Collaborations

ERIC Educational Resources Information Center

Hansson, Finn; Monsted, Mette

2012-01-01

Peer review of research programmes is changing. The problem is discussed through detailed study of a selection process to a call for collaborations in the energy sector for the European Institute of Innovation and Technology. The authors were involved in the application for a Knowledge Innovation Community. Through the analysis of the case the…

Using a Template to Facilitate External Peer Preview of Curriculum: A Variation on the PRoT Theme

ERIC Educational Resources Information Center

Sealey, Rebecca

2013-01-01

Peer reviewing of teaching and curriculum in Higher Education is a common practice aimed at both quality assurance and professional development. External review of curriculum prior to implementation appears less common. The aim of this project was to develop, implement and evaluate a user-friendly process for external peer preview of teaching…

Formalising multidisciplinary peer review: developing a haematological malignancy-specific electronic proforma and standard operating procedure to facilitate procedural efficiency and evidence-based clinical practice.

PubMed

Trotman, Judith; Trinh, Jimmy; Kwan, Yiu Lam; Estell, Jane A; Fletcher, Julie; Archer, Kate; Lee, Kenneth; Foo, Kerwin; Curnow, Jennifer; Bianchi, Alessandra; Wignall, Lynda; Verner, Emma; Gasiorowski, Robin; Siedlecka, Elizabeth; Cunningham, Ilona

2017-05-01

Multidisciplinary team (MDT) meetings aimed at facilitating peer review have become standard practice in oncology. However, there is scant literature on the optimal structure and conduct of such meetings. To develop a process for formal peer review of patients with haematological malignancies and to audit any resulting changes made to the management recommendations of the treating physician. A standard operating procedure (SOP) for MDT meetings was developed essentially to integrate clinical peer review with weekly pathology and radiology meetings. The centrepiece is the electronic submission of a patient-specific proforma (Microsoft InfoPath) prior to the meeting. It serves as the template for presentation, discussion and recording of recommendations and conclusions. The final verified document is stored in the electronic patient record, and a copy is sent to the general practitioner. The proposed management plans were compared to the consensus recommendations of the meeting for the first 4 years since inception. Both SOP and proforma underwent continual improvements. These provided the framework for the conduct of a robust weekly MDT meeting for peer review of the management of patients with haematological malignancies. On 20% of occasions, patient management plans were altered to optimise patient care as a direct consequence on peer review at the MDT. Our streamlined process, in its ultimate format, has provided a mature and efficient forum for formal peer review in a genuine multidisciplinary environment. Both initial data and informal feedback support its ongoing activity as an integral component of delivering quality patient care. © 2016 Royal Australasian College of Physicians.

Army Corps of Engineers: Peer Review Process for Civil Works Project Studies Can Be Improved

DTIC Science & Technology

2012-03-01

Chacon Creek study in southern Texas underwent peer review but should not have, according to some Corps officials we spoke with. This study was for a...assessing and addressing such risks in light of Hurricane Katrina and said that flood studies such as Chacon Creek require peer review because of the... Chacon Creek, Rio Grande Draft Feasibility Report and Integrated Environmental Assessment Fort Worth Southwestern Flood Risk management Nov. 17

What is the future of peer review? Why is there fraud in science? Is plagiarism out of control? Why do scientists do bad things? Is it all a case of: "all that is necessary for the triumph of evil is that good men do nothing"?

PubMed

Triggle, Chris R; Triggle, David J

2007-01-01

Peer review is an essential component of the process that is universally applied prior to the acceptance of a manuscript, grant or other scholarly work. Most of us willingly accept the responsibilities that come with being a reviewer but how comfortable are we with the process? Peer review is open to abuse but how should it be policed and can it be improved? A bad peer review process can inadvertently ruin an individual's career, but are there penalties for policing a reviewer who deliberately sabotages a manuscript or grant? Science has received an increasingly tainted name because of recent high profile cases of alleged scientific misconduct. Once considered the results of work stress or a temporary mental health problem, scientific misconduct is increasingly being reported and proved to be a repeat offence. How should scientific misconduct be handled--is it a criminal offence and subject to national or international law? Similarly plagiarism is an ever-increasing concern whether at the level of the student or a university president. Are the existing laws tough enough? These issues, with appropriate examples, are dealt with in this review.

IRIS Toxicological Review of Inorganic Arsenic (Cancer) ...

EPA Pesticide Factsheets

On February 19, 2010, the draft IRIS Toxicological Review of Inorganic Arsenic (Cancer) external review draft document and the charge to external peer reviewers were released for public review and comment. The draft document and the charge to external peer reviewers were reviewed internally by EPA and by other federal agencies and White House Offices before public release. In the new IRIS process, introduced by the EPA Administrator, all written comments on IRIS assessments submitted by other federal agencies and White House Offices will be made publicly available. Accordingly, interagency comments and the interagency science consultation draft of the Toxicological Review of Inorganic Arsenic and the charge to external peer reviewers are posted on this site. This draft IRIS health assessment addresses only cancer human health effects that may result from chronic exposure to this chemical. An assessment of noncancer health effects of inorganic arsenic will be released for external peer review and public comment at a later date.

Pre-university Chemistry Students in a Mimicked Scholarly Peer Review

NASA Astrophysics Data System (ADS)

van Rens, Lisette; Hermarij, Philip; Pilot, Albert; Beishuizen, Jos; Hofman, Herman; Wal, Marjolein

2014-10-01

Peer review is a significant component in scientific research. Introducing peer review into inquiry processes may be regarded as an aim to develop student understanding regarding quality in inquiries. This study examines student understanding in inquiry peer reviews among pre-university chemistry students, aged 16-17, when they enact a design of a mimicked scholarly peer review. This design is based on a model of a human activity system. Twenty-five different schools in Brazil, Germany, Poland and The Netherlands participated. The students (n = 880) conducted in small groups (n = 428) open inquiries on fermentation. All groups prepared an inquiry report for peer review. These reports were published on a website. Groups were randomly paired in an internet symposium, where they posted review comments to their peers. These responses were qualitatively analyzed on small groups' level of understanding regarding seven categories: inquiry question, hypothesis, management of control variables, accurate measurement, presenting results, reliability of results, discussion and conclusion. The mimicked scholarly review prompted a collective practice. Student understanding was significantly well on presenting results, discussion and conclusion, and significantly less on inquiry question and reliability of results. An enacted design, based on a model of a human activity system, created student understanding of quality in inquiries as well as an insight in a peer-reviewing practice. To what extent this model can be applied in a broader context of design research in science education needs further study.

Thank you to Virology Journal's peer reviewers in 2013

PubMed Central

2014-01-01

The editors of Virology Journal would like to thank all our reviewers who have contributed to the journal in Volume 10 (2013). The success of any scientific journal depends on an effective and strict peer review process and Virology Journal could not operate without your contribution. We are grateful to the large number of reviewers (1026 to be exact!), who have done a great job in not only lifting the quality of the journal’s scientific peer reviewing process, but also helped us to achieve our goal of a median time to first decision of just 35 days. Our record time from submission to online, open access, publication in 2013 was 22 days for a Research Article [1] and 28 days for a Review [2]. This is a great achievement by any standard. We look forward to your continuous support of Virology Journal either as an invited reviewer or a contributing author in the years to come.

Do peers matter? A review of peer and/or friends' influence on physical activity among American adolescents.

PubMed

Fitzgerald, Amanda; Fitzgerald, Noelle; Aherne, Cian

2012-08-01

This systematic review investigated the relationship between peer and/or friend variables and physical activity among adolescents by synthesising cross-sectional, longitudinal, and experimental research conducted in the US. Seven electronic databases were searched to identify related articles published within the last 10 years and the articles reviewed included adolescents between 10 and 18 years. Studies reporting a measure of physical activity for adolescents and at least one potential peer and/or friend variable were included. Research demonstrated that peers and friends have an important role to play in the physical activity behavior of adolescents. Six processes were identified through which peers and/or friends may have an influence on physical activity including: peer and/or friend support, presence of peers and friends, peer norms, friendship quality and acceptance, peer crowds, and peer victimization. The theoretical significance of these results is assessed and the development of peer-related physical activity programs for adolescents is discussed. Copyright © 2012 The Foundation for Professionals in Services for Adolescents. Published by Elsevier Ltd. All rights reserved.

Evaluating Training Programs for Primary Care Providers in Child/Adolescent Mental Health in Canada: A Systematic Review.

PubMed

Gotovac, Sandra; Espinet, Stacey; Naqvi, Reza; Lingard, Lorelei; Steele, Margaret

2018-04-01

The need for child/adolescent mental health care in Canada is growing. Primary care can play a key role in filling this gap, yet most providers feel they do not have adequate training. This paper reviews the Canadian literature on capacity building programs in child and adolescent psychiatry for primary care providers, to examine how these programs are being implemented and evaluated to contribute to evidence-based initiatives. A systematic literature review of peer-reviewed published articles of capacity building initiatives in child/adolescent mental health care for primary care practitioners that have been implemented in Canada. Sixteen articles were identified that met inclusion criteria. Analysis revealed that capacity building initiatives in Canada are varied but rigorous evaluation methodology is lacking. Primary care providers welcome efforts to increase mental health care capacity and were satisfied with the implementation of most programs. Objective conclusions regarding the effectiveness of these programs to increase mental health care capacity is challenging given the evaluation methodology of these studies. Rigorous evaluation methods are needed to make evidence-based decisions on ways forward to be able to build child/adolescent mental health care capacity in primary care. Outcome measures need to move beyond self-report to more objective measures, and should expand the measurement of patient outcomes to ensure that these initiative are indeed leading to improved care for families.

Evaluation of internal peer-review to train nurses recruiting to a randomized controlled trial--Internal Peer-review for Recruitment Training in Trials (InterPReTiT).

PubMed

Mann, Cindy; Delgado, Debbie; Horwood, Jeremy

2014-04-01

A discussion and qualitative evaluation of the use of peer-review to train nurses and optimize recruitment practice in a randomized controlled trial. Sound recruitment processes are critical to the success of randomized controlled trials. Nurses recruiting to trials must obtain consent for an intervention that is administered for reasons other than anticipated benefit to the patient. This requires not only patients' acquiescence but also evidence that they have weighed the relevant information in reaching their decision. How trial information is explained is vital, but communication and training can be inadequate. A discussion of a new process to train nurses recruiting to a randomized controlled trial. Literature from 1999-2013 about consenting to trials is included. Over 3 months from 2009-2010, recruiting nurses reviewed recruitment interviews recorded during the pilot phase of a single-site randomized controlled trial and noted content, communication style and interactions. They discussed their findings during peer-review meetings, which were audio-recorded and analysed using qualitative methodology. Peer-review can enhance nurses' training in trial recruitment procedures by supporting development of the necessary communication skills, facilitating consistency in information provision and sharing best practice. Nurse-led peer-review can provide a forum to share communication strategies that will elicit and address participant concerns and obtain evidence of participant understanding prior to consent. Comparing practice can improve consistency and accuracy of trial information and facilitate identification of recruitment issues. Internal peer-review was well accepted and promoted team cohesion. Further evaluation is needed. © 2013 John Wiley & Sons Ltd.

Evidence-based Peer Review for Radiation Therapy - Updated Review of the Literature with a Focus on Tumour Subsite and Treatment Modality.

PubMed

Huo, M; Gorayski, P; Poulsen, M; Thompson, K; Pinkham, M B

2017-10-01

Technological advances in radiation therapy permit steep dose gradients from the target to spare normal tissue, but increase the risk of geographic miss. Suboptimal target delineation adversely affects clinical outcomes. Prospective peer review is a method for quality assurance of oncologists' radiotherapy plans. Published surveys suggest it is widely implemented. However, it may not be feasible to review every case before commencement of radiation therapy in all departments. The rate of plan changes following peer review of cases without a specific subsite or modality is typically around 10%. Stereotactic body radiation therapy, head and neck, gynaecological, gastrointestinal, haematological and lung cases are associated with higher rates of change of around 25%. These cases could thus be prioritised for peer review. Other factors may limit peer review efficacy including organisational culture, time constraints and the physical environment in which sessions are held. Recommendations for peer review endorsed by the American Society for Radiation Oncology were made available in 2013, but a number of relevant studies have been published since. Here we review and update the literature, and provide an updated suggestion for the implementation of peer review to serve as an adjunct to published guidelines. This may help practitioners evaluate their current processes and maximise the utility and effectiveness of peer review sessions. Copyright © 2017 The Royal College of Radiologists. Published by Elsevier Ltd. All rights reserved.

Blinding Applicants in a First-Stage Peer-Review Process of Biomedical Research Grants: An Observational Study

ERIC Educational Resources Information Center

Solans-Domènech, Maite; Guillamón, Imma; Ribera, Aida; Ferreira-González, Ignacio; Carrion, Carme; Permanyer-Miralda, Gaietà; Pons, Joan M. V.

2017-01-01

To blind or not researcher's identity has often been a topic of debate in the context of peer-review process for scientific publication and research grant application. This article reports on how knowing the name and experience of researchers/institutions influences the qualification of a proposal. We present our experience of managing the…

There is no ``I'' in referee: Why referees should be anonymous

NASA Astrophysics Data System (ADS)

Ucko, Daniel

2015-03-01

From the early days of modern science, it has been recognized that scientific claims must be verified by someone who is not the maker of those claims, and who furthermore has no stake in the matter. In other words, claims need to be evaluated objectively, by the community. The way in which this tends to be done is by peer review conducted by journals. Peer review as currently practiced touches on the themes of trust, where the trust is in institutions and procedures that emerge from expert communities. The practice of peer review is viewed as a citizenly duty of scientists in the scientific community, because all scientists take turns serving either as authors, referees, and editors in the peer review process We lack the resources to have a work evaluated by the entire community, so we substitute with a representative. Yet, in most examples of scientific review, the referee or referees are anonymous. This question is particularly important when the peer review process is brought to bear in order to evaluate matters beyond scientific validity, more ``subjective'' criteria such as relative importance, broadness of interest - criteria that do not appear to have an objective standard of comparison and validation. I will show that the anonymity of referees, far from endangering this trust, actually strengthens it. I will show that this anonymity is crucial in order to maintain any objectivity in scientific peer review, and why authors should not try to unmask the referee. Also at American Physical Society (APS).

The Dedisciplining of Peer Review

ERIC Educational Resources Information Center

Frodeman, Robert; Briggle, Adam

2012-01-01

The demand for greater public accountability is changing the nature of ex ante peer review at public science agencies worldwide. Based on a four year research project, this essay examines these changes through an analysis of the process of grant proposal review at two US public science agencies, the National Institutes of Health (NIH) and the…

Meeting Customer Service Standards Under Executive Order 12862: NASA’s Space Science Grant Process.

DTIC Science & Technology

1995-07-01

Logistics Management Institute Meeting Customer Service Standards Under Executive Order 12862 NASA’s Space Science Grant Process NS302MR2...Logistics Management Institute to survey the customers — proposal writers and peer review panelists — of its science grant process. This effort benefited... Management Institute (LMI) to develop customer satisfac- tion surveys for both proposal writers and peer review panelists as well as to conduct those

Retrospective analysis of the quality of reports by author-suggested and non-author-suggested reviewers in journals operating on open or single-blind peer review models.

PubMed

Kowalczuk, Maria K; Dudbridge, Frank; Nanda, Shreeya; Harriman, Stephanie L; Patel, Jigisha; Moylan, Elizabeth C

2015-09-29

To assess whether reports from reviewers recommended by authors show a bias in quality and recommendation for editorial decision, compared with reviewers suggested by other parties, and whether reviewer reports for journals operating on open or single-blind peer review models differ with regard to report quality and reviewer recommendations. Retrospective analysis of the quality of reviewer reports using an established Review Quality Instrument, and analysis of reviewer recommendations and author satisfaction surveys. BioMed Central biology and medical journals. BMC Infectious Diseases and BMC Microbiology are similar in size, rejection rates, impact factors and editorial processes, but the former uses open peer review while the latter uses single-blind peer review. The Journal of Inflammation has operated under both peer review models. Two hundred reviewer reports submitted to BMC Infectious Diseases, 200 reviewer reports submitted to BMC Microbiology and 400 reviewer reports submitted to the Journal of Inflammation. For each journal, author-suggested reviewers provided reports of comparable quality to non-author-suggested reviewers, but were significantly more likely to recommend acceptance, irrespective of the peer review model (p<0.0001 for BMC Infectious Diseases, BMC Microbiology and the Journal of Inflammation). For BMC Infectious Diseases, the overall quality of reviewer reports measured by the Review Quality Instrument was 5% higher than for BMC Microbiology (p=0.042). For the Journal of Inflammation, the quality of reports was the same irrespective of the peer review model used. Reviewers suggested by authors provide reports of comparable quality to non-author-suggested reviewers, but are significantly more likely to recommend acceptance. Open peer review reports for BMC Infectious Diseases were of higher quality than single-blind reports for BMC Microbiology. There was no difference in quality of peer review in the Journal of Inflammation under open peer review compared with single blind. Published by the BMJ Publishing Group Limited. For permission to use (where not already granted under a licence) please go to http://group.bmj.com/group/rights-licensing/permissions.

A multi-disciplinary perspective on emergent and future innovations in peer review

PubMed Central

Tennant, Jonathan P.; Dugan, Jonathan M.; Graziotin, Daniel; Jacques, Damien C.; Waldner, François; Mietchen, Daniel; Elkhatib, Yehia; B. Collister, Lauren; Pikas, Christina K.; Crick, Tom; Masuzzo, Paola; Caravaggi, Anthony; Berg, Devin R.; Niemeyer, Kyle E.; Ross-Hellauer, Tony; Mannheimer, Sara; Rigling, Lillian; Katz, Daniel S.; Greshake Tzovaras, Bastian; Pacheco-Mendoza, Josmel; Fatima, Nazeefa; Poblet, Marta; Isaakidis, Marios; Irawan, Dasapta Erwin; Renaut, Sébastien; Madan, Christopher R.; Matthias, Lisa; Nørgaard Kjær, Jesper; O'Donnell, Daniel Paul; Neylon, Cameron; Kearns, Sarah; Selvaraju, Manojkumar; Colomb, Julien

2017-01-01

Peer review of research articles is a core part of our scholarly communication system. In spite of its importance, the status and purpose of peer review is often contested. What is its role in our modern digital research and communications infrastructure? Does it perform to the high standards with which it is generally regarded? Studies of peer review have shown that it is prone to bias and abuse in numerous dimensions, frequently unreliable, and can fail to detect even fraudulent research. With the advent of web technologies, we are now witnessing a phase of innovation and experimentation in our approaches to peer review. These developments prompted us to examine emerging models of peer review from a range of disciplines and venues, and to ask how they might address some of the issues with our current systems of peer review. We examine the functionality of a range of social Web platforms, and compare these with the traits underlying a viable peer review system: quality control, quantified performance metrics as engagement incentives, and certification and reputation. Ideally, any new systems will demonstrate that they out-perform and reduce the biases of existing models as much as possible. We conclude that there is considerable scope for new peer review initiatives to be developed, each with their own potential issues and advantages. We also propose a novel hybrid platform model that could, at least partially, resolve many of the socio-technical issues associated with peer review, and potentially disrupt the entire scholarly communication system. Success for any such development relies on reaching a critical threshold of research community engagement with both the process and the platform, and therefore cannot be achieved without a significant change of incentives in research environments. PMID:29188015

A multi-disciplinary perspective on emergent and future innovations in peer review.

PubMed

Tennant, Jonathan P; Dugan, Jonathan M; Graziotin, Daniel; Jacques, Damien C; Waldner, François; Mietchen, Daniel; Elkhatib, Yehia; B Collister, Lauren; Pikas, Christina K; Crick, Tom; Masuzzo, Paola; Caravaggi, Anthony; Berg, Devin R; Niemeyer, Kyle E; Ross-Hellauer, Tony; Mannheimer, Sara; Rigling, Lillian; Katz, Daniel S; Greshake Tzovaras, Bastian; Pacheco-Mendoza, Josmel; Fatima, Nazeefa; Poblet, Marta; Isaakidis, Marios; Irawan, Dasapta Erwin; Renaut, Sébastien; Madan, Christopher R; Matthias, Lisa; Nørgaard Kjær, Jesper; O'Donnell, Daniel Paul; Neylon, Cameron; Kearns, Sarah; Selvaraju, Manojkumar; Colomb, Julien

2017-01-01

Peer review of research articles is a core part of our scholarly communication system. In spite of its importance, the status and purpose of peer review is often contested. What is its role in our modern digital research and communications infrastructure? Does it perform to the high standards with which it is generally regarded? Studies of peer review have shown that it is prone to bias and abuse in numerous dimensions, frequently unreliable, and can fail to detect even fraudulent research. With the advent of web technologies, we are now witnessing a phase of innovation and experimentation in our approaches to peer review. These developments prompted us to examine emerging models of peer review from a range of disciplines and venues, and to ask how they might address some of the issues with our current systems of peer review. We examine the functionality of a range of social Web platforms, and compare these with the traits underlying a viable peer review system: quality control, quantified performance metrics as engagement incentives, and certification and reputation. Ideally, any new systems will demonstrate that they out-perform and reduce the biases of existing models as much as possible. We conclude that there is considerable scope for new peer review initiatives to be developed, each with their own potential issues and advantages. We also propose a novel hybrid platform model that could, at least partially, resolve many of the socio-technical issues associated with peer review, and potentially disrupt the entire scholarly communication system. Success for any such development relies on reaching a critical threshold of research community engagement with both the process and the platform, and therefore cannot be achieved without a significant change of incentives in research environments.

Lessons Learned from the Frenchman Flat Flow and Transport Modeling External Peer Review

NASA Astrophysics Data System (ADS)

Becker, N. M.; Crowe, B. M.; Ruskauff, G.; Kwicklis, E. M.; Wilborn, B.

2011-12-01

The objective of the U.S. Department of Energy's Underground Test Area Program program is to forecast, using computer modeling, the contaminant boundary of radionuclide transport in groundwater at the Nevada National Security Site that exceeds the Safe Drinking Water Act after 1000 yrs. This objective is defined within the Federal Facilities Agreement and Consent Order between the Department of Energy, Department of Defense and State of Nevada Division of Environmental Protection . At one of the Corrective Action Units, Frenchman Flat, a Phase I flow and transport model underwent peer review in 1999 to determine if the model approach, assumptions and results adequate to be used as a decision tool as a basis to negotiate a compliance boundary with Nevada Division of Environmental Protection. The external peer review decision was that the model was not fully tested under a full suite of possible conceptual models, including boundary conditions, flow mechanisms, other transport processes, hydrological framework models, sensitivity and uncertainty analysis, etc. The program went back to collect more data, expand modeling to consider other alternatives that were not adequately tested, and conduct sensitivity and uncertainty analysis. A second external peer review was held in August 2010. Their conclusion that the new Frenchman Flat flow and transport modeling analysis were adequate as a decision tool and that the model was ready to advance to the next step in the Federal Facilities Agreement and Consent Order strategy. We will discuss the processes to changing the modeling that occurred between the first and second peer reviews, and then present the second peer review general comments. Finally, we present the lessons learned from the total model acceptance process required for federal regulatory compliance.

Emerging trends in peer review—a survey

PubMed Central

Walker, Richard; Rocha da Silva, Pascal

2015-01-01

“Classical peer review” has been subject to intense criticism for slowing down the publication process, bias against specific categories of paper and author, unreliability, inability to detect errors and fraud, unethical practices, and the lack of recognition for unpaid reviewers. This paper surveys innovative forms of peer review that attempt to address these issues. Based on an initial literature review, we construct a sample of 82 channels of scientific communication covering all forms of review identified by the survey, and analyze the review mechanisms used by each channel. We identify two major trends: the rapidly expanding role of preprint servers (e.g., ArXiv) that dispense with traditional peer review altogether, and the growth of “non-selective review,” focusing on papers' scientific quality rather than their perceived importance and novelty. Other potentially important developments include forms of “open review,” which remove reviewer anonymity, and interactive review, as well as new mechanisms for post-publication review and out-of-channel reader commentary, especially critical commentary targeting high profile papers. One of the strongest findings of the survey is the persistence of major differences between the peer review processes used by different disciplines. None of these differences is likely to disappear in the foreseeable future. The most likely scenario for the coming years is thus continued diversification, in which different review mechanisms serve different author, reader, and publisher needs. Relatively little is known about the impact of these innovations on the problems they address. These are important questions for future quantitative research. PMID:26074753

What is open peer review? A systematic review

PubMed Central

Ross-Hellauer, Tony

2017-01-01

Background: “Open peer review” (OPR), despite being a major pillar of Open Science, has neither a standardized definition nor an agreed schema of its features and implementations. The literature reflects this, with numerous overlapping and contradictory definitions. While for some the term refers to peer review where the identities of both author and reviewer are disclosed to each other, for others it signifies systems where reviewer reports are published alongside articles. For others it signifies both of these conditions, and for yet others it describes systems where not only “invited experts” are able to comment. For still others, it includes a variety of combinations of these and other novel methods. Methods: Recognising the absence of a consensus view on what open peer review is, this article undertakes a systematic review of definitions of “open peer review” or “open review”, to create a corpus of 122 definitions. These definitions are systematically analysed to build a coherent typology of the various innovations in peer review signified by the term, and hence provide the precise technical definition currently lacking. Results: This quantifiable data yields rich information on the range and extent of differing definitions over time and by broad subject area. Quantifying definitions in this way allows us to accurately portray exactly how ambiguously the phrase “open peer review” has been used thus far, for the literature offers 22 distinct configurations of seven traits, effectively meaning that there are 22 different definitions of OPR in the literature reviewed. Conclusions: I propose a pragmatic definition of open peer review as an umbrella term for a number of overlapping ways that peer review models can be adapted in line with the aims of Open Science, including making reviewer and author identities open, publishing review reports and enabling greater participation in the peer review process. PMID:28580134

Artificial intelligence in peer review: How can evolutionary computation support journal editors?

PubMed Central

Fronczak, Piotr; Fronczak, Agata; Ausloos, Marcel; Nedic, Olgica

2017-01-01

With the volume of manuscripts submitted for publication growing every year, the deficiencies of peer review (e.g. long review times) are becoming more apparent. Editorial strategies, sets of guidelines designed to speed up the process and reduce editors’ workloads, are treated as trade secrets by publishing houses and are not shared publicly. To improve the effectiveness of their strategies, editors in small publishing groups are faced with undertaking an iterative trial-and-error approach. We show that Cartesian Genetic Programming, a nature-inspired evolutionary algorithm, can dramatically improve editorial strategies. The artificially evolved strategy reduced the duration of the peer review process by 30%, without increasing the pool of reviewers (in comparison to a typical human-developed strategy). Evolutionary computation has typically been used in technological processes or biological ecosystems. Our results demonstrate that genetic programs can improve real-world social systems that are usually much harder to understand and control than physical systems. PMID:28931033

WASP: Is open access publishing the way forward? A review of the different ways in which research papers can be published.

PubMed

Cuschieri, Sarah

2018-06-01

Academics have a duty towards peers and scholars alike to engage in research work and to publish their findings. This also assists in establishing personal academic success as well as the attainment of research grants. In the past, authors used to publish their research articles for free but access to these articles was restricted to subscription users only. Recently, open access publishing has gained momentum, whereby such articles are made freely accessible online. However open access publishing comes with a price tag for the author through article processing charges. Open access may also question a journal's credibility within the academic world if improperly implemented. This is particularly so following the unsolicited bombardment of researchers' email accounts with invitations for submissions to predatory open access journals. For these reasons, authors needs to rigorously weigh the pros and cons of whether to choose a subscription based or an open access journal for publication. Copyright © 2018 Elsevier B.V. All rights reserved.

Collaborative Learning through Formative Peer Review with Technology

ERIC Educational Resources Information Center

Eaton, Carrie Diaz; Wade, Stephanie

2014-01-01

This paper describes a collaboration between a mathematician and a compositionist who developed a sequence of collaborative writing assignments for calculus. This sequence of developmentally appropriate assignments presents peer review as a collaborative process that promotes reflection, deepens understanding, and improves exposition. First, we…

Publications and the peer review system

USDA-ARS?s Scientific Manuscript database

The peer review process as it relates to scientific publications in entomological journals is facing a number of serious issues that must be addressed. Among those issues are the increasing submissions from international authors writing in English as a second or third language, manuscripts lacking s...

Portfolio Peer Review: A Tool for Program Change.

ERIC Educational Resources Information Center

Fleak, Sandra K.; Romine, Jeff; Gilchrist, Neil

2003-01-01

To achieve cultural change in a business management/accounting department, annual peer review of faculty portfolios documenting teaching, advising, service, and scholarship was instituted. The process improved the department's alignment with the university's mission. Scholarly productivity quadrupled from 1998-2001. Portfolio assessment had little…

SU-F-T-231: Improving the Efficiency of a Radiotherapy Peer-Review System for Quality Assurance

DOE Office of Scientific and Technical Information (OSTI.GOV)

Hsu, S; Basavatia, A; Garg, M

Purpose: To improve the efficiency of a radiotherapy peer-review system using a commercially available software application for plan quality evaluation and documentation. Methods: A commercial application, FullAccess (Radialogica LLC, Version 1.4.4), was implemented in a Citrix platform for peer-review process and patient documentation. This application can display images, isodose lines, and dose-volume histograms and create plan reports for peer-review process. Dose metrics in the report can also be benchmarked for plan quality evaluation. Site-specific templates were generated based on departmental treatment planning policies and procedures for each disease site, which generally follow RTOG protocols as well as published prospective clinicalmore » trial data, including both conventional fractionation and hypo-fractionation schema. Once a plan is ready for review, the planner exports the plan to FullAccess, applies the site-specific template, and presents the report for plan review. The plan is still reviewed in the treatment planning system, as that is the legal record. Upon physician’s approval of a plan, the plan is packaged for peer review with the plan report and dose metrics are saved to the database. Results: The reports show dose metrics of PTVs and critical organs for the plans and also indicate whether or not the metrics are within tolerance. Graphical results with green, yellow, and red lights are displayed of whether planning objectives have been met. In addition, benchmarking statistics are collected to see where the current plan falls compared to all historical plans on each metric. All physicians in peer review can easily verify constraints by these reports. Conclusion: We have demonstrated the improvement in a radiotherapy peer-review system, which allows physicians to easily verify planning constraints for different disease sites and fractionation schema, allows for standardization in the clinic to ensure that departmental policies are maintained, and builds a comprehensive database for potential clinical outcome evaluation.« less

Peer Review of Best Practices

NASA Astrophysics Data System (ADS)

Pearlman, J.; Buttigieg, P. L.; Simpson, P.; Munoz, C.; Dufois, F.; Heslop, E. E.

2017-12-01

To ensure the quality of oceanographic data, there is a clear need to employ best practices (BPs) for ocean observation and information management. However, effectively discovering these BPs is a challenge, hindering harmonized quality assurance across projects and programmes. To remedy this, we are prototyping a resource for the stable archiving and efficient discovery of BPs through a granular, semantically indexed, and consistently formatted web resource. While these technical advances have value, they cannot ensure improved oceanographic data quality without effective and inclusive peer review processes. Peer review of digitized best practices can take a number of forms from traditional (blind) peer review as practiced by journal publishers through to the evolving "open" approach where community reviews have both the authors and reviewers identified. This presentation will discuss the options for peer review mechanisms for best practices, including a hybrid approach where both expert panels and open community review are used to improve methodologies and thus downstream data quality. It is not yet clear if the ocean community prefers open versus blind reviews for best practices. It is also unclear the extent to which innovation versus solid technical base should have a higher priority in the reviews. Further, it is not clear whether the reviews should use an internal expert panel of the IODE OceanBestPractices Repository (http://www.oceanbestpractices.net/) or should be done as part of a journal publications process or both, as mentioned above. Thus, we will also describe our future approach to `field test' these review models on a multi-stakeholder compendium of digitized best practice documents.

Ethics of reviewing scientific publications.

PubMed

Napolitani, Federica; Petrini, Carlo; Garattini, Silvio

2017-05-01

The approval or rejection of scientific publications can have important consequences for scientific knowledge, so considerable responsibility lies on those who have to assess or review them. Today it seems that the peer review process, far from being considered an outdated system to be abandoned, is experiencing a new upturn. This article proposes criteria for the conduct of reviewers and of those who select them. While commenting on new emerging models, it provides practical recommendations for improving the peer-review system, like strengthening the role of guidelines and training and supporting reviewers. The process of peer review is changing, it is getting more open and collaborative, but those same ethical principles which guided it from its very origin should remain untouched and be firmly consolidated. The paper highlights how the ethics of reviewing scientific publications is needed now more than ever, in particular with regard to competence, conflict of interest, willingness to discuss decisions, complete transparency and integrity. Copyright © 2016 European Federation of Internal Medicine. Published by Elsevier B.V. All rights reserved.

What is the future of peer review? Why is there fraud in science? Is plagiarism out of control? Why do scientists do bad things? Is it all a case of:“All that is necessary for the triumph of evil is that good men do nothing?”

PubMed Central

Triggle, Chris R; Triggle, David J

2007-01-01

Peer review is an essential component of the process that is universally applied prior to the acceptance of a manuscript, grant or other scholarly work. Most of us willingly accept the responsibilities that come with being a reviewer but how comfortable are we with the process? Peer review is open to abuse but how should it be policed and can it be improved? A bad peer review process can inadvertently ruin an individual’s career, but are there penalties for policing a reviewer who deliberately sabotages a manuscript or grant? Science has received an increasingly tainted name because of recent high profile cases of alleged scientific misconduct. Once considered the results of work stress or a temporary mental health problem, scientific misconduct is increasingly being reported and proved to be a repeat offence. How should scientific misconduct be handled—is it a criminal offence and subject to national or international law? Similarly plagiarism is an ever-increasing concern whether at the level of the student or a university president. Are the existing laws tough enough? These issues, with appropriate examples, are dealt with in this review. PMID:17583174

The peer review process: a primer for JNIS readers.

PubMed

Hirsch, Joshua A; Manchikanti, Laxmaiah; Albuquerque, Felipe C; Leslie-Mazwi, Thabele M; Lev, Michael H; Linfante, Italo; Mocco, J; Rai, Ansaar T; Schaefer, Pamela W; Tarr, Robert W

2017-07-01

Peer review of scientific articles submitted for publication has been such an integral component of innovation in science and medicine that participants (be they readers, reviewers, or editors) seldom consider its complexity. Not surprisingly, much has been written about scientific peer review. The aim of this report is to share some of the elements of that discourse with readers of the Journal of NeuroInterventional Surgery ( JNIS ). Published by the BMJ Publishing Group Limited. For permission to use (where not already granted under a licence) please go to http://group.bmj.com/group/rights-licensing/permissions.

A scoping review of 10 years of published literature on community-based rehabilitation.

PubMed

Cleaver, Shaun; Nixon, Stephanie

2014-01-01

To identify the characteristics of peer-reviewed literature on community-based rehabilitation (CBR) in low- and middle-income countries published in English from 2003 to 2012. This scoping review involved a systematic search of electronic databases using specific keyword/subject heading combinations. Journal articles were included if they were published in English, used "CBR" as related to rehabilitation with persons with disabilities and not limited to high-income countries (HICs). Data were charted according to both pre-determined and emergent categories. A subset of articles was charted by two reviewers to ensure reliability of variables. A total of 114 articles were included. Fifty-two articles presented empirical research and 49 were published in one of two journals. The articles represented CBR activity in 26 specific countries, although only two of these were in Europe and only one was in the Americas. Authors were predominantly affiliated at universities and in HICs. This scoping review identified and characterized a large pool of literature on CBR, facilitating its incorporation into research and practice. Future research should examine the engagement of persons with disabilities in creating CBR literature, and analysis of literature in languages other than English. Implications for Rehabilitation Community-based rehabilitation (CBR) has been promoted as a rehabilitation strategy of choice in low- and middle-income countries (LMICs), but it has been critiqued for lack of an evidence base. A large number (114) of peer-reviewed articles were published on CBR between 2003 and 2012. Just under half of these articles (45%) presented empirical research, indicating that the evidence base for CBR is growing but will benefit from continued, rigorous inquiry. Furthermore, researchers from LMICs appear to be largely under-represented in published CBR research, flagging the need to support LMIC partners to share their CBR research in peer-reviewed journals.

Biofuels: Network Analysis of the Literature Reveals Key Environmental and Economic Unknowns

PubMed Central

2012-01-01

Despite rapid growth in biofuel production worldwide, it is uncertain whether decision-makers possess sufficient information to fully evaluate the impacts of the industry and avoid unintended consequences. Doing so requires rigorous peer-reviewed data and analyses across the entire range of direct and indirect effects. To assess the coverage of scientific research, we analyzed over 1600 peer-reviewed articles published between 2000 and 2009 that addressed 23 biofuels-related topics within four thematic areas: environment and human well-being, economics, technology, and geography. Greenhouse gases, fuel production, and feedstock production were well-represented in the literature, while trade, biodiversity, and human health were not. Gaps were especially striking across topics in the Southern Hemisphere, where the greatest potential socio-economic benefits, as well as environmental damages, may co-occur. There was strong asymmetry in the connectedness of research topics; greenhouse gases articles were twice as often connected to other topics as biodiversity articles. This could undermine the ability of scientific and economic analyses to adequately evaluate impacts and avoid significant unintended consequences. At the least, our review suggests caution in this developing industry and the need to pursue more interdisciplinary research to assess complex trade-offs and feedbacks inherent to an industry with wide-reaching potential impacts. PMID:22229835

School psychology recruitment research characteristics and implications for increasing racial and ethnic diversity.

PubMed

Proctor, Sherrie L; Romano, Maria

2016-09-01

Shortages of school psychologists and the underrepresentation of minorities in school psychology represent longstanding concerns. Scholars recommend that one way to address both issues is to recruit individuals from racially and ethnically diverse backgrounds into school psychology. The purpose of this study was to explore the characteristics and minority focused findings of school psychology recruitment studies conducted from 1994 to 2014. Using an electronic search that included specified databases, subject terms and study inclusion criteria along with a manual search of 10 school psychology focused journals, the review yielded 10 published, peer-reviewed recruitment studies focused primarily on school psychology over the 20-year span. Two researchers coded these 10 studies using a rigorous coding process that included a high level of inter rater reliability. Results suggest that the studies utilized varied methodologies, primarily sampled undergraduate populations, and mostly included White participants. Five studies focused on minority populations specifically. These studies indicate that programs should actively recruit minority undergraduates and offer financial support to attract minority candidates. Implications suggest a need for more recruitment research focused on minority populations and the implementation and evaluation of minority recruitment models. (PsycINFO Database Record (c) 2016 APA, all rights reserved).

Social media for lifelong learning.

PubMed

Kind, Terry; Evans, Yolanda

2015-04-01

Learning is ongoing, and can be considered a social activity. In this paper we aim to provide a review of the use of social media for lifelong learning. We start by defining lifelong learning, drawing upon principles of continuous professional development and adult learning theory. We searched Embase and MEDLINE from 2004-2014 for search terms relevant to social media and learning. We describe examples of lifelong learners using social media in medical education and healthcare that have been reported in the peer-reviewed literature. Medical or other health professions students may have qualities consistent with being a lifelong learner, yet once individuals move beyond structured learning environments they will need to recognize their own gaps in knowledge and skills over time and be motivated to fill them, thereby incorporating lifelong learning principles into their day-to-day practice. Engagement with social media can parallel engagement in the learning process over time, to the extent that online social networking fosters feedback and collaboration. The use of social media and online networking platforms are a key way to continuously learn in today's information sharing society. Additional research is needed, particularly rigorous studies that extend beyond learner satisfaction to knowledge, behaviour change, and outcomes.

A systematic review of the effectiveness and cost-effectiveness of peer education and peer support in prisons.

PubMed

Bagnall, Anne-Marie; South, Jane; Hulme, Claire; Woodall, James; Vinall-Collier, Karen; Raine, Gary; Kinsella, Karina; Dixey, Rachael; Harris, Linda; Wright, Nat M J

2015-03-25

Prisoners experience significantly worse health than the general population. This review examines the effectiveness and cost-effectiveness of peer interventions in prison settings. A mixed methods systematic review of effectiveness and cost-effectiveness studies, including qualitative and quantitative synthesis was conducted. In addition to grey literature identified and searches of websites, nineteen electronic databases were searched from 1985 to 2012. Study selection criteria were: Prisoners resident in adult prisons and children resident in Young Offender Institutions (YOIs). Peer-based interventions. Review questions 3 and 4 compared peer and professionally led approaches. Prisoner health or determinants of health; organisational/process outcomes; views of prison populations. Quantitative, qualitative and mixed method evaluations. Fifty-seven studies were included in the effectiveness review and one study in the cost-effectiveness review; most were of poor methodological quality. Evidence suggested that peer education interventions are effective at reducing risky behaviours, and that peer support services are acceptable within the prison environment and have a positive effect on recipients, practically or emotionally. Consistent evidence from many, predominantly qualitative, studies, suggested that being a peer deliverer was associated with positive effects. There was little evidence on cost-effectiveness of peer-based interventions. There is consistent evidence from a large number of studies that being a peer worker is associated with positive health; peer support services are also an acceptable source of help within the prison environment and can have a positive effect on recipients. Research into cost-effectiveness is sparse. PROSPERO ref: CRD42012002349.

Case Study of 'Engineering Peer Meetings' in JPL's ST-6 Project

NASA Technical Reports Server (NTRS)

Chao, Lawrence P.; Tumer, Irem

2004-01-01

This design process error-proofing case study describes a design review practice implemented by a project manager at NASA Jet Propulsion Laboratory. There are many types of reviews at NASA: required and not, formalized and informal, programmatic and technical. Standing project formal reviews such as the Preliminary Design Review (PDR) and Critical Design Review (CDR) are a required part of every project and mission development. However, the engineering peer reviews that support teams technical work on such projects are often informal, ad hoc, and inconsistent across the organization. This case study discusses issues and innovations identified by a project manager at JPL and implemented in 'engineering peer meetings' for his group.

Case Study of "Engineering Peer Meetings" in JPL's ST-6 Project

NASA Technical Reports Server (NTRS)

Tumer, Irem Y.; Chao, Lawrence P.

2003-01-01

This design process error-proofing case study describes a design review practice implemented by a project manager at NASA Jet Propulsion Laboratory. There are many types of reviews at NASA: required and not, formalized and informal, programmatic and technical. Standing project formal reviews such as the Preliminary Design Review (PDR) and Critical Design Review (CDR) are a required part of every project and mission development. However, the engineering peer reviews that support teams technical work on such projects are often informal, ad hoc, and inconsistent across the organization. This case study discusses issues and innovations identified by a project manager at JPL and implemented in "engineering peer meetings" for his group.

The learner as co-creator: A new peer review and self-assessment feedback form created by student nurses.

PubMed

Duers, Lorraine E

2017-11-01

Engagement with peer review and self-assessment is not always regarded by student nurses as an activity that results in a positive learning experience. Literature indicates that withdrawal from the learning process becomes attractive to individuals affected by a negative experience of peer review. Literature also provides examples of student nurses' feeling 'torn to shreds' during the process of peer review, resulting in loss of confidence and self-esteem. An influencing factor in such situations appears to be the absence of specific learner-driven criteria against which student nurses can assess peer and self-performance. The idea was thus ignited, that creation and utilisation of a learner-driven feedback form might potentially prevent, or at least minimise, the possibility of negative peer review experience. Set within the context of a pre-registration nursing programme, within a Higher Education institution, student nurses (n=25), created a peer review/self-assessment feedback form. Its potential cross-discipline, global applicability is reasonably speculated. Purposive sampling, followed by Stratified Random sampling, maximised participant variation. Data collection took place on 34 occasions, utilising focus group discussions using Nominal Group Technique, a practical task which was video recorded for mediating artefact purposes, and individual interviews. Analysis was concept and theme driven. The study found that participants desired a new feedback form that specifically asks the evaluator to judge human qualities, such as 'compassion' and 'kindness', in addition to the skills and knowledge criteria that any peer review or self-assessment form used currently had incorporated. Providing the participants with the opportunity to develop criteria, against which performance could be measured, with emphasis being afforded to student inclusivity and resultant shift in power balance from the educator to the learner, embraces the idea of teaching and learning in the 21st Century. Crown Copyright © 2017. Published by Elsevier Ltd. All rights reserved.

Quality assurance in radiology: peer review and peer feedback.

PubMed

Strickland, N H

2015-11-01

Peer review in radiology means an assessment of the accuracy of a report issued by another radiologist. Inevitably, this involves a judgement opinion from the reviewing radiologist. Peer feedback is the means by which any form of peer review is communicated back to the original author of the report. This article defines terms, discusses the current status, identifies problems, and provides some recommendations as to the way forward, concentrating upon the software requirements for efficient peer review and peer feedback of reported imaging studies. Radiologists undertake routine peer review in their everyday clinical practice, particularly when reporting and preparing for multidisciplinary team meetings. More formal peer review of reported imaging studies has been advocated as a quality assurance measure to promote good clinical practice. It is also a way of assessing the competency of reporting radiologists referred for investigation to bodies such as the General Medical Council (GMC). The literature shows, firstly, that there is a very wide reported range of discrepancy rates in many studies, which have used a variety of non-comparable methodologies; and secondly, that applying scoring systems in formal peer review is often meaningless, unhelpful, and can even be detrimental. There is currently a lack of electronic peer feedback system software on the market to inform radiologists of any review of their work that has occurred or to provide them with clinical outcome information on cases they have previously reported. Learning opportunities are therefore missed. Radiologists should actively engage with the medical informatics industry to design optimal peer review and feedback software with features to meet their needs. Such a system should be easy to use, be fully integrated with the radiological information and picture archiving systems used clinically, and contain a free-text comment box, without a numerical scoring system. It should form a temporary record that cannot be permanently archived. It must provide automated feedback to the original author. Peer feedback, as part of everyday reporting, should enhance daily learning for radiologists. Software requirements for everyday peer feedback differ from those needed for a formal peer review process, which might only be necessary in the setting of a formal GMC enquiry into a particular radiologist's reporting competence, for example. Copyright © 2015 The Royal College of Radiologists. Published by Elsevier Ltd. All rights reserved.

Thank you to Virology Journal’s peer reviewers in 2012

PubMed Central

2013-01-01

Contributing reviewers The editors of Virology Journal would like to thank all our reviewers who have contributed to the journal in Volume 9 (2012). The success of any scientific journal depends on an effective and strict peer review process and Virology Journal could not operate without your contribution. We look forward to your continuous support to this journal either as an invited reviewer or a contributing author in the years to come.

Data bank has operational impact. Proper peer review can protect hospitals from antitrust and defamation suits.

PubMed

Purtell, D L

1990-11-01

The Health Care Quality Improvement Act of 1986 can help protect medical professionals and healthcare facilities from antitrust and defamation claims and other forms of litigation arising from the peer review process. Some hospitals may need to make major changes in their peer review activity as a result of the act. The healthcare entity, not the physicians involved in peer review, has the burden of complying with the provisions of the act. Failure to comply with the act can lead to loss of immunity from damages, fines, and potential exclusion from the Medicare program. The potential for liability has sparked a need for hospitals to reexamine and possibly reorganize medical staff and update procedures and related governing documents. Healthcare entities may consider changes such as implementing a director of medical affairs function, choosing medical staff for multiple-year terms, and centralizing physician review files. In the 1980s many hospitals created quality assurance and risk management programs. Risk managers need to share data with quality assurance personnel, who must in turn share the information with medical staff involved with credentialing, peer review, and medical affairs management. Legal counsel will need to be familiar with the legalities of the act, as well as the hospital's peer review procedures and operations. General legal counsel should oversee coordination of hospital proceedings and assist in educating staff on the legalities of peer review.

Quantifying Peer Interactions for Research and Clinical Use: The Manchester Inventory for Playground Observation

ERIC Educational Resources Information Center

Gibson, Jenny; Hussain, Jamilla; Holsgrove, Samina; Adams, Catherine; Green, Jonathan

2011-01-01

Direct observation of peer relating is potentially a sensitive and ecologically valid measure of child social functioning, but there has been a lack of standardised methods. The Manchester Inventory for Playground Observation (MIPO) was developed as a practical yet rigorous assessment of this kind for 5-11 year olds. We report on the initial…

Primary prevention research: a preliminary review of program outcome studies.

PubMed

Schaps, E; Churgin, S; Palley, C S; Takata, B; Cohen, A Y

1980-07-01

This article reviews 35 drug abuse prevention program evaluations employing drug-specific outcome measures. Many of these evaluations assessed the effects of "new generation" prevention strategies: affective, peer-oriented, and multidimensional approaches. Only 14 studies evaluated purely informational programs. Evaluations were analyzed to ascertain (1) characteristics of the programs under study, (2) characteristics of the research designs, and (3) patterns among findings. This review provides some evidence that the newer prevention strategies may produce more positive and fewer negative outcomes than did older drug information approaches. Over 70% of the programs using the newer strategies produced some positive effects; only 29% showed negative effects. In contrast, 46% of informational programs showed positive effects; 46% showed negative effects. These findings must be approached with great caution, since the research was frequently scientifically inadequate, and since rigor of research was negatively correlated with intensity and duration of program services.

Animal-Assisted Intervention for trauma: a systematic literature review.

PubMed

O'Haire, Marguerite E; Guérin, Noémie A; Kirkham, Alison C

2015-01-01

Animals have a long history of inclusion in psychiatric treatment. There has been a recent growth in the empirical study of this practice, known as Animal-Assisted Intervention (AAI). We conducted a systematic review of the empirical literature on AAI for trauma, including posttraumatic stress disorder (PTSD). Ten studies qualified for inclusion, including six peer-reviewed journal articles and four unpublished theses. Participants were predominantly survivors of child abuse, in addition to military veterans. The presentation of AAI was highly variable across the studies. The most common animal species were dogs and horses. The most prevalent outcomes were reduced depression, PTSD symptoms, and anxiety. There was a low level of methodological rigor in most studies, indicating the preliminary nature of this area of investigation. We conclude that AAI may provide promise as a complementary treatment option for trauma, but that further research is essential to establish feasibility, efficacy, and manualizable protocols.

Animal-Assisted Intervention for trauma: a systematic literature review

PubMed Central

O'Haire, Marguerite E.; Guérin, Noémie A.; Kirkham, Alison C.

2015-01-01

Animals have a long history of inclusion in psychiatric treatment. There has been a recent growth in the empirical study of this practice, known as Animal-Assisted Intervention (AAI). We conducted a systematic review of the empirical literature on AAI for trauma, including posttraumatic stress disorder (PTSD). Ten studies qualified for inclusion, including six peer-reviewed journal articles and four unpublished theses. Participants were predominantly survivors of child abuse, in addition to military veterans. The presentation of AAI was highly variable across the studies. The most common animal species were dogs and horses. The most prevalent outcomes were reduced depression, PTSD symptoms, and anxiety. There was a low level of methodological rigor in most studies, indicating the preliminary nature of this area of investigation. We conclude that AAI may provide promise as a complementary treatment option for trauma, but that further research is essential to establish feasibility, efficacy, and manualizable protocols. PMID:26300817

Peer Reviewing of OER in a Contested Domain--An Activity Theoretical Analysis

ERIC Educational Resources Information Center

Algers, Anne; Ljung, Magnus

2015-01-01

Globally, we experience numerous initiatives to increase the adoption of open educational resources (OER), but quality concerns challenge the adoption. In this study we present an analysis of the peer review process of an OER. The OER under review is produced by the European Commission (EU). It has the goal to teach children about farm animal…

Peer Reviewers' Dilemmas: Values Antinomies when Evaluating Higher Education Institutions

ERIC Educational Resources Information Center

Patry, Jean-Luc; Gastager, Angela

2012-01-01

Whenever evaluations are done, there are antinomies of interests both within and between stakeholders. To account for such antinomies, taxonomy has been developed which will be presented and discussed using the peer review processes in university evaluations as example. The taxonomy contains four dimensions: a) seven values domains are…

45 CFR 60.3 - Definitions.

Code of Federal Regulations, 2013 CFR

2013-10-01

... of a patient(s) or quality of health care services; (2) Any recommendation by a peer review... with the primary purpose of evaluating the quality of patient care practices or services ordered or... through a formal peer review process for the purpose of furthering quality health care, or a committee of...

Interrater Reliability to Assure Valid Content in Peer Review of CME-Accredited Presentations

ERIC Educational Resources Information Center

Quigg, Mark; Lado, Fred A.

2009-01-01

Introduction: The Accreditation Council for Continuing Medical Education (ACCME) provides guidelines for continuing medical education (CME) materials to mitigate problems in the independence or validity of content in certified activities; however, the process of peer review of materials appears largely unstudied and the reproducibility of…

The science behind pre-Columbian evidence of syphilis in Europe: research by documentary.

PubMed

Armelagos, George J; Zuckerman, Molly K; Harper, Kristin N

2012-03-01

This article discusses the presentation of scientific findings by documentary, without the process of peer review. We use, as an example, PBS's "The Syphilis Enigma," in which researchers presented novel evidence concerning the origin of syphilis that had never been reviewed by other scientists. These "findings" then entered the world of peer-reviewed literature through citations of the documentary itself or material associated with it. Here, we demonstrate that the case for pre-Columbian syphilis in Europe that was made in the documentary does not withstand scientific scrutiny. We also situate this example from paleopathology within a larger trend of "science by documentary" or "science by press conference," in which researchers seek to bypass the peer review process by presenting unvetted findings directly to the public. Copyright © 2011 Wiley Periodicals, Inc.

The Science behind Pre-Columbian Evidence of Syphilis in Europe: Research by Documentary

PubMed Central

Armelagos, George J.; Zuckerman, Molly K.; Harper, Kristin N.

2012-01-01

This article discusses the presentation of scientific finding via documentary and absent the process of peer-review. We use, as an example, PBS’s Syphilis Enigma, in which researchers presented novel evidence concerning the origin of syphilis that had never been reviewed by other scientists. These “findings” then entered the world of peer-reviewed literature through citations of the documentary itself or material associated with the documentary. Here, we demonstrate that the case for pre-Columbian syphilis in Europe that was made in the documentary does not withstand scientific scrutiny. We also situate this example from paleopathology within a larger trend of “science by documentary” or “science by press conference,” in which researchers seek to bypass the peer review process by presenting unvetted findings directly to the public. PMID:22499439

Teleconference versus face-to-face scientific peer review of grant application: effects on review outcomes.

PubMed

Gallo, Stephen A; Carpenter, Afton S; Glisson, Scott R

2013-01-01

Teleconferencing as a setting for scientific peer review is an attractive option for funding agencies, given the substantial environmental and cost savings. Despite this, there is a paucity of published data validating teleconference-based peer review compared to the face-to-face process. Our aim was to conduct a retrospective analysis of scientific peer review data to investigate whether review setting has an effect on review process and outcome measures. We analyzed reviewer scoring data from a research program that had recently modified the review setting from face-to-face to a teleconference format with minimal changes to the overall review procedures. This analysis included approximately 1600 applications over a 4-year period: two years of face-to-face panel meetings compared to two years of teleconference meetings. The average overall scientific merit scores, score distribution, standard deviations and reviewer inter-rater reliability statistics were measured, as well as reviewer demographics and length of time discussing applications. The data indicate that few differences are evident between face-to-face and teleconference settings with regard to average overall scientific merit score, scoring distribution, standard deviation, reviewer demographics or inter-rater reliability. However, some difference was found in the discussion time. These findings suggest that most review outcome measures are unaffected by review setting, which would support the trend of using teleconference reviews rather than face-to-face meetings. However, further studies are needed to assess any correlations among discussion time, application funding and the productivity of funded research projects.

An Online Peer Assisted Learning Community Model and its Application in ZJNU

ERIC Educational Resources Information Center

Gaofeng, Ruan; Yeyu, Lin

2007-01-01

Peer coaching, or peer assisting, was established in 1970s by Joyce and Showers. Initially used in teachers' professional development, it refers to a process that two or more teacher peers evaluate current practice mutually; expand skills, extract and build new skills; share ideas, and review & solve problems of classroom teaching in a way of…

IRIS Toxicological Review of Trichloroacetic Acid (TCA) ...

EPA Pesticide Factsheets

On September 24, 2009, the Toxicological Review of Trichloroacetic Acid (TCA) and the charge to external peer reviewers were released for external peer review and public comment. The Toxicological Review and charge were reviewed internally by EPA and by other federal agencies and White House Offices before public release. In the new IRIS process, introduced by the EPA Administrator, all written comments on IRIS assessments submitted by other federal agencies and White House Offices will be made publicly available. Accordingly, interagency comments and the interagency science consultation draft of the IRIS Toxicological Review of Trichloroacetic Acid and the charge to external peer reviewers are posted on this site. The draft Toxicological Review of Trichloroacetic Acid provides scientific support and rationale for the hazard identification and dose-response assessment pertaining to chronic exposure to trichloroacetic acid.

IRIS Toxicological Review of Formaldehyde (Interagency ...

EPA Pesticide Factsheets

On June 2, 2010, the Toxicological Review of Formaldehyde and the charge to external peer reviewers were released for external peer review and public comment. The Toxicological Review and charge were reviewed internally by EPA and by other federal agencies and White House Offices before public release. In the new IRIS process, introduced by the EPA Administrator, all written comments on IRIS assessments submitted by other federal agencies and White House Offices will be made publicly available. Accordingly, interagency comments and the interagency science consultation draft of the IRIS Toxicological Review of Formaldehyde and the charge to external peer reviewers are posted on this site. The draft Toxicological Review of Formaldehyde-Inhalation Assessment provides scientific support and rationale for the hazard and dose-response assessment pertaining to chronic inhalation exposure to formaldehyde.

IRIS Toxicological Review of Urea (Interagency Science ...

EPA Pesticide Factsheets

On September 28, 2010, the Toxicological Review of Urea and the charge to external peer reviewers were released for external peer review and public comment. The Toxicological Review and charge were reviewed internally by EPA and by other federal agencies and White House Offices before public release. In the new IRIS process, introduced by the EPA Administrator, all written comments on IRIS assessments submitted by other federal agencies and White House Offices will be made publicly available. Accordingly, interagency comments and the interagency science consultation draft of the IRIS Toxicological Review of Urea and the charge to external peer reviewers are posted on this site. The draft Toxicological Review of Urea provides scientific support and rationale for the hazard and dose-response assessment pertaining to chronic exposure to Urea.

Transformation of Adolescent Peer Relations in the Social Media Context: Part 2-Application to Peer Group Processes and Future Directions for Research.

PubMed

Nesi, Jacqueline; Choukas-Bradley, Sophia; Prinstein, Mitchell J

2018-04-07

As social media use becomes increasingly widespread among adolescents, research in this area has accumulated rapidly. Researchers have shown a growing interest in the impact of social media on adolescents' peer experiences, including the ways that the social media context shapes a variety of peer relations constructs. This paper represents Part 2 of a two-part theoretical review. In this review, we offer a new model for understanding the transformative role of social media in adolescents' peer experiences, with the goal of stimulating future empirical work that is grounded in theory. The transformation framework suggests that the features of the social media context transform adolescents' peer experiences by changing their frequency or immediacy, amplifying demands, altering their qualitative nature, and/or offering new opportunities for compensatory or novel behaviors. In the current paper, we consider the ways that social media may transform peer relations constructs that often occur at the group level. Our review focuses on three key constructs: peer victimization, peer status, and peer influence. We selectively review and highlight existing evidence for the transformation of these domains through social media. In addition, we discuss methodological considerations and key conceptual principles for future work. The current framework offers a new theoretical perspective through which peer relations researchers may consider adolescent social media use.

How to Write a Scholarly Book Review for Publication in a Peer-Reviewed Journal

PubMed Central

Lee, Alexander D.; Green, Bart N.; Johnson, Claire D.; Nyquist, Julie

2010-01-01

Purpose: To describe and discuss the processes used to write scholarly book reviews for publication in peer-reviewed journals and to provide a recommended strategy and book appraisal worksheet to use when conducting book reviews. Methods: A literature search of MEDLINE, EMBASE, CINAHL, and the Index to Chiropractic Literature was conducted in June 2009 using a combination of controlled vocabulary and truncated text words to capture articles relevant to writing scholarly book reviews for publication in peer-reviewed journals. Results: The initial search identified 839 citations. Following the removal of duplicates and the application of selection criteria, a total of 78 articles were included in this review including narrative commentaries (n = 26), editorials or journal announcements (n = 25), original research (n = 18), and journal correspondence pieces (n = 9). Discussion: Recommendations for planning and writing an objective and quality book review are presented based on the evidence gleaned from the articles reviewed and from the authors' experiences. A worksheet for conducting a book review is provided. Conclusions: The scholarly book review serves many purposes and has the potential to be an influential literary form. The process of publishing a successful scholarly book review requires the reviewer to appreciate the book review publication process and to be aware of the skills and strategies involved in writing a successful review. PMID:20480015

Editors’ Perspectives on Enhancing Manuscript Quality and Editorial Decisions Through Peer Review and Reviewer Development

PubMed Central

Janke, Kristin K.; Traynor, Andrew P.

2017-01-01

Objectives. To identify peer reviewer and peer review characteristics that enhance manuscript quality and editorial decisions, and to identify valuable elements of peer reviewer training programs. Methods. A three-school, 15-year review of pharmacy practice and pharmacy administration faculty’s publications was conducted to identify high-publication volume journals for inclusion. Editors-in-chief identified all editors managing manuscripts for participation. A three-round modified Delphi process was used. Rounds advanced from open-ended questions regarding actions and attributes of good reviewers to consensus-seeking and clarifying questions related to quality, importance, value, and priority. Results. Nineteen editors representing eight pharmacy journals participated. Three characteristics of reviews were rated required or helpful in enhancing manuscript quality by all respondents: includes a critical analysis of the manuscript (88% required, 12% helpful), includes feedback that contains both strengths and areas of improvement (53% required, 47% helpful), and speaks to the manuscript’s utility in the literature (41% required, 59% helpful). Hands-on experience with review activities (88%) and exposure to good and bad reviews (88%) were identified as very valuable to peer reviewer development. Conclusion. Reviewers, individuals involved in faculty development, and journals should work to assist new reviewers in defining focused areas of expertise, building knowledge in these areas, and developing critical analysis skills. PMID:28630514

Social Information-Processing Patterns of Maltreated Children in Two Social Domains

ERIC Educational Resources Information Center

Keil, Vivien; Price, Joseph M.

2009-01-01

This study examined relations among social information-processing (SIP) variables in the domains of peer provocation and peer group entry. Using Crick and Dodge's [Crick, N. R., & Dodge, K. A. (1994). "A review and reformulation of social information-processing mechanisms in children's social adjustment." "Psychological Bulletin," 115, 74-101]…

34 CFR 356.21 - What is the fellowship review process?

Code of Federal Regulations, 2010 CFR

2010-07-01

... fellowship review process? The Secretary reviews applications for Fellowships in accordance with the peer review requirements governing grants in 34 CFR 350.31 and 350.32 and the selection criteria contained in... 34 Education 2 2010-07-01 2010-07-01 false What is the fellowship review process? 356.21 Section...

Mobile health use in low- and high-income countries: an overview of the peer-reviewed literature

PubMed Central

Bastawrous, Andrew; Armstrong, Matthew J

2013-01-01

The evolution of mobile phone technology has introduced new possibilities to the field of medicine. Combining technological advances with medical expertise has led to the use of mobile phones in all healthcare areas including diagnostics, telemedicine, research, reference libraries and interventions. This article provides an overview of the peer-reviewed literature, published between 1 August 2006 and 1 August 2011, for the application of mobile/cell phones (from basic text-messaging systems to smartphones) in healthcare in both resource-poor and high-income countries. Smartphone use is paving the way in high-income countries, while basic text-messaging systems of standard mobile phones are proving to be of value in low- and middle-income countries. Ranging from infection outbreak reporting, anti-HIV therapy adherence to gait analysis, resuscitation training and radiological imaging, the current uses and future possibilities of mobile phone technology in healthcare are endless. Multiple mobile phone based applications are available for healthcare workers and healthcare consumers; however, the absolute majority lack an evidence base. Therefore, more rigorous research is required to ensure that healthcare is not flooded with non-evidence based applications and is maximized for patient benefit. PMID:23564897

Successful peer review of courses: a case study.

PubMed

Horowitz, S; Van Eyck, S; Albanese, M

1998-03-01

The authors describe their school's system of peer review for courses, established in 1988 to facilitate faculty evaluation and continual course and curriculum improvement. (The system has been temporarily suspended while the school's new curriculum becomes established.) They explain how the system was created and then report how faculty reviews of courses over the five-year operation of the system compared with students' reviews of the same courses. The faculty and students' ratings were in agreement 75% of the time. When not in agreement, the students' ratings tended to upgrade courses that were not very demanding, had easy grading, and emphasized clinical details, often at the expense of basic concepts and the big picture. The authors then document how the work of the peer review system favorably influenced the transformation of the school's curriculum. They also provide guidelines for the creation and operation of a course review process that uses faculty peers. The authors maintain that the peer review system worked because it was run by a committee of experienced and respected teachers who had been selected by their peers, the other faculty. Additional reasons for its success were that the school's faculty supported and respected the committee and its work, that course directors helped evaluate their courses, and that peer reviewers took their work seriously despite having no remuneration, and the clearly positive impact of the review system on faculty interaction, faculty-student interaction, and the reform of the curriculum.

Enhancing the role of case-oriented peer review to improve quality and safety in radiation oncology: Executive summary

PubMed Central

Marks, Lawrence B.; Adams, Robert D.; Pawlicki, Todd; Blumberg, Albert L.; Hoopes, David; Brundage, Michael D.; Fraass, Benedick A.

2013-01-01

This report is part of a series of white papers commissioned for the American Society for Radiation Oncology (ASTRO) Board of Directors as part of ASTRO's Target Safely Campaign, focusing on the role of peer review as an important component of a broad safety/quality assurance (QA) program. Peer review is one of the most effective means for assuring the quality of qualitative, and potentially controversial, patient-specific decisions in radiation oncology. This report summarizes many of the areas throughout radiation therapy that may benefit from the application of peer review. Each radiation oncology facility should evaluate the issues raised and develop improved ways to apply the concept of peer review to its individual process and workflow. This might consist of a daily multidisciplinary (eg, physicians, dosimetrists, physicists, therapists) meeting to review patients being considered for, or undergoing planning for, radiation therapy (eg, intention to treat and target delineation), as well as meetings to review patients already under treatment (eg, adequacy of image guidance). This report is intended to clarify and broaden the understanding of radiation oncology professionals regarding the meaning, roles, benefits, and targets for peer review as a routine quality assurance tool. It is hoped that this work will be a catalyst for further investigation, development, and study of the efficacy of peer review techniques and how these efforts can help improve the safety and quality of our treatments. PMID:24175002

Public Policies and Interventions for Diabetes in Latin America: a Scoping Review.

PubMed

Kaselitz, Elizabeth; Rana, Gurpreet K; Heisler, Michele

2017-08-01

Successful interventions are needed to diagnose and manage type 2 diabetes (T2DM) in Latin America, a region that is experiencing a significant rise in rates of T2DM. Complementing an earlier review exploring diabetes prevention efforts in Latin America, this scoping review examines the literature on (1) policies and governmental programs intended to improve diabetes diagnosis and treatment in Latin America and (2) interventions to improve diabetes management in Latin America. It concludes with a brief discussion of promising directions for future research. Governmental policies and programs for the diagnosis and treatment of diabetes in different Latin American countries have been implemented, but their efficacy to date has not been rigorously evaluated. There are some promising intervention approaches in Latin America to manage diabetes that have been evaluated. Some of these utilize multidisciplinary teams, a relatively resource-intensive approach difficult to replicate in low-resource settings. Other evaluated interventions in Latin America have successfully leveraged mobile health tools, trained peer volunteers, and community health workers (CHWs) to improve diabetes management and outcomes. There are some promising approaches and large-scale governmental efforts underway to curb the growing burden of type 2 diabetes in Latin America. While some of these interventions have been rigorously evaluated, further research is warranted to determine their effectiveness, cost, and scalability in this region.

The impact of peer review on paediatric forensic reports.

PubMed

Kariyawasam, Uditha

2016-10-01

To retrospectively evaluate the common grammar and spelling errors of the medico-legal reports written by the doctors at the Victorian Forensic Paediatric Medical Service (VFPMS) in both Royal Children's Hospital (RCH) and Monash Medical Centre. The reports were evaluated at two points in time; before and after peer review. The aim of the study was to ascertain whether peer review improved the grammar and spelling in VFPMS medico-legal reports. Draft VFPMS reports are sent to the VFPMS medical director for peer review. The current study sampled 50 reports that were sent consecutively to Dr. Anne Smith from 1st of May 2015. The 50 corresponding final reports were then retrieved from the VFPMS database. The 50 pairs of draft and final reports were scored using a 50-point scoring system. The scores of the draft reports were compared to the scores of the final report to assess if there was a change in quality as measured using an explicit criteria audit of report structure, simple grammar, jargon use and spelling. The audit did not include evaluation of the validity of forensic opinions. The overall scores were statistically analysed using descriptive statistics and a paired T-test. The scores of the reports improved by 2.24% when the final reports were compared to the draft reports (p < 0.001). The peer-review process resulted in a significantly higher quality of medico-legal reports. The report writing and peer-review process could be assisted by an abbreviated version of the checklist used for the audit. Crown Copyright © 2016. Published by Elsevier Ltd. All rights reserved.

Peer engagement in harm reduction strategies and services: a critical case study and evaluation framework from British Columbia, Canada.

PubMed

Greer, Alissa M; Luchenski, Serena A; Amlani, Ashraf A; Lacroix, Katie; Burmeister, Charlene; Buxton, Jane A

2016-05-27

Engaging people with drug use experience, or 'peers,' in decision-making helps to ensure harm reduction services reflect current need. There is little published on the implementation, evaluation, and effectiveness of meaningful peer engagement. This paper aims to describe and evaluate peer engagement in British Columbia from 2010-2014. A process evaluation framework specific to peer engagement was developed and used to assess progress made, lessons learned, and future opportunities under four domains: supportive environment, equitable participation, capacity building and empowerment, and improved programming and policy. The evaluation was conducted by reviewing primary and secondary qualitative data including focus groups, formal documents, and meeting minutes. Peer engagement was an iterative process that increased and improved over time as a consequence of reflexive learning. Practical ways to develop trust, redress power imbalances, and improve relationships were crosscutting themes. Lack of support, coordination, and building on existing capacity were factors that could undermine peer engagement. Peers involved across the province reviewed and provided feedback on these results. Recommendations from this evaluation can be applied to other peer engagement initiatives in decision-making settings to improve relationships between peers and professionals and to ensure programs and policies are relevant and equitable.

Evaluating Training Programs for Primary Care Providers in Child/Adolescent Mental Health in Canada: A Systematic Review

PubMed Central

Espinet, Stacey; Naqvi, Reza; Lingard, Lorelei; Steele, Margaret

2018-01-01

Introduction The need for child/adolescent mental health care in Canada is growing. Primary care can play a key role in filling this gap, yet most providers feel they do not have adequate training. This paper reviews the Canadian literature on capacity building programs in child and adolescent psychiatry for primary care providers, to examine how these programs are being implemented and evaluated to contribute to evidence-based initiatives. Methods A systematic literature review of peer-reviewed published articles of capacity building initiatives in child/adolescent mental health care for primary care practitioners that have been implemented in Canada. Results Sixteen articles were identified that met inclusion criteria. Analysis revealed that capacity building initiatives in Canada are varied but rigorous evaluation methodology is lacking. Primary care providers welcome efforts to increase mental health care capacity and were satisfied with the implementation of most programs. Discussion Objective conclusions regarding the effectiveness of these programs to increase mental health care capacity is challenging given the evaluation methodology of these studies. Conclusion Rigorous evaluation methods are needed to make evidence-based decisions on ways forward to be able to build child/adolescent mental health care capacity in primary care. Outcome measures need to move beyond self-report to more objective measures, and should expand the measurement of patient outcomes to ensure that these initiative are indeed leading to improved care for families. PMID:29662521

Critical review of complementary and alternative medicine use in menopause: focus on prevalence, motivation, decision-making, and communication.

PubMed

Peng, Wenbo; Adams, Jon; Sibbritt, David W; Frawley, Jane E

2014-05-01

This study aims to undertake the first critical review of complementary and alternative medicine (CAM) use among menopausal women (a term here used to include premenopausal, perimenopausal and postmenopausal women) by focusing on the prevalence of CAM use and CAM users' characteristics, motivation, decision-making, and communication with healthcare providers. A comprehensive search of 2002-2012 international literature in the Medline, CINAHL, AMED, and SCOPUS databases was conducted. The search was confined to peer-reviewed articles published in English with abstracts and reporting new empirical research findings regarding CAM use and menopause. A considerable level of CAM use was observed among women in menopause. Many menopausal women use CAM concurrently with their conventional medicine. However, communication regarding CAM between menopausal women and healthcare providers seems less than optimal, with a demand for further information on the safety and efficacy of medicines. Existing literature is of variable methodological rigor, often presenting small sample sizes and low-quality data collection. Further rigorous research on this topic-including quantitative and qualitative methods using large national samples, where relevant-is required. The findings of this critical review provide insights for those practicing and managing health care in this area of women's health. Healthcare providers should prepare to inform menopausal women about all treatment options, including CAM, and should be aware of the possible adverse effects of CAM and potential interactions between CAM and conventional medicine among women in menopause who are under their care.

Assessing Fidelity of Implementation (FOI) for School-Based Mindfulness and Yoga Interventions: A Systematic Review

PubMed Central

Gould, Laura Feagans; Dariotis, Jacinda K.; Greenberg, Mark T.; Mendelson, Tamar

2015-01-01

As school-based mindfulness and yoga programs gain popularity, the systematic study of fidelity of program implementation (FOI) is critical to provide a more robust understanding of the core components of mindfulness and yoga interventions, their potential to improve specified teacher and student outcomes, and our ability to implement these programs consistently and effectively. This paper reviews the current state of the science with respect to inclusion and reporting of FOI in peer-reviewed studies examining the effects of school-based mindfulness and/or yoga programs targeting students and/or teachers implemented in grades kindergarten through twelve (K-12) in North America. Electronic searches in PsychInfo and Web of Science from their inception through May 2014, in addition to hand searches of relevant review articles, identified 312 publications, 48 of which met inclusion criteria. Findings indicated a relative paucity of rigorous FOI. Fewer than 10% of studies outlined potential core program components or referenced a formal theory of action, and fewer than 20% assessed any aspect of FOI beyond participant dosage. The emerging nature of the evidence base provides a critical window of opportunity to grapple with key issues relevant to FOI of mindfulness-based and yoga programs, including identifying essential elements of these programs that should be faithfully implemented and how we might develop rigorous measures to accurately capture them. Consideration of these questions and suggested next steps are intended to help advance the emerging field of school-based mindfulness and yoga interventions. PMID:27158278

Financial impact of population health management programs: reevaluating the literature.

PubMed

Grossmeier, Jessica; Terry, Paul E; Anderson, David R; Wright, Steven

2012-06-01

Although many employers offer some components of worksite-based population health management (PHM), most do not yet invest in comprehensive programs. This hesitation to invest in comprehensive programs may be attributed to numerous factors, such as other more pressing business priorities, reluctance to intervene in the personal health choices of employees, or insufficient funds for employee health. Many decision makers also remain skeptical about whether investment in comprehensive programs will produce a financial return on investment (ROI). Most peer-reviewed studies assessing the financial impact of PHM were published before 2000 and include a broad array of program and study designs. Many of these studies have also included indirect productivity savings in their assessment of financial outcomes. In contrast, this review includes only peer-reviewed studies of the direct health care cost impact of comprehensive PHM programs that meet rigorous methodological criteria. A systematic search of health sciences databases identified only 5 studies with program designs and study methods meeting these selection criteria published after 2007. This focused review found that comprehensive PHM programs can yield a positive ROI based on their impact on direct health care costs, but the level of ROI achieved was lower than that reported by literature reviews with less focused and restrictive qualifying criteria. To yield substantial short-term health care cost savings, the longer term financial return that can credibly be associated with a comprehensive, prevention-oriented population health program must be augmented by other financial impact strategies.

Rigorous Screening Technology for Identifying Suitable CO2 Storage Sites II

DOE Office of Scientific and Technical Information (OSTI.GOV)

George J. Koperna Jr.; Vello A. Kuuskraa; David E. Riestenberg

2009-06-01

This report serves as the final technical report and users manual for the 'Rigorous Screening Technology for Identifying Suitable CO2 Storage Sites II SBIR project. Advanced Resources International has developed a screening tool by which users can technically screen, assess the storage capacity and quantify the costs of CO2 storage in four types of CO2 storage reservoirs. These include CO2-enhanced oil recovery reservoirs, depleted oil and gas fields (non-enhanced oil recovery candidates), deep coal seems that are amenable to CO2-enhanced methane recovery, and saline reservoirs. The screening function assessed whether the reservoir could likely serve as a safe, long-term CO2more » storage reservoir. The storage capacity assessment uses rigorous reservoir simulation models to determine the timing, ultimate storage capacity, and potential for enhanced hydrocarbon recovery. Finally, the economic assessment function determines both the field-level and pipeline (transportation) costs for CO2 sequestration in a given reservoir. The screening tool has been peer reviewed at an Electrical Power Research Institute (EPRI) technical meeting in March 2009. A number of useful observations and recommendations emerged from the Workshop on the costs of CO2 transport and storage that could be readily incorporated into a commercial version of the Screening Tool in a Phase III SBIR.« less

Genetic and environmental effects on the muscle structure response post-mortem.

PubMed

Thompson, J M; Perry, D; Daly, B; Gardner, G E; Johnston, D J; Pethick, D W

2006-09-01

This paper reviewed the mechanisms by which glycolytic rate and pre-rigor stretching of muscle impact on meat quality. If muscle is free to shorten during the rigor process extremes in glycolytic rate can impact negatively on meat quality by inducing either cold or rigor shortening. Factors that contribute to variation in glycolytic rate include the glycogen concentration at slaughter and fibre type of the muscle. Glycolysis is highly sensitive to temperature, which is an important factor in heavy grain fed carcasses. An alternative solution to controlling glycolysis is to stretch the muscle pre-rigor so that it cannot shorten, thus providing an insurance against extremes in processing conditions. Results are presented which show a large reduction in variance (both additive and phenotypic) in tenderness caused by pre-rigor stretching. Whilst this did not impact on the heritability of shear force, it did reduce genotype differences. The implications of these results on the magnitude of genotype effects on tenderness is discussed.

Voluntary peer review as innovative tool for quality improvement in the intensive care unit – a retrospective descriptive cohort study in German intensive care units

PubMed Central

Kumpf, Oliver; Bloos, Frank; Bause, Hanswerner; Brinkmann, Alexander; Deja, Maria; Marx, Gernot; Kaltwasser, Arnold; Dubb, Rolf; Muhl, Elke; Greim, Clemens-A.; Weiler, Norbert; Chop, Ines; Jonitz, Günther; Schaefer, Henning; Felsenstein, Matthias; Liebeskind, Ursula; Leffmann, Carsten; Jungbluth, Annemarie; Waydhas, Christian; Pronovost, Peter; Spies, Claudia; Braun, Jan-Peter

2014-01-01

Introduction: Quality improvement and safety in intensive care are rapidly evolving topics. However, there is no gold standard for assessing quality improvement in intensive care medicine yet. In 2007 a pilot project in German intensive care units (ICUs) started using voluntary peer reviews as an innovative tool for quality assessment and improvement. We describe the method of voluntary peer review and assessed its feasibility by evaluating anonymized peer review reports and analysed the thematic clusters highlighted in these reports. Methods: Retrospective data analysis from 22 anonymous reports of peer reviews. All ICUs – representing over 300 patient beds – had undergone voluntary peer review. Data were retrieved from reports of peers of the review teams and representatives of visited ICUs. Data were analysed with regard to number of topics addressed and results of assessment questionnaires. Reports of strengths, weaknesses, opportunities and threats (SWOT reports) of these ICUs are presented. Results: External assessment of structure, process and outcome indicators revealed high percentages of adherence to predefined quality goals. In the SWOT reports 11 main thematic clusters were identified representative for common ICUs. 58.1% of mentioned topics covered personnel issues, team and communication issues as well as organisation and treatment standards. The most mentioned weaknesses were observed in the issues documentation/reporting, hygiene and ethics. We identified several unique patterns regarding quality in the ICU of which long-term personnel problems und lack of good reporting methods were most interesting Conclusion: Voluntary peer review could be established as a feasible and valuable tool for quality improvement. Peer reports addressed common areas of interest in intensive care medicine in more detail compared to other methods like measurement of quality indicators. PMID:25587245

Voluntary peer review as innovative tool for quality improvement in the intensive care unit--a retrospective descriptive cohort study in German intensive care units.

PubMed

Kumpf, Oliver; Bloos, Frank; Bause, Hanswerner; Brinkmann, Alexander; Deja, Maria; Marx, Gernot; Kaltwasser, Arnold; Dubb, Rolf; Muhl, Elke; Greim, Clemens-A; Weiler, Norbert; Chop, Ines; Jonitz, Günther; Schaefer, Henning; Felsenstein, Matthias; Liebeskind, Ursula; Leffmann, Carsten; Jungbluth, Annemarie; Waydhas, Christian; Pronovost, Peter; Spies, Claudia; Braun, Jan-Peter

2014-01-01

Quality improvement and safety in intensive care are rapidly evolving topics. However, there is no gold standard for assessing quality improvement in intensive care medicine yet. In 2007 a pilot project in German intensive care units (ICUs) started using voluntary peer reviews as an innovative tool for quality assessment and improvement. We describe the method of voluntary peer review and assessed its feasibility by evaluating anonymized peer review reports and analysed the thematic clusters highlighted in these reports. Retrospective data analysis from 22 anonymous reports of peer reviews. All ICUs - representing over 300 patient beds - had undergone voluntary peer review. Data were retrieved from reports of peers of the review teams and representatives of visited ICUs. Data were analysed with regard to number of topics addressed and results of assessment questionnaires. Reports of strengths, weaknesses, opportunities and threats (SWOT reports) of these ICUs are presented. External assessment of structure, process and outcome indicators revealed high percentages of adherence to predefined quality goals. In the SWOT reports 11 main thematic clusters were identified representative for common ICUs. 58.1% of mentioned topics covered personnel issues, team and communication issues as well as organisation and treatment standards. The most mentioned weaknesses were observed in the issues documentation/reporting, hygiene and ethics. We identified several unique patterns regarding quality in the ICU of which long-term personnel problems und lack of good reporting methods were most interesting Conclusion: Voluntary peer review could be established as a feasible and valuable tool for quality improvement. Peer reports addressed common areas of interest in intensive care medicine in more detail compared to other methods like measurement of quality indicators.

IRIS Toxicological Review of Dichloromethane (Methylene ...

EPA Pesticide Factsheets

On March 31, 2010, the draft IRIS Toxicological Review of Dichloromethane (Methylene Chloride) external review draft document and the charge to external peer reviewers were released for public review and comment. The draft document and the charge to external peer reviewers were reviewed internally by EPA and by other federal agencies and White House Offices before public release. In the new IRIS process, introduced by the EPA Administrator, all written comments on IRIS assessments submitted by other federal agencies and White House Offices will be made publicly available. Accordingly, interagency comments and the interagency science consultation draft of the Toxicological Review of Dichloromethane (Methylene Chloride) and the charge to external peer reviewers are posted on this site. The draft Toxicological Review of Dichloromethane provides scientific support and rationale for the hazard and dose-response assessment pertaining to chronic exposure to dichloromethane.

Making the First Cut: An Analysis of Academic Medicine Editors' Reasons for Not Sending Manuscripts Out for External Peer Review.

PubMed

Meyer, Holly S; Durning, Steven J; Sklar, David P; Maggio, Lauren A

2018-03-01

Manuscripts submitted to Academic Medicine (AM) undergo an internal editor review to determine whether they will be sent for external peer review. Increasingly, manuscripts are rejected at this early stage. This study seeks to inform scholars about common reasons for internal editor review rejections, increase transparency of the process, and provide suggestions for improving submissions. A mixed-methods approach was used to retrospectively analyze editors' free-text comments. Descriptive content analysis was performed of editors' comments for 369 manuscripts submitted between December 2014 and December 2015, and rejected prior to external peer review from AM. Comments were analyzed, categorized, and counted for explicit reasons for rejection. Nine categories of rejection reasons were identified: ineffective study question and/or design (338; 92%); suboptimal data collection process (180; 49%); weak discussion and/or conclusions (139; 37%); unimportant or irrelevant topic to the journal's mission (137; 37%); weak data analysis and/or presentation of results (120; 33%); text difficult to follow, to understand (89; 24%); inadequate or incomplete introduction (67; 18%); other publishing considerations (42; 11%); and issues with scientific conduct (20; 5%). Manuscripts had, on average, three or more reasons for rejection. Findings suggest that clear identification of a research question that is addressed by a well-designed study methodology on a topic aligned with the mission of the journal would address many of the problems that lead to rejection through the internal review process. The findings also align with research on external peer review.

Peer feedback for examiner quality assurance on MRCGP International South Asia: a mixed methods study.

PubMed

Perera, D P; Andrades, Marie; Wass, Val

2017-12-08

The International Membership Examination (MRCGP[INT]) of the Royal College of General Practitioners UK is a unique collaboration between four South Asian countries with diverse cultures, epidemiology, clinical facilities and resources. In this setting good quality assurance is imperative to achieve acceptable standards of inter rater reliability. This study aims to explore the process of peer feedback for examiner quality assurance with regard to factors affecting the implementation and acceptance of the method. A sequential mixed methods approach was used based on focus group discussions with examiners (n = 12) and clinical examination convenors who acted as peer reviewers (n = 4). A questionnaire based on emerging themes and literature review was then completed by 20 examiners at the subsequent OSCE exam. Qualitative data were analysed using an iterative reflexive process. Quantitative data were integrated by interpretive analysis looking for convergence, complementarity or dissonance. The qualitative data helped understand the issues and informed the process of developing the questionnaire. The quantitative data allowed for further refining of issues, wider sampling of examiners and giving voice to different perspectives. Examiners stated specifically that peer feedback gave an opportunity for discussion, standardisation of judgments and improved discriminatory abilities. Interpersonal dynamics, hierarchy and perception of validity of feedback were major factors influencing acceptance of feedback. Examiners desired increased transparency, accountability and the opportunity for equal partnership within the process. The process was stressful for examiners and reviewers; however acceptance increased with increasing exposure to receiving feedback. The process could be refined to improve acceptability through scrupulous attention to training and selection of those giving feedback to improve the perceived validity of feedback and improved reviewer feedback skills to enable better interpersonal dynamics and a more equitable feedback process. It is important to highlight the role of quality assurance and peer feedback as a tool for continuous improvement and maintenance of standards to examiners during training. Examiner quality assurance using peer feedback was generally a successful and accepted process. The findings highlight areas for improvement and guide the path towards a model of feedback that is responsive to examiner views and cultural sensibilities.

Multi-Stage Open Peer Review: Scientific Evaluation Integrating the Strengths of Traditional Peer Review with the Virtues of Transparency and Self-Regulation

PubMed Central

Pöschl, Ulrich

2012-01-01

The traditional forms of scientific publishing and peer review do not live up to all demands of efficient communication and quality assurance in today’s highly diverse and rapidly evolving world of science. They need to be advanced and complemented by interactive and transparent forms of review, publication, and discussion that are open to the scientific community and to the public. The advantages of open access, public peer review, and interactive discussion can be efficiently and flexibly combined with the strengths of traditional scientific peer review. Since 2001 the benefits and viability of this approach are clearly demonstrated by the highly successful interactive open access journal Atmospheric Chemistry and Physics (ACP, www.atmos-chem-phys.net) and a growing number of sister journals launched and operated by the European Geosciences Union (EGU, www.egu.eu) and the open access publisher Copernicus (www.copernicus.org). The interactive open access journals are practicing an integrative multi-stage process of publication and peer review combined with interactive public discussion, which effectively resolves the dilemma between rapid scientific exchange and thorough quality assurance. Key features and achievements of this approach are: top quality and impact, efficient self-regulation and low rejection rates, high attractivity and rapid growth, low costs, and financial sustainability. In fact, ACP and the EGU interactive open access sister journals are by most if not all standards more successful than comparable scientific journals with traditional or alternative forms of peer review (editorial statistics, publication statistics, citation statistics, economic costs, and sustainability). The high efficiency and predictive validity of multi-stage open peer review have been confirmed in a series of dedicated studies by evaluation experts from the social sciences, and the same or similar concepts have recently also been adopted in other disciplines, including the life sciences and economics. Multi-stage open peer review can be flexibly adjusted to the needs and peculiarities of different scientific communities. Due to the flexibility and compatibility with traditional structures of scientific publishing and peer review, the multi-stage open peer review concept enables efficient evolution in scientific communication and quality assurance. It has the potential for swift replacement of hidden peer review as the standard of scientific quality assurance, and it provides a basis for open evaluation in science. PMID:22783183

Barriers and attitudes influencing non-engagement in a peer feedback model to inform evidence for GP appraisal

PubMed Central

2012-01-01

Background The UK general practitioner (GP) appraisal system is deemed to be an inadequate source of performance evidence to inform a future medical revalidation process. A long-running voluntary model of external peer review in the west of Scotland provides feedback by trained peers on the standard of GP colleagues' core appraisal activities and may 'add value' in strengthening the robustness of the current system in support of revalidation. A significant minority of GPs has participated in the peer feedback model, but a clear majority has yet to engage with it. We aimed to explore the views of non-participants to identify barriers to engagement and attitudes to external peer review as a means to inform the current appraisal system. Methods We conducted semi-structured interviews with a sample of west of Scotland GPs who had yet to participate in the peer review model. A thematic analysis of the interview transcriptions was conducted using a constant comparative approach. Results 13 GPs were interviewed of whom nine were males. Four core themes were identified in relation to the perceived and experienced 'value' placed on the topics discussed and their relevance to routine clinical practice and professional appraisal: 1. Value of the appraisal improvement activity. 2. Value of external peer review. 3. Value of the external peer review model and host organisation and 4. Attitudes to external peer review. Conclusions GPs in this study questioned the 'value' of participation in the external peer review model and the national appraisal system over the standard of internal feedback received from immediate work colleagues. There was a limited understanding of the concept, context and purpose of external peer review and some distrust of the host educational provider. Future engagement with the model by these GPs is likely to be influenced by policy to improve the standard of appraisal and contractual related activities, rather than a self-directed recognition of learning needs. PMID:22443714

Barriers and attitudes influencing non-engagement in a peer feedback model to inform evidence for GP appraisal.

PubMed

Curnock, Esther; Bowie, Paul; Pope, Lindsey; McKay, John

2012-03-23

The UK general practitioner (GP) appraisal system is deemed to be an inadequate source of performance evidence to inform a future medical revalidation process. A long-running voluntary model of external peer review in the west of Scotland provides feedback by trained peers on the standard of GP colleagues' core appraisal activities and may 'add value' in strengthening the robustness of the current system in support of revalidation. A significant minority of GPs has participated in the peer feedback model, but a clear majority has yet to engage with it. We aimed to explore the views of non-participants to identify barriers to engagement and attitudes to external peer review as a means to inform the current appraisal system. We conducted semi-structured interviews with a sample of west of Scotland GPs who had yet to participate in the peer review model. A thematic analysis of the interview transcriptions was conducted using a constant comparative approach. 13 GPs were interviewed of whom nine were males. Four core themes were identified in relation to the perceived and experienced 'value' placed on the topics discussed and their relevance to routine clinical practice and professional appraisal: 1. Value of the appraisal improvement activity. 2. Value of external peer review. 3. Value of the external peer review model and host organisation and 4. Attitudes to external peer review. GPs in this study questioned the 'value' of participation in the external peer review model and the national appraisal system over the standard of internal feedback received from immediate work colleagues. There was a limited understanding of the concept, context and purpose of external peer review and some distrust of the host educational provider. Future engagement with the model by these GPs is likely to be influenced by policy to improve the standard of appraisal and contractual related activities, rather than a self-directed recognition of learning needs.

The development of Music in Dementia Assessment Scales (MiDAS)

PubMed Central

McDermott, Orii; Orrell, Martin; Ridder, Hanne Mette

2015-01-01

There is a need to develop an outcome measure specific to music therapy in dementia that reflects a holistic picture of the therapy process and outcome. This study aimed to develop a clinically relevant and scientifically robust music therapy outcome measure incorporating the values and views of people with dementia. Focus groups and interviews were conducted to obtain qualitative data on what music meant to people with dementia and the observed effects of music. Expert and peer consultations were conducted at each stage of the measure development to maximise its content validity. The new measure was field-tested by clinicians in a care home. Feedback from the clinicians and music therapy experts were incorporated during the review and refinement process of the measure. A review of the existing literature, the experiential results and the consensus process enabled the development of the new outcome measure “Music in Dementia Assessment Scales (MiDAS)”. Analysis of the qualitative data identified five key areas of the impact of music on people with dementia and they were transformed as the five Visual Analogue Scale (VAS) items: levels of Interest, Response, Initiation, Involvement and Enjoyment. MiDAS comprises the five VAS items and a supplementary checklist of notable positive and negative reactions from the individual. This study demonstrates that it is possible to design and develop an easy to apply and rigorous quantitative outcome measure which has a high level of clinical relevance for people with dementia, care home staff and music therapists. PMID:26246670

The development of Music in Dementia Assessment Scales (MiDAS).

PubMed

McDermott, Orii; Orrell, Martin; Ridder, Hanne Mette

2015-07-03

There is a need to develop an outcome measure specific to music therapy in dementia that reflects a holistic picture of the therapy process and outcome. This study aimed to develop a clinically relevant and scientifically robust music therapy outcome measure incorporating the values and views of people with dementia. Focus groups and interviews were conducted to obtain qualitative data on what music meant to people with dementia and the observed effects of music. Expert and peer consultations were conducted at each stage of the measure development to maximise its content validity. The new measure was field-tested by clinicians in a care home. Feedback from the clinicians and music therapy experts were incorporated during the review and refinement process of the measure. A review of the existing literature, the experiential results and the consensus process enabled the development of the new outcome measure "Music in Dementia Assessment Scales (MiDAS)". Analysis of the qualitative data identified five key areas of the impact of music on people with dementia and they were transformed as the five Visual Analogue Scale (VAS) items: levels of Interest, Response, Initiation, Involvement and Enjoyment. MiDAS comprises the five VAS items and a supplementary checklist of notable positive and negative reactions from the individual. This study demonstrates that it is possible to design and develop an easy to apply and rigorous quantitative outcome measure which has a high level of clinical relevance for people with dementia, care home staff and music therapists.

Innovative Peer Review Model for Rural Physicians: System Design and Implementation

ERIC Educational Resources Information Center

Williams, Josie R.; Mechler, Kathy; Akins, Ralitsa B.

2008-01-01

Context: The peer review process in small rural hospitals is complicated by limited numbers of physicians, conflict of interest, issues related to appropriate utilization of new technology, possibility for conflicting recommendations, and need for external expertise. Purpose: The purpose of this project was to design, test, and implement a virtual…

Nurturing Professional Growth: A Peer Review Model for Independent Evaluators

ERIC Educational Resources Information Center

Bond, Sally L.; Ray, Marilyn L.

2006-01-01

There has been a recent groundswell of support in the American Evaluation Association's Independent Consulting Topical Interest Group (IC TIG) for evaluating evaluators' work just as evaluators evaluate the work of their clients. To facilitate this self-evaluation, the IC TIG elected to create a peer review process that focuses on written…

Radiologist Peer Review by Group Consensus.

PubMed

Harvey, H Benjamin; Alkasab, Tarik K; Prabhakar, Anand M; Halpern, Elkan F; Rosenthal, Daniel I; Pandharipande, Pari V; Gazelle, G Scott

2016-06-01

The objective of this study was to evaluate the feasibility of the consensus-oriented group review (COGR) method of radiologist peer review within a large subspecialty imaging department. This study was institutional review board approved and HIPAA compliant. Radiologist interpretations of CT, MRI, and ultrasound examinations at a large academic radiology department were subject to peer review using the COGR method from October 2011 through September 2013. Discordance rates and sources of discordance were evaluated on the basis of modality and division, with group differences compared using a χ(2) test. Potential associations between peer review outcomes and the time after the initiation of peer review or the number of radiologists participating in peer review were tested by linear regression analysis and the t test, respectively. A total of 11,222 studies reported by 83 radiologists were peer reviewed using COGR during the two-year study period. The average radiologist participated in 112 peer review conferences and had 3.3% of his or her available CT, MRI and ultrasound studies peer reviewed. The rate of discordance was 2.7% (95% confidence interval [CI], 2.4%-3.0%), with significant differences in discordance rates on the basis of division and modality. Discordance rates were highest for MR (3.4%; 95% CI, 2.8%-4.1%), followed by ultrasound (2.7%; 95% CI, 2.0%-3.4%) and CT (2.4%; 95% CI, 2.0%-2.8%). Missed findings were the most common overall cause for discordance (43.8%; 95% CI, 38.2%-49.4%), followed by interpretive errors (23.5%; 95% CI, 18.8%-28.3%), dictation errors (19.0%; 95% CI, 14.6%-23.4%), and recommendation (10.8%; 95% CI, 7.3%-14.3%). Discordant cases, compared with concordant cases, were associated with a significantly greater number of radiologists participating in the peer review process (5.9 vs 4.7 participating radiologists, P < .001) and were significantly more likely to lead to an addendum (62.9% vs 2.7%, P < .0001). COGR permits departments to collect highly contextualized peer review data to better elucidate sources of error in diagnostic imaging reports, while reviewing a sufficient case volume to comply with external standards for ongoing performance review. Copyright © 2016 American College of Radiology. Published by Elsevier Inc. All rights reserved.

Peer review in medical journals: Beyond quality of reports towards transparency and public scrutiny of the process.

PubMed

Vercellini, Paolo; Buggio, Laura; Viganò, Paola; Somigliana, Edgardo

2016-06-01

Published medical research influences health care providers and policy makers, guides patient management, and is based on the peer review process. Peer review should prevent publication of unreliable data and improve study reporting, but there is little evidence that these aims are fully achieved. In the blinded systems, authors and readers do not know the reviewers' identity. Moreover, the reviewers' reports are not made available to readers. Anonymous peer review poses an ethical imbalance toward authors, who are judged by masked referees, and to the medical community and society at large, in case patients suffer the consequences of acceptance of flawed manuscripts or erroneous rejection of important findings. Some general medical journals have adopted an open process, require reviewers to sign their reports, and links online pre-publication histories to accepted articles. This system increases editors' and reviewers' accountability and allows public scrutiny, consenting readers understand on which basis were decisions taken and by whom. Moreover, this gives credit to reviewers for their apparently thankless job, as online availability of signed and scored reports may contribute to researchers' academic curricula. However, the transition from the blind to the open system could pose problems to journals. Reviewers may be more difficult to find, and publishers or medical societies could resist changes that may affect editorial costs and journals' revenues. Nonetheless, also considering the risk of competing interests in the medical field, general and major specialty journals could consider testing the effects of open review on manuscripts regarding studies that may influence clinical practice. Copyright © 2016 European Federation of Internal Medicine. Published by Elsevier B.V. All rights reserved.

RETRACTED: Growth of boron-doped diamond nanoclusters using the HFCVD technique

NASA Astrophysics Data System (ADS)

Azadfar, P.; Ghoranneviss, M.; Elahi, S. M.; Farhadyar, N.; Salar Elahi, A.

2015-04-01

This article has been retracted: please see Elsevier Policy on Article Withdrawal (http://www.elsevier.com/locate/withdrawalpolicy). This article has been retracted at the request of the Principal Editor. After a thorough investigation, the Editor has concluded that the review process for this article was compromised. The acceptance was based on information from one reviewer report that was submitted from an email account provided to the journal as a suggested reviewer during the submission of the article. Although purportedly a real reviewer account, the Editor has concluded that this was not of an appropriate, independent reviewer. This manipulation of the peer-review process represents a clear violation of the fundamentals of peer review, our publishing policies, and publishing ethics standards. Apologies are offered to the reviewer whose identity was assumed and to the readers of the journal that this deception was not detected during the submission process.

In Referees We Trust? Controversies over Grant Peer Review in the Late Twentieth Century

NASA Astrophysics Data System (ADS)

Baldwin, Melinda

While many accounts of external refereeing assume that it has been a consistent part of science since the seventeenth century, the practice developed far more slowly and haphazardly than many observers realize, and it was not until after the Second World War that ''peer review'' became considered an essential part of scientific publishing or grant-making. This talk will explore refereeing procedures at American grant-giving organizations in the twentieth century, focusing especially on the National Science Foundation and the National Institutes of Health. The creators of the NSF and the NIH put refereeing systems in place at their foundation. However, the form and function of these systems differed from modern ''peer review'' in several important ways. At the NSF the initial purpose of the referee process was to advise the NSF program directors, not to dictate funding decisions. At the NIH, small ''study sections'' devoted to particular subjects made recommendations to the NIH leadership, which rendered final judgments. However, beginning in the 1960s a series of controversies about NIH and NSF grants placed refereeing procedures at these organizations under more intense scrutiny. These debates culminated in six days of Special Oversight Hearings into the NSF's peer review process in the summer of 1975. Following the hearings, both the NSF and NIH reformed their review processes to place more emphasis on referees' opinions about grant proposals, making peer review increasingly responsible for decision-making. These controversies illustrate that refereeing continued to undergo significant changes in form and purpose throughout the twentieth century, and further suggest that both the scientific community and the public placed increased emphasis on the role of the referee during the late twentieth century.

Does industry self-regulation protect young people from exposure to alcohol marketing? A review of compliance and complaint studies.

PubMed

Noel, Jonathan K; Babor, Thomas F

2017-01-01

Exposure to alcohol marketing is considered to be potentially harmful to adolescents. In addition to statutory regulation, industry self-regulation is a common way to protect adolescents from alcohol marketing exposures. This paper critically reviews research designed to evaluate the effectiveness of the alcohol industry's compliance procedures to manage complaints when alcohol marketing is considered to have violated a self-regulatory code. Peer-reviewed papers were identified through four literature search engines: PubMed, SCOPUS, PsychINFO and CINAHL. Non-peer-reviewed reports produced by public health agencies, alcohol research centers, non-governmental organizations, government research centers and national industry advertising associations were also included. The search process yielded three peer-reviewed papers, seven non-peer reviewed reports published by academic institutes and non-profit organizations and 20 industry reports. The evidence indicates that the complaint process lacks standardization across countries, industry adjudicators may be trained inadequately or biased and few complaints are upheld against advertisements pre-determined to contain violations of a self-regulatory code. The current alcohol industry marketing complaint process used in a wide variety of countries may be ineffective at removing potentially harmful content from the market-place. The process of determining the validity of complaints employed by most industry groups appears to suffer from serious conflict of interest and procedural weaknesses that could compromise objective adjudication of even well-documented complaints. In our opinion the current system of self-regulation needs major modifications if it is to serve public health objectives, and more systematic evaluations of the complaint process are needed. © 2016 Society for the Study of Addiction.

Process modeling and bottleneck mining in online peer-review systems.

PubMed

Premchaiswadi, Wichian; Porouhan, Parham

2015-01-01

This paper is divided into three main parts. In the first part of the study, we captured, collected and formatted an event log describing the handling of reviews for proceedings of an international conference in Thailand. In the second part, we used several process mining techniques in order to discover process models, social, organizational, and hierarchical structures from the proceeding's event log. In the third part, we detected the deviations and bottlenecks of the peer review process by comparing the observed events (i.e., authentic dataset) with a pre-defined model (i.e., master map). Finally, we investigated the performance information as well as the total waiting time in order to improve the effectiveness and efficiency of the online submission and peer review system for the prospective conferences and seminars. Consequently, the main goals of the study were as follows: (1) to convert the collected event log into the appropriate format supported by process mining analysis tools, (2) to discover process models and to construct social networks based on the collected event log, and (3) to find deviations, discrepancies and bottlenecks between the collected event log and the master pre-defined model. The results showed that although each paper was initially sent to three different reviewers; it was not always possible to make a decision after the first round of reviewing; therefore, additional reviewers were invited. In total, all the accepted and rejected manuscripts were reviewed by an average of 3.9 and 3.2 expert reviewers, respectively. Moreover, obvious violations of the rules and regulations relating to careless or inappropriate peer review of a manuscript-committed by the editorial board and other staff-were identified. Nine blocks of activity in the authentic dataset were not completely compatible with the activities defined in the master model. Also, five of the activity traces were not correctly enabled, and seven activities were missed within the online submission system. On the other hand, dealing with the feedback (comments) received from the first and the third reviewers; the conference committee members and the organizers did not attend to those feedback/comments in a timely manner.

Teleconference versus Face-to-Face Scientific Peer Review of Grant Application: Effects on Review Outcomes

PubMed Central

Gallo, Stephen A.; Carpenter, Afton S.; Glisson, Scott R.

2013-01-01

Teleconferencing as a setting for scientific peer review is an attractive option for funding agencies, given the substantial environmental and cost savings. Despite this, there is a paucity of published data validating teleconference-based peer review compared to the face-to-face process. Our aim was to conduct a retrospective analysis of scientific peer review data to investigate whether review setting has an effect on review process and outcome measures. We analyzed reviewer scoring data from a research program that had recently modified the review setting from face-to-face to a teleconference format with minimal changes to the overall review procedures. This analysis included approximately 1600 applications over a 4-year period: two years of face-to-face panel meetings compared to two years of teleconference meetings. The average overall scientific merit scores, score distribution, standard deviations and reviewer inter-rater reliability statistics were measured, as well as reviewer demographics and length of time discussing applications. The data indicate that few differences are evident between face-to-face and teleconference settings with regard to average overall scientific merit score, scoring distribution, standard deviation, reviewer demographics or inter-rater reliability. However, some difference was found in the discussion time. These findings suggest that most review outcome measures are unaffected by review setting, which would support the trend of using teleconference reviews rather than face-to-face meetings. However, further studies are needed to assess any correlations among discussion time, application funding and the productivity of funded research projects. PMID:23951223

Establishing a Research Agenda for Understanding the Role and Impact of Mental Health Peer Specialists.

PubMed

Chinman, Matthew; McInnes, D Keith; Eisen, Susan; Ellison, Marsha; Farkas, Marianne; Armstrong, Moe; Resnick, Sandra G

2017-09-01

Mental health peer specialists are individuals with serious mental illnesses who receive training to use their lived experiences to help others with serious mental illnesses in clinical settings. This Open Forum discusses the state of the research for mental health peer specialists and suggests a research agenda to advance the field. Studies have suggested that peer specialists vary widely in their roles, settings, and theoretical orientations. Theories of action have been proposed, but none have been tested. Outcome studies have shown benefits of peer specialists; however, many studies have methodological shortcomings. Qualitative descriptions of peer specialists are plentiful but lack grounding in implementation science frameworks. A research agenda advancing the field could include empirically testing theoretical mechanisms of peer specialists, developing a measure of peer specialist fidelity, conducting more rigorous outcomes studies, involving peer specialists in executing the research, and assessing various factors that influence implementing peer specialist services and testing strategies that could address those factors.

Students Matter: Quality Measurements in Online Courses

ERIC Educational Resources Information Center

Unal, Zafer; Unal, Aslihan

2016-01-01

Quality Matters (QM) is a peer review process designed to certify the quality of online courses and online components. It has generated widespread interest and received national recognition for its peer-based approach to quality assurance and continuous improvement in online education. While the entire QM online course design process is…

Testing the Rebound Peer Review Concept

PubMed Central

Choi, Augustine M.K.

2013-01-01

Abstract This invited editorial addresses the rescue of the article by Skrzypek et al. “Interplay between heme oxygenase-1 and miR-378 affects non-small cell lung carcinoma growth, vascularization, and metastasis.” The work was rejected by the standard peer review system and subsequently rescued by the Rebound Peer Review (RPR) mechanism offered by Antioxidants and Redox Signaling (Antioxid Redox Signal 16: 293–296, 2012). The reviewers who openly rescued the article were James F. George, Justin C. Mason, Mahin D. Maines, and Yasufumi Sato. The initial article was a de novo resubmission of a previously rejected article, which was then reviewed by six reviewers. The reviewers raised substantial scientific concerns, including questions pertaining to the specificity of the findings, quality of the presentation, and other technical concerns; the editor returned a decision of reject. The authors voluntarily chose to exercise the option to rescue the article utilizing the RPR system, where the authors found qualified reviewers who were willing to advocate for acceptance with scientific reasoning. The open reviewers felt that the scientific and technical concerns raised by the reviewers were outweighed by the strengths and novelty of the findings to justify acceptance. The RPR, in this case, was a “success” in that it rescued a rejected article. Despite this assessment, we question the necessity of open peer review as a means to overturn a peer review decision, with concerns for the larger-than-usual peer review process, and the voluntary relinquishing of editorial privilege and disclosure of reviewer identity. Antioxid. Redox Signal. 19, 639–643. PMID:23725371

Learning effects of thematic peer-review: a qualitative analysis of reflective journals on spiritual care.

PubMed

van Leeuwen, René; Tiesinga, Lucas J; Jochemsen, Henk; Post, Doeke

2009-05-01

This study describes the learning effects of thematic peer-review discussion groups (Hendriksen, 2000. Begeleid intervisie model, Collegiale advisering en probleemoplossing, Nelissen, Baarn.) on developing nursing students' competence in providing spiritual care. It also discusses the factors that might influence the learning process. The method of peer-review is a form of reflective learning based on the theory of experiential learning (Kolb, 1984. Experiential learning, Experience as the source of learning development. Englewoods Cliffs, New Jersey, Prentice Hill). It was part of an educational programme on spiritual care in nursing for third-year undergraduate nursing students from two nursing schools in the Netherlands. Reflective journals (n=203) kept by students throughout the peer-review process were analysed qualitatively The analysis shows that students reflect on spirituality in the context of personal experiences in nursing practice. In addition, they discuss the nursing process and organizational aspects of spiritual care. The results show that the first two phases in the experiential learning cycle appear prominently; these are 'inclusion of actual experience' and 'reflecting on this experience'. The phases of 'abstraction of experience' and 'experimenting with new behaviour' are less evident. We will discuss possible explanations for these findings according to factors related to education, the students and the tutors and make recommendations for follow-up research.

Peer-review for selection of oral presentations for conferences: Are we reliable?

PubMed

Deveugele, Myriam; Silverman, Jonathan

2017-11-01

Although peer-review for journal submission, grant-applications and conference submissions has been called 'a counter- stone of science', and even 'the gold standard for evaluating scientific merit', publications on this topic remain scares. Research that has investigated peer-review reveals several issues and criticisms concerning bias, poor quality review, unreliability and inefficiency. The most important weakness of the peer review process is the inconsistency between reviewers leading to inadequate inter-rater reliability. To report the reliability of ratings for a large international conference and to suggest possible solutions to overcome the problem. In 2016 during the International Conference on Communication in Healthcare, organized by EACH: International Association for Communication in Healthcare, a calibration exercise was proposed and feedback was reported back to the participants of the exercise. Most abstracts, as well as most peer-reviewers, receive and give scores around the median. Contrary to the general assumption that there are high and low scorers, in this group only 3 peer-reviewers could be identified with a high mean, while 7 has a low mean score. Only 2 reviewers gave only high ratings (4 and 5). Of the eight abstracts included in this exercise, only one abstract received a high mean score and one a low mean score. Nevertheless, both these abstracts received both low and high scores; all other abstracts received all possible scores. Peer-review of submissions for conferences are, in accordance with the literature, unreliable. New and creative methods will be needed to give the participants of a conference what they really deserve: a more reliable selection of the best abstracts. More raters per abstract improves the inter-rater reliability; training of reviewers could be helpful; providing feedback to reviewers can lead to less inter-rater disagreement; fostering negative peer-review (rejecting the inappropriate submissions) rather than a positive (accepting the best) could be fruitful for selecting abstracts for conferences. Copyright © 2017 Elsevier B.V. All rights reserved.

Peer review at the Health Information and Libraries Journal.

PubMed

Grant, Maria J

2014-12-01

At its best, peer review can mean receiving constructive feedback to help you make the most of your writing. At the Health Information and Libraries Journal, we strive to make the peer review a positive process for both authors and referees. We adopt a process of double-blind peer review. To receive two reviews in a timely manner, three referees are initially invited for each article submitted. The referees are asked to submit their review noting errors, areas of ambiguity or clarification required before the editor and editorial team consider the manuscript ready for publication. As with most journals, it's unlikely that your writing will be accepted in its original form; a typical outcome will be for a recommendation for major or minor revisions. This is good! It means the editorial team has seen something of likely interest to their readership and wants to help you develop it to a publishable standard. There can be a surprising amount of development and change in a manuscript from original submission through to publication. While you may be experienced in your field, you may not have much experience of writing for publication. As a referee, you get an intriguing insight into the shape of manuscripts in their original form. © 2014 The authors. Health Information and Libraries Journal © 2014 Health Libraries Journal.

How to Assess Quality of Research in Iran, From Input to Impact? Introduction of Peer-Based Research Evaluation Model in Iran.

PubMed

Ebadifar, Asghar; Baradaran Eftekhari, Monir; Owlia, Parviz; Habibi, Elham; Ghalenoee, Elham; Bagheri, Mohammad Reza; Falahat, Katayoun; Eltemasi, Masoumeh; Sobhani, Zahra; Akhondzadeh, Shahin

2017-11-01

Research evaluation is a systematic and objective process to measure relevance, efficiency and effectiveness of research activities, and peer review is one of the most important tools for assessing quality of research. The aim of this study was introducing research evaluation indicators based on peer reviewing. This study was implemented in 4 stages. A list of objective-oriented evaluation indicators were designed in 4 axes, including; governance and leadership, structure, knowledge production and research impact. The top 10% medical sciences research centers (RCs) were evaluated based on peer review. Adequate equipment and laboratory instruments, high quality research publication and national or international cooperation were the main strengths in medical sciences RCs and the most important weaknesses included failure to adhere to strategic plans, parallel actions in similar fields, problems in manpower recruitment, knowledge translation & exchange (KTE) in service providers and policy makers' levels. Peer review evaluation can improve the quality of research.

An examination of gender differences in the American Fisheries Society peer-review process

USGS Publications Warehouse

Handley, Grace; Frantz, Cynthia M; Kocovsky, Patrick; DeVries, Dennis R.; Cooke, Steven J.; Claussen, Julie

2015-01-01

This study investigated the possibility of gender differences in outcomes throughout the peer review process of American Fisheries Society (AFS) journals. For each manuscript submitted to four AFS journals between January 2003 and December 2010, we collated information regarding the gender and nationality of authors, gender of associate editor, gender of reviewers, reviewer recommendations, associate editor's decision, and publication status of the manuscript. We used hierarchical linear modeling to test for differences in manuscript decision outcomes associated with author, reviewer, and associate editor gender. Gender differences were present at some but not every stage of the review process and were not equal among the four journals. Although there was a small gender difference in decision outcomes, we found no evidence of bias in editors’ and reviewers’ recommendations. Our results support the conclusion that the current single-blind review system does not result in bias against female authors within AFS journals.

Peer review amongst restorative specialists on the quality of their communication with referring dental practitioners.

PubMed

Ricketts, D N J; Scott, B J J; Ali, A; Chadwick, R G; Murray, C A; Radford, J R; Saunders, W P

2003-10-11

A peer review study was carried out to assess the written communication between consultants and specialist registrars in restorative dentistry with the referring general dental practitioners. Seven people took part in the study and each presented referral and reply letters for five patients whom they had seen for consultation. The referral letters were used for information only and were not used in the peer review process. Each participant inspected the referral and reply letters from the other six participants. The reply letters were anonymously peer reviewed by using a proforma containing agreed criteria in relation to appropriate factors to include in the reply letter. The reviewer also ranked the letter in relation to overall quality on a 1-10 point scale. It was found that the participants' letters generally conformed positively with the agreed criteria although there were some differences between individuals. There were particular problems identified in relation to tooth notation. Reply letters commonly used different forms of tooth notation to the referring practitioners. The ranking of the letters generally indicated that the participants' replies were judged to be favourable by their peers. There may be scope for continuing this study in relation to peer review by other groups of professionals, in particular practitioners in primary dental care.

The Long Shadow of Peer Review on the Preparation of Artist Educators

ERIC Educational Resources Information Center

Walker, Loretta Niebur

2013-01-01

The recruitment and retention of the highest-quality artist educators in colleges and universities is a key element in supporting strong K-12 arts education programs. Artist educators must be expert in at least two disciplines: their art forms and education. However, the peer review processes commonly employed to recommend higher education faculty…

Implementing a Peer Mentoring Model in the Clemson Eportfolio Program

ERIC Educational Resources Information Center

Ring, Gail L.

2015-01-01

Since the implementation of the ePortfolio Program in 2006, Clemson University has incorporated peer review for the formative feedback process. One of the challenges with this large-scale implementation has been ensuring that all work is reviewed and constructive feedback is provided in a timely manner. In this article, I discuss the strategies…

Authorization of Animal Experiments Is Based on Confidence Rather than Evidence of Scientific Rigor

PubMed Central

Nathues, Christina; Würbel, Hanno

2016-01-01

Accumulating evidence indicates high risk of bias in preclinical animal research, questioning the scientific validity and reproducibility of published research findings. Systematic reviews found low rates of reporting of measures against risks of bias in the published literature (e.g., randomization, blinding, sample size calculation) and a correlation between low reporting rates and inflated treatment effects. That most animal research undergoes peer review or ethical review would offer the possibility to detect risks of bias at an earlier stage, before the research has been conducted. For example, in Switzerland, animal experiments are licensed based on a detailed description of the study protocol and a harm–benefit analysis. We therefore screened applications for animal experiments submitted to Swiss authorities (n = 1,277) for the rates at which the use of seven basic measures against bias (allocation concealment, blinding, randomization, sample size calculation, inclusion/exclusion criteria, primary outcome variable, and statistical analysis plan) were described and compared them with the reporting rates of the same measures in a representative sub-sample of publications (n = 50) resulting from studies described in these applications. Measures against bias were described at very low rates, ranging on average from 2.4% for statistical analysis plan to 19% for primary outcome variable in applications for animal experiments, and from 0.0% for sample size calculation to 34% for statistical analysis plan in publications from these experiments. Calculating an internal validity score (IVS) based on the proportion of the seven measures against bias, we found a weak positive correlation between the IVS of applications and that of publications (Spearman’s rho = 0.34, p = 0.014), indicating that the rates of description of these measures in applications partly predict their rates of reporting in publications. These results indicate that the authorities licensing animal experiments are lacking important information about experimental conduct that determines the scientific validity of the findings, which may be critical for the weight attributed to the benefit of the research in the harm–benefit analysis. Similar to manuscripts getting accepted for publication despite poor reporting of measures against bias, applications for animal experiments may often be approved based on implicit confidence rather than explicit evidence of scientific rigor. Our findings shed serious doubt on the current authorization procedure for animal experiments, as well as the peer-review process for scientific publications, which in the long run may undermine the credibility of research. Developing existing authorization procedures that are already in place in many countries towards a preregistration system for animal research is one promising way to reform the system. This would not only benefit the scientific validity of findings from animal experiments but also help to avoid unnecessary harm to animals for inconclusive research. PMID:27911892

Authorization of Animal Experiments Is Based on Confidence Rather than Evidence of Scientific Rigor.

PubMed

Vogt, Lucile; Reichlin, Thomas S; Nathues, Christina; Würbel, Hanno

2016-12-01

Accumulating evidence indicates high risk of bias in preclinical animal research, questioning the scientific validity and reproducibility of published research findings. Systematic reviews found low rates of reporting of measures against risks of bias in the published literature (e.g., randomization, blinding, sample size calculation) and a correlation between low reporting rates and inflated treatment effects. That most animal research undergoes peer review or ethical review would offer the possibility to detect risks of bias at an earlier stage, before the research has been conducted. For example, in Switzerland, animal experiments are licensed based on a detailed description of the study protocol and a harm-benefit analysis. We therefore screened applications for animal experiments submitted to Swiss authorities (n = 1,277) for the rates at which the use of seven basic measures against bias (allocation concealment, blinding, randomization, sample size calculation, inclusion/exclusion criteria, primary outcome variable, and statistical analysis plan) were described and compared them with the reporting rates of the same measures in a representative sub-sample of publications (n = 50) resulting from studies described in these applications. Measures against bias were described at very low rates, ranging on average from 2.4% for statistical analysis plan to 19% for primary outcome variable in applications for animal experiments, and from 0.0% for sample size calculation to 34% for statistical analysis plan in publications from these experiments. Calculating an internal validity score (IVS) based on the proportion of the seven measures against bias, we found a weak positive correlation between the IVS of applications and that of publications (Spearman's rho = 0.34, p = 0.014), indicating that the rates of description of these measures in applications partly predict their rates of reporting in publications. These results indicate that the authorities licensing animal experiments are lacking important information about experimental conduct that determines the scientific validity of the findings, which may be critical for the weight attributed to the benefit of the research in the harm-benefit analysis. Similar to manuscripts getting accepted for publication despite poor reporting of measures against bias, applications for animal experiments may often be approved based on implicit confidence rather than explicit evidence of scientific rigor. Our findings shed serious doubt on the current authorization procedure for animal experiments, as well as the peer-review process for scientific publications, which in the long run may undermine the credibility of research. Developing existing authorization procedures that are already in place in many countries towards a preregistration system for animal research is one promising way to reform the system. This would not only benefit the scientific validity of findings from animal experiments but also help to avoid unnecessary harm to animals for inconclusive research.

Peers and adolescent smoking.

PubMed

Kobus, Kimberly

2003-05-01

There is a considerable body of empirical research that has identified adolescent peer relationships as a primary factor involved in adolescent cigarette smoking. Despite this large research base, many questions remain unanswered about the mechanisms by which peers affect youths' smoking behavior. Understanding these processes of influence is key to the development of prevention and intervention programs designed to address adolescent smoking as a significant public health concern. In this paper, theoretical frameworks and empirical findings are reviewed critically which inform the current state of knowledge regarding peer influences on teenage smoking. Specifically, social learning theory, primary socialization theory, social identity theory and social network theory are discussed. Empirical findings regarding peer influence and selection, as well as multiple reference points in adolescent friendships, including best friendships, romantic relationships, peer groups and social crowds, are also reviewed. Review of this work reveals the contribution that peers have in adolescents' use of tobacco, in some cases promoting use, and in other cases deterring it. This review also suggests that peer influences on smoking are more subtle than commonly thought and need to be examined more carefully, including consideration of larger social contexts, e.g. the family, neighborhood, and media. Recommendations for future investigations are made, as well as suggestions for specific methodological approaches that offer promise for advancing our knowledge of the contribution of peers on adolescent tobacco use.

Peer Attachment and Youth Internalizing Problems: A Meta-Analysis

ERIC Educational Resources Information Center

Gorrese, Anna

2016-01-01

Background: Peer relationships become the central arena in which attachment processes are likely to play out during adolescence and beyond, and contribute to various aspects of psychosocial adjustment. Objective: Given the relevance of peer connections and the growing literature examining them, the purpose of this article was to review, through a…

Online Peer Discourse in a Writing Classroom

ERIC Educational Resources Information Center

Choi, Jessie

2014-01-01

This paper is an attempt to explore the interaction discourse of second language undergraduate learners in the online peer review process of a writing classroom in Hong Kong. Specifically, the writer sought to investigate the types of online discourse learners have in the peer discussions on their writing, and to examine the role of explicit…

A novel program to improve patient safety by integrating peer review into the emergency medicine residency curriculum.

PubMed

Strayer, Reuben J; Shy, Bradley D; Shearer, Peter L

2014-12-01

Evaluating the quality of care as part of a quality improvement process is required in many clinical environments by accrediting bodies. It produces metrics used to evaluate department and individual provider performance, provides outcomes-based feedback to clinicians, and identifies ways to reduce error. To improve patient safety and train our residents to perform peer review, we expanded our quality assurance program from a narrow, administrative process carried out by a small number of attendings to an educationally focused activity of much greater scope incorporating all residents on a monthly basis. We developed an explicit system by which residents analyze sets of high-risk cases and record their impressions onto structured databases, which are reviewed by faculty. At monthly meetings, results from the month's case reviews are presented, learning points discussed, and corrective actions are proposed. By integrating Clinical Quality Review (CQR) as a core, continuous component of the residency curriculum, we increased the number of cases reviewed more than 10-fold and implemented a variety of clinical process improvements. An anonymous survey conducted after 2 years of resident-led CQR indicated that residents value their exposure to the peer review process and feel it benefits them as clinicians, but also that the program requires a significant investment of time that can be burdensome. Copyright © 2014 Elsevier Inc. All rights reserved.

Facilitating improvements in laboratory report writing skills with less grading: a laboratory report peer-review process.

PubMed

Brigati, Jennifer R; Swann, Jerilyn M

2015-05-01

Incorporating peer-review steps in the laboratory report writing process provides benefits to students, but it also can create additional work for laboratory instructors. The laboratory report writing process described here allows the instructor to grade only one lab report for every two to four students, while giving the students the benefits of peer review and prompt feedback on their laboratory reports. Here we present the application of this process to a sophomore level genetics course and a freshman level cellular biology course, including information regarding class time spent on student preparation activities, instructor preparation, prerequisite student knowledge, suggested learning outcomes, procedure, materials, student instructions, faculty instructions, assessment tools, and sample data. T-tests comparing individual and group grading of the introductory cell biology lab reports yielded average scores that were not significantly different from each other (p = 0.13, n = 23 for individual grading, n = 6 for group grading). T-tests also demonstrated that average laboratory report grades of students using the peer-review process were not significantly different from those of students working alone (p = 0.98, n = 9 for individual grading, n = 6 for pair grading). While the grading process described here does not lead to statistically significant gains (or reductions) in student learning, it allows student learning to be maintained while decreasing instructor workload. This reduction in workload could allow the instructor time to pursue other high-impact practices that have been shown to increase student learning. Finally, we suggest possible modifications to the procedure for application in a variety of settings.

A qualitative synthesis of the positive and negative impacts related to delivery of peer-based health interventions in prison settings.

PubMed

South, Jane; Woodall, James; Kinsella, Karina; Bagnall, Anne-Marie

2016-09-29

Peer interventions involving prisoners in delivering peer education and peer support in a prison setting can address health need and add capacity for health services operating in this setting. This paper reports on a qualitative synthesis conducted as part of a systematic review of prison-based peer interventions. One of the review questions aimed to investigate the positive and negative impacts of delivering peer interventions within prison settings. This covered organisational and process issues relating to peer interventions, including prisoner and staff views. A qualitative synthesis of qualitative and mixed method studies was undertaken. The overall study design comprised a systematic review involving searching, study selection, data extraction and validity assessment. Studies reporting interventions with prisoners or ex-prisoners delivering education or support to prisoners resident in any type of prison or young offender institution, all ages, male and female, were included. A thematic synthesis was undertaken with a subset of studies reporting qualitative data (n = 33). This involved free coding of text reporting qualitative findings to develop a set of codes, which were then grouped into thematic categories and mapped back to the review question. Themes on process issues and wider impacts were grouped into four thematic categories: peer recruitment training and support; organisational support; prisoner relationships; prison life. There was consistent qualitative evidence on the need for organisational support within the prison to ensure smooth implementation and on managing security risks when prisoners were involved in service delivery. A suite of factors affecting the delivery of peer interventions and the wider organisation of prison life were identified. Alongside reported benefits of peer delivery, some reasons for non-utilisation of services by other prisoners were found. There was weak qualitative evidence on wider impacts on the prison system, including better communication between staff and prisoners. Gaps in evidence were identified. The quality of included studies limited the strength of the conclusions. The main conclusion is that peer interventions cannot be seen as independent of prison life and health services need to work in partnership with prison services to deliver peer interventions. More research is needed on long-term impacts. PROSPERO ref: CRD42012002349 .

Interventions to Reduce Perceived Stress Among Graduate Students: A Systematic Review With Implications for Evidence-Based Practice.

PubMed

Stillwell, Susan B; Vermeesch, Amber L; Scott, Jane G

2017-12-01

Stress is a part of daily life for graduate students, including graduate nursing students. Contemporary graduate nursing students are facing unprecedented challenges to meet rigorous academic standards as they prepare for their advanced professional role to meet the demands of the nation's complex and ever-changing healthcare system. Empowering graduate nursing students to ease their perceived stress and minimize undesirable health effects may benefit their capacity to adapt and successfully manage perceived stress in their future healthcare role. To conduct a systematic review to evaluate the existing evidence with the aim of identifying evidence-based self-care interventions for coping with perceived stress. We conducted a systematic review, searching CINAHL Plus with Full Text, PsycINFO, and MEDLINE. Inclusion criteria included self-care, graduate students, perceived stress as measured by Perceived Stress Scale, quantitative analysis, conducted within the United States, English language, and peer reviewed. Two authors completed an asynchronous review of the articles, and one expert evidence-based practice mentor and one wellness expert conducted rigorous appraisal of the eight identified studies. Evidence was evaluated and synthesized, and recommendations for practice were determined. Eight studies meeting the criteria for this systematic review were critically appraised. The interventions varied from a stress management course to mind-body-stress-reduction (MBSR) techniques, such as yoga, breath work, meditation, and mindfulness. All studies measured the outcome of stress with the Perceived Stress Scale. Each study demonstrated a reduction in perceived stress postintervention. Most effective self-care MBSR interventions include (a) a didactic component, (b) a guided MBSR practice session, and (c) homework. Consideration should be given to a trained or certified MBSR instructor to teach the intervention. © 2017 Sigma Theta Tau International.

Urine trouble: should we think differently about UTI?

PubMed

Price, Travis K; Hilt, Evann E; Dune, Tanaka J; Mueller, Elizabeth R; Wolfe, Alan J; Brubaker, Linda

2018-02-01

Urinary tract infection (UTI) is clinically important, given that it is one of the most common bacterial infections in adult women. However, the current understanding of UTI remains based on a now disproven concept that the urinary bladder is sterile. Thus, current standards for UTI diagnosis have significant limitations that may reduce the opportunity to improve patient care. Using data from our work and numerous other peer-reviewed studies, we identified four major limitations to the contemporary UTI description: the language of UTI, UTI diagnostic testing, the Escherichia coli-centric view of UTI, and the colony-forming units (CFU) threshold-based diagnosis. Contemporary methods and technology, combined with continued rigorous clinical research can be used to correct these limitations.

Idaho Transportation Department : 2010 research program peer exchange.

DOT National Transportation Integrated Search

2010-05-01

The objectives of the peer exchange were to: : 1. Identify strengths, challenges, and opportunities for program and project management; : 2. Understand management expectations of the ITD Research Program; : 3. Review processes for project selection a...

IRIS Toxicological Review for Carbon Tetrachloride ...

EPA Pesticide Factsheets

EPA released the draft report,Toxicological Review for Carbon Tetrachloride(Interagency Science Discussion Draft), that was distributed to Federal agencies and White House Offices for comment during the Science Discussion step of the IRIS Assessment Development Process. Comments received from other Federal agencies and White House Offices are provided below with external peer review panel comments. EPA is conducting a peer review of the scientific basis supporting the human health hazard and dose-response assessment of carbon tetrachloride that will appear on the Integrated Risk Information System (IRIS) database.

IRIS Toxicological Review of 2-Hexanone (External Review ...

EPA Pesticide Factsheets

EPA is conducting a peer review of the scientific basis supporting the human health hazard and dose-response assessment of 2-hexanone that will appear on the Integrated Risk Information System (IRIS) database. Peer review is meant to ensure that science is used credibly and appropriately in derivation of the dose-response assessments and toxicological characterization. 2-Hexanone was nominated for IRIS assessment because of its frequent detection at sites nation-wide and its occurrence as a byproduct of certain industrial processes.

IRIS Toxicological Review of Ethylene Glycol Mono-Butyl ...

EPA Pesticide Factsheets

EPA released the draft report, Toxicological Review for Ethylene Glycol Mono-Butyl Ether , that was distributed to Federal agencies and White House Offices for comment during the Science Discussion step of the IRIS Assessment Development Process. Comments received from other Federal agencies and White House Offices are provided below with external peer review panel comments. EPA is conducting a peer review of the scientific basis supporting the human health hazard and dose-response assessment of EGBE that will appear on the Integrated Risk Information System (IRIS) database.

Using Normalization Process Theory in feasibility studies and process evaluations of complex healthcare interventions: a systematic review.

PubMed

May, Carl R; Cummings, Amanda; Girling, Melissa; Bracher, Mike; Mair, Frances S; May, Christine M; Murray, Elizabeth; Myall, Michelle; Rapley, Tim; Finch, Tracy

2018-06-07

Normalization Process Theory (NPT) identifies, characterises and explains key mechanisms that promote and inhibit the implementation, embedding and integration of new health techniques, technologies and other complex interventions. A large body of literature that employs NPT to inform feasibility studies and process evaluations of complex healthcare interventions has now emerged. The aims of this review were to review this literature; to identify and characterise the uses and limits of NPT in research on the implementation and integration of healthcare interventions; and to explore NPT's contribution to understanding the dynamics of these processes. A qualitative systematic review was conducted. We searched Web of Science, Scopus and Google Scholar for articles with empirical data in peer-reviewed journals that cited either key papers presenting and developing NPT, or the NPT Online Toolkit ( www.normalizationprocess.org ). We included in the review only articles that used NPT as the primary approach to collection, analysis or reporting of data in studies of the implementation of healthcare techniques, technologies or other interventions. A structured data extraction instrument was used, and data were analysed qualitatively. Searches revealed 3322 citations. We show that after eliminating 2337 duplicates and broken or junk URLs, 985 were screened as titles and abstracts. Of these, 101 were excluded because they did not fit the inclusion criteria for the review. This left 884 articles for full-text screening. Of these, 754 did not fit the inclusion criteria for the review. This left 130 papers presenting results from 108 identifiable studies to be included in the review. NPT appears to provide researchers and practitioners with a conceptual vocabulary for rigorous studies of implementation processes. It identifies, characterises and explains empirically identifiable mechanisms that motivate and shape implementation processes. Taken together, these mean that analyses using NPT can effectively assist in the explanation of the success or failure of specific implementation projects. Ten percent of papers included critiques of some aspect of NPT, with those that did mainly focusing on its terminology. However, two studies critiqued NPT emphasis on agency, and one study critiqued NPT for its normative focus. This review demonstrates that researchers found NPT useful and applied it across a wide range of interventions. It has been effectively used to aid intervention development and implementation planning as well as evaluating and understanding implementation processes themselves. In particular, NPT appears to have offered a valuable set of conceptual tools to aid understanding of implementation as a dynamic process.

Assessing the state of knowledge of utility-scale wind energy development and operation on non-volant terrestrial and marine wildlife

USGS Publications Warehouse

Lovich, Jeffrey E.; Ennen, Joshua R.

2013-01-01

A great deal has been published in the scientific literature regarding the effects of wind energy development and operation on volant (flying) wildlife including birds and bats, although knowledge of how to mitigate negative impacts is still imperfect. We reviewed the peer-reviewed scientific literature for information on the known and potential effects of utility-scale wind energy development and operation (USWEDO) on terrestrial and marine non-volant wildlife and found that very little has been published on the topic. Following a similar review for solar energy we identified known and potential effects due to construction and eventual decommissioning of wind energy facilities. Many of the effects are similar and include direct mortality, environmental impacts of destruction and modification of habitat including impacts of roads, and offsite impacts related to construction material acquisition, processing and transportation. Known and potential effects due to operation and maintenance of facilities include habitat fragmentation and barriers to gene flow, as well as effects due to noise, vibration and shadow flicker, electromagnetic field generation, macro- and micro-climate change, predator attraction, and increased fire risk. The scarcity of before-after-control-impact studies hinders the ability to rigorously quantify the effects of USWEDO on non-volant wildlife. We conclude that more empirical data are currently needed to fully assess the impact of USWEDO on non-volant wildlife.

Outstanding reviewers 2014

NASA Astrophysics Data System (ADS)

2015-09-01

Every article published in this Journal goes through a rigorous review process. The reviewers are experts in their field, and undertake this service voluntarily with advancement of their fields as the only motivation. We acknowledge our debt to the reviewers for this service and in an earlier issue (Quaternary Science Reviews, Volume 107, Pages 276-280, http://dx.doi.org/10.1016/S0277-3791(14)00458-2)

"She's Weird!"--The Social Construction of Bullying in School: A Review of Qualitative Research

ERIC Educational Resources Information Center

Thornberg, Robert

2011-01-01

Qualitative research provides opportunities to study bullying and peer harassment as social processes, interactions and meaning-making in the everyday context of particular settings. It offers the possibility of developing a deep understanding of the culture and group processes of bullying and the participants' perspectives on peer harassment as…

Outcomes of Synergetic Peer Assessment: First-Year Experience

ERIC Educational Resources Information Center

Hodgson, Paula; Chan, Kitty; Liu, Justina

2014-01-01

Active participation in learning activities and reviewing assessment activity can facilitate learners engaged in these processes. This case study reports student experiences of the process of peer assessment with teacher guidance in a group project for a first-year nursing course with 153 students. Twenty groups of students were assigned roles in…

Understanding the Federal Proposal Review Process.

ERIC Educational Resources Information Center

Cavin, Janis I.

Information on the peer review process for the evaluation of federal grant proposals is presented to help college grants administrators and faculty develop good proposals. This guidebook provides an overview of the policies and conventions that govern the review and selection of proposals for funding, and details the review procedures of the…

Preprinting Microbiology

PubMed Central

2017-01-01

ABSTRACT The field of microbiology has experienced significant growth due to transformative advances in technology and the influx of scientists driven by a curiosity to understand how microbes sustain myriad biochemical processes that maintain Earth. With this explosion in scientific output, a significant bottleneck has been the ability to rapidly disseminate new knowledge to peers and the public. Preprints have emerged as a tool that a growing number of microbiologists are using to overcome this bottleneck. Posting preprints can help to transparently recruit a more diverse pool of reviewers prior to submitting to a journal for formal peer review. Although the use of preprints is still limited in the biological sciences, early indications are that preprints are a robust tool that can complement and enhance peer-reviewed publications. As publishing moves to embrace advances in Internet technology, there are many opportunities for preprints and peer-reviewed journals to coexist in the same ecosystem. PMID:28536284

Preprinting Microbiology.

PubMed

Schloss, Patrick D

2017-05-23

The field of microbiology has experienced significant growth due to transformative advances in technology and the influx of scientists driven by a curiosity to understand how microbes sustain myriad biochemical processes that maintain Earth. With this explosion in scientific output, a significant bottleneck has been the ability to rapidly disseminate new knowledge to peers and the public. Preprints have emerged as a tool that a growing number of microbiologists are using to overcome this bottleneck. Posting preprints can help to transparently recruit a more diverse pool of reviewers prior to submitting to a journal for formal peer review. Although the use of preprints is still limited in the biological sciences, early indications are that preprints are a robust tool that can complement and enhance peer-reviewed publications. As publishing moves to embrace advances in Internet technology, there are many opportunities for preprints and peer-reviewed journals to coexist in the same ecosystem. Copyright © 2017 Schloss.

Calibrated peer review assignments for the earth sciences

USGS Publications Warehouse

Rudd, J.A.; Wang, V.Z.; Cervato, C.; Ridky, R.W.

2009-01-01

Calibrated Peer Review ??? (CPR), a web-based instructional tool developed as part of the National Science Foundation reform initiatives in undergraduate science education, allows instructors to incorporate multiple writing assignments in large courses without overwhelming the instructor. This study reports successful implementation of CPR in a large, introductory geology course and student learning of geoscience content. For each CPR assignment in this study, students studied web-based and paper resources, wrote an essay, and reviewed seven essays (three from the instructor, three from peers, and their own) on the topic. Although many students expressed negative attitudes and concerns, particularly about the peer review process of this innovative instructional approach, they also recognized the learning potential of completing CPR assignments. Comparing instruction on earthquakes and plate boundaries using a CPR assignment vs. an instructional video lecture and homework essay with extensive instructor feedback, students mastered more content via CPR instruction.

Manuscript peer review at the AJR: facts, figures, and quality assessment.

PubMed

Friedman, D P

1995-04-01

Concern by the government, funding institutions, and the public for quality assurance in all aspects of medical endeavors mandates critical examination of various professional activities. Although peer review is generally regarded as the best system for selecting and improving scientific papers for publication, the efficacy of this process has never been proved. Moreover, the administrative functions of the editorial staff are often poorly understood. The purpose of this article is to make peer review a the AJR less esoteric and more understandable by quantifying some of its activities. This information is then assessed as it relates to the quality of this important step in scientific publication.

How to Become a More Effective Reviewer

ERIC Educational Resources Information Center

Snyder, Kate E.

2018-01-01

Effective peer review is a critical element of the scientific process, but it is one that can be daunting for new reviewers. In this article, the author shares guidelines she has learned on how to review, based on her personal process and the literature on reviewing, in the hopes that new and experienced reviewers alike can use these…

Checklist for Early Recognition and Treatment of Acute Illness (CERTAIN): evolution of a content management system for point-of-care clinical decision support.

PubMed

Barwise, Amelia; Garcia-Arguello, Lisbeth; Dong, Yue; Hulyalkar, Manasi; Vukoja, Marija; Schultz, Marcus J; Adhikari, Neill K J; Bonneton, Benjamin; Kilickaya, Oguz; Kashyap, Rahul; Gajic, Ognjen; Schmickl, Christopher N

2016-10-03

The Checklist for Early Recognition and Treatment of Acute Illness (CERTAIN) is an international collaborative project with the overall objective of standardizing the approach to the evaluation and treatment of critically ill patients world-wide, in accordance with best-practice principles. One of CERTAIN's key features is clinical decision support providing point-of-care information about common acute illness syndromes, procedures, and medications in an index card format. This paper describes 1) the process of developing and validating the content for point-of-care decision support, and 2) the content management system that facilitates frequent peer-review and allows rapid updates of content across different platforms (CERTAIN software, mobile apps, pdf-booklet) and different languages. Content was created based on survey results of acute care providers and validated using an open peer-review process. Over a 3 year period, CERTAIN content expanded to include 67 syndrome cards, 30 procedure cards, and 117 medication cards. 127 (59 %) cards have been peer-reviewed so far. Initially MS Word® and Dropbox® were used to create, store, and share content for peer-review. Recently Google Docs® was used to make the peer-review process more efficient. However, neither of these approaches met our security requirements nor has the capacity to instantly update the different CERTAIN platforms. Although we were able to successfully develop and validate a large inventory of clinical decision support cards in a short period of time, commercially available software solutions for content management are suboptimal. Novel custom solutions are necessary for efficient global point of care content system management.

What's so Important about Peer Review of Teaching Portfolio Components? An Exploratory Analysis of Peer-Review Episodes within ETPP. Research Brief

ERIC Educational Resources Information Center

Turns, Jennifer; Yellin, Jessica; Huang, Yi-Min; Gygi, Kathleen

2007-01-01

Understanding and promoting effective teaching are central concerns of the engineering education community. This paper reports on research to investigate the processes by which construction of teaching portfolios in a socially supportive context can promote the advancement of teaching knowledge and ability. By characterizing how a specific…

Assessment of Programming Language Learning Based on Peer Code Review Model: Implementation and Experience Report

ERIC Educational Resources Information Center

Wang, Yanqing; Li, Hang; Feng, Yuqiang; Jiang, Yu; Liu, Ying

2012-01-01

The traditional assessment approach, in which one single written examination counts toward a student's total score, no longer meets new demands of programming language education. Based on a peer code review process model, we developed an online assessment system called "EduPCR" and used a novel approach to assess the learning of computer…

HST Peer Review, Where We've Been, Where We Are Now and Possibly Where the Future Lies

NASA Astrophysics Data System (ADS)

Blacker, Brett S.; Macchetto, Duccio; Meylan, Georges; Stanghellini, Letizia; van der Marel, Roeland P.

2002-12-01

In some eyes, the Phase I proposal selection process is the most important activity handled by the Space Telescope Science Institute (STScI). Proposing for HST and other missions consists of requesting observing time and/or archival research funding. This step is called Phase I, where the scientific merit of a proposal is considered by a community based peer-review process. Accepted proposals then proceed thru Phase II, where the observations are specified in sufficient detail to enable scheduling on the telescope. Each cycle the Hubble Space Telescope (HST) Telescope Allocation Committee (TAC) reviews proposals and awards observing time that is valued at $0.5B, when the total expenditures for HST over its lifetime are figured on an annual basis. This is in fact a very important endeavor that we continue to fine-tune and tweak. This process is open to the science community and we constantly receive comments and praise for this process. Several cycles ago we instituted several significant changes to the process to address concerns such as: Fewer, broader panels, with redundancy to avoid conflicts of interest; Redefinition of the TAC role, to focus on Larger programs; and incentives for the panels to award time to medium sized proposals. In the last cycle, we offered new initiatives to try to enhance the scientific output of the telescope. Some of these initiatives were: Hubble Treasury Program; AR Legacy Program; and the AR Theory Program. This paper will outline the current HST Peer review process. We will discuss why we made changes and how we made changes from our original system. We will also discuss some ideas as to where we may go in the future to generate a stronger science program for HST and to reduce the burden on the science community. This paper is an update of the status of the HST Peer Review Process that was described in the published paper "Evolution of the HST Proposal Selection Process".

Virginia's transportation research peer exchange.

DOT National Transportation Integrated Search

2004-01-01

To be eligible for managing State Planning and Research (SP & R) funds, a state must agree to a peer review of its management process with regard to Research, Development, and Technology Transfer (RD & T2) efforts. The Federal Highway Administration ...

Development, implementation and evaluation of a peer review of teaching (PRoT) initiative in nursing education.

PubMed

Mager, Diana R; Kazer, Meredith W; Conelius, Jaclyn; Shea, Joyce; Lippman, Doris T; Torosyan, Roben; Nantz, Kathryn

2014-06-03

For many years, an area of research in higher education has been emerging around the development and implementation of fair and effective peer evaluation programs. Recently, a new body of knowledge has developed regarding the development and implementation of fair and effective peer evaluation programs resulting in formative and summative evaluations. The purpose of this article is to describe the development, implementation, and evaluation of a peer review of teaching (PRoT) program for nursing faculty, initiated at one small comprehensive university in the northeastern United States. Pairs of nursing faculty evaluated each other's teaching, syllabi, and course materials after collaborating in a pre-evaluation conference to discuss goals of the classroom visit. Qualitative data gathered in post project focus groups revealed that faculty found their modified PRoT process to be a mutually beneficial experience that was more useful, flexible and collegial, and less stressful than their previous evaluation process.

Commercial Lighting Solutions Webtool Peer Review Report, Office Solutions

DOE Office of Scientific and Technical Information (OSTI.GOV)

Beeson, Tracy A.; Jones, Carol C.

2010-02-01

The Commercial Lighting Solutions (CLS) project directly supports the U.S. Department of Energy’s Commercial Building Energy Alliance efforts to design high performance buildings. CLS creates energy efficient best practice lighting designs for widespread use, and they are made available to users via an interactive webtool that both educates and guides the end user through the application of the Lighting Solutions. This report summarizes the peer review of the CLS webtool for offices. The methodology for the peer review process included data collection (stakeholder input), analysis of the comments, and organization of the input into categories for prioritization of the commentsmore » against a set of criteria. Based on this process, recommendations were developed for the release of version 2.0 of the webtool at the Lightfair conference in Las Vegas in May 2010. The report provides a list of the top ten most significant and relevant improvements that will be made within the webtool for version 2.0 as well as appendices containing the comments and short-term priorities in additional detail. Peer review comments that are considered high priority by the reviewers and the CLS team but cannot be completed for Version 2.0 are listed as long-term recommendations.« less

A systematic review of nursing research priorities on health system and services in the Americas.

PubMed

Garcia, Alessandra Bassalobre; Cassiani, Silvia Helena De Bortoli; Reveiz, Ludovic

2015-03-01

To systematically review literature on priorities in nursing research on health systems and services in the Region of the Americas as a step toward developing a nursing research agenda that will advance the Regional Strategy for Universal Access to Health and Universal Health Coverage. This was a systematic review of the literature available from the following databases: Web of Science, PubMed, LILACS, and Google. Documents considered were published in 2008-2014; in English, Spanish, or Portuguese; and addressed the topic in the Region of the Americas. The documents selected had their priority-setting process evaluated according to the "nine common themes for good practice in health research priorities." A content analysis collected all study questions and topics, and sorted them by category and subcategory. Of 185 full-text articles/documents that were assessed for eligibility, 23 were selected: 12 were from peer-reviewed journals; 6 from nursing publications; 4 from Ministries of Health; and 1 from an international organization. Journal publications had stronger methodological rigor; the majority did not present a clear implementation or evaluation plan. After compiling the 444 documents' study questions and topics, the content analysis resulted in a document with 5 categories and 16 subcategories regarding nursing research priorities on health systems and services. Research priority-setting is a highly important process for health services improvement and resources optimization, but implementation and evaluation plans are rarely included. The resulting document will serve as basis for the development of a new nursing research agenda focused on health systems and services, and shaped to advance universal health coverage and universal access to health.

Impact of peer review audit on occupational health report quality.

PubMed

Lalloo, D; Demou, E; Macdonald, E B

2015-08-01

In a previous report, we described the implementation of a formal process for peer review of occupational health (OH) reports and a method of assessment of the outcomes of this process. The initial audit identified that 27% of OH reports required modifications. To assess formally, following implementation of this process, if changes in practice had occurred, i.e. whether fewer deficiencies were being identified in reports. We repeated a prospective internal audit of all peer reviewed OH reports between September and November 2011. We used an abbreviated assessment form, based on questions 4-8 and 10-12 of the modified SAIL (Sheffield Assessment Instrument for Letters), with four possible outcomes: no action, no changes made to report following discussion with author, changes made without discussion with author and changes made following discussion with author. One hundred seventy-three reports by 10 clinicians were audited. The audit identified a 13% reduction in OH reports requiring modifications (from 27 to 14%) compared with the previous cycle. Where modifications were required, 8% of these were related to minor typographical, spelling and grammar errors and 6% were for more complex reasons. Implementation of this process also produced a reduction in clinical complaints about OH reports from customers, from three in the preceding year to none 2 years later. Peer review improved the standard of OH reports and was associated with a reduction in customer complaints about reports. © The Author 2015. Published by Oxford University Press on behalf of the Society of Occupational Medicine.

Establishing an Online HIV Peer Helping Programme: A Review of Process Challenges and Lessons Learned

ERIC Educational Resources Information Center

Harris, Gregory E.; Corcoran, Valerie; Myles, Adam; Lundrigan, Philip; White, Robert; Greidanus, Elaine; Savage, Stephanie L.; Pope, Leslie; McDonald, James; Yetman, Gerard

2015-01-01

Background: Online peer support can be a valuable approach to helping people living with HIV, especially in regions with large rural populations and relatively centralised HIV services. Design: This paper focuses on a community-university partnership aimed at developing an online peer support programme in the Canadian province of Newfoundland and…

Promoting Early Adolescents' Achievement and Peer Relationships: The Effects of Cooperative, Competitive, and Individualistic Goal Structures

ERIC Educational Resources Information Center

Roseth, Cary J.; Johnson, David W.; Johnson, Roger T.

2008-01-01

Emphasizing the developmental need for positive peer relationships, in this study the authors tested a social-contextual view of the mechanisms and processes by which early adolescents' achievement and peer relationships may be promoted simultaneously. Meta-analysis was used to review 148 independent studies comparing the relative effectiveness of…

Standardizing the evaluation of scientific and academic performance in neurosurgery--critical review of the "h" index and its variants.

PubMed

Aoun, Salah G; Bendok, Bernard R; Rahme, Rudy J; Dacey, Ralph G; Batjer, H Hunt

2013-11-01

Assessing the academic impact and output of scientists and physicians is essential to the academic promotion process and has largely depended on peer review. The inherent subjectivity of peer review, however, has led to an interest to incorporate objective measures into more established methods of academic assessment and promotion. Journal impact factor has been used to add objectivity to the process but this index alone does not capture all aspects of academic impact and achievement. The "h" index and its variants have been designed to compensate for these shortcomings, and have been successfully used in the fields of physics, mathematics, and biology, and more recently in medicine. Leaders in academic neurosurgery should be aware of the advantages offered by each of these indices, as well as of their individual shortcomings, to be able to efficiently use them to refine the peer-review process. This review critically analyzes indices that are currently available to evaluate the academic impact of scientists and physicians. These indices include the total citation count, the total number of papers, the impact factor, as well as the "h" index with eight of its most common variants. The analysis focuses on their use in the field of academic neurosurgery, and discusses means to implement them in current review processes. Copyright © 2013 Elsevier Inc. All rights reserved.

Message Framing in Vaccine Communication: A Systematic Review of Published Literature.

PubMed

Penţa, Marcela A; Băban, Adriana

2018-03-01

Suboptimal vaccination rates are a significant problem in many countries today, in spite of improved access to vaccine services. As a result, there has been a recent expansion of research on how best to communicate about vaccines. The purpose of the present article is to provide an updated review of published, peer-reviewed empirical studies that examined the effectiveness of gain versus loss framing (i.e., goal framing) in the context of vaccine communication. To locate studies, we examined the reference list from the previous meta-analytic review (O'Keefe & Nan, 2012), and we conducted systematic searches across multiple databases. We included 34 studies in the qualitative synthesis. The relative effectiveness of goal-framed vaccine messages was often shown to depend on characteristics of the message recipient, perceived risk, or situational factors, yet most effects were inconsistent across studies, or simply limited by an insufficient number of studies. Methodological characteristics and variations are noted and discussed. The review points to several directions concerning moderators and mediators of framing effects where additional rigorous studies would be needed.

Sharing Research Models: Using Software Engineering Practices for Facilitation

PubMed Central

Bryant, Stephanie P.; Solano, Eric; Cantor, Susanna; Cooley, Philip C.; Wagener, Diane K.

2011-01-01

Increasingly, researchers are turning to computational models to understand the interplay of important variables on systems’ behaviors. Although researchers may develop models that meet the needs of their investigation, application limitations—such as nonintuitive user interface features and data input specifications—may limit the sharing of these tools with other research groups. By removing these barriers, other research groups that perform related work can leverage these work products to expedite their own investigations. The use of software engineering practices can enable managed application production and shared research artifacts among multiple research groups by promoting consistent models, reducing redundant effort, encouraging rigorous peer review, and facilitating research collaborations that are supported by a common toolset. This report discusses three established software engineering practices— the iterative software development process, object-oriented methodology, and Unified Modeling Language—and the applicability of these practices to computational model development. Our efforts to modify the MIDAS TranStat application to make it more user-friendly are presented as an example of how computational models that are based on research and developed using software engineering practices can benefit a broader audience of researchers. PMID:21687780

Facilitating Improvements in Laboratory Report Writing Skills with Less Grading: A Laboratory Report Peer-Review Process†

PubMed Central

Brigati, Jennifer R.; Swann, Jerilyn M.

2015-01-01

Incorporating peer-review steps in the laboratory report writing process provides benefits to students, but it also can create additional work for laboratory instructors. The laboratory report writing process described here allows the instructor to grade only one lab report for every two to four students, while giving the students the benefits of peer review and prompt feedback on their laboratory reports. Here we present the application of this process to a sophomore level genetics course and a freshman level cellular biology course, including information regarding class time spent on student preparation activities, instructor preparation, prerequisite student knowledge, suggested learning outcomes, procedure, materials, student instructions, faculty instructions, assessment tools, and sample data. T-tests comparing individual and group grading of the introductory cell biology lab reports yielded average scores that were not significantly different from each other (p = 0.13, n = 23 for individual grading, n = 6 for group grading). T-tests also demonstrated that average laboratory report grades of students using the peer-review process were not significantly different from those of students working alone (p = 0.98, n = 9 for individual grading, n = 6 for pair grading). While the grading process described here does not lead to statistically significant gains (or reductions) in student learning, it allows student learning to be maintained while decreasing instructor workload. This reduction in workload could allow the instructor time to pursue other high-impact practices that have been shown to increase student learning. Finally, we suggest possible modifications to the procedure for application in a variety of settings. PMID:25949758

Methods used and lessons learnt in conducting document reviews of medical and allied health curricula - a key step in curriculum evaluation.

PubMed

Rohwer, Anke; Schoonees, Anel; Young, Taryn

2014-11-02

This paper describes the process, our experience and the lessons learnt in doing document reviews of health science curricula. Since we could not find relevant literature to guide us on how to approach these reviews, we feel that sharing our experience would benefit researchers embarking on similar projects. We followed a rigorous, transparent, pre-specified approach that included the preparation of a protocol, a pre-piloted data extraction form and coding schedule. Data were extracted, analysed and synthesised. Quality checks were included at all stages of the process. The main lessons we learnt related to time and project management, continuous quality assurance, selecting the software that meets the needs of the project, involving experts as needed and disseminating the findings to relevant stakeholders. A complete curriculum evaluation comprises, apart from a document review, interviews with students and lecturers to assess the learnt and taught curricula respectively. Rigorous methods must be used to ensure an objective assessment.

The Challenge of Timely, Responsive and Rigorous Ethics Review of Disaster Research: Views of Research Ethics Committee Members.

PubMed

Hunt, Matthew; Tansey, Catherine M; Anderson, James; Boulanger, Renaud F; Eckenwiler, Lisa; Pringle, John; Schwartz, Lisa

2016-01-01

Research conducted following natural disasters such as earthquakes, floods or hurricanes is crucial for improving relief interventions. Such research, however, poses ethical, methodological and logistical challenges for researchers. Oversight of disaster research also poses challenges for research ethics committees (RECs), in part due to the rapid turnaround needed to initiate research after a disaster. Currently, there is limited knowledge available about how RECs respond to and appraise disaster research. To address this knowledge gap, we investigated the experiences of REC members who had reviewed disaster research conducted in low- or middle-income countries. We used interpretive description methodology and conducted in-depth interviews with 15 respondents. Respondents were chairs, members, advisors, or coordinators from 13 RECs, including RECs affiliated with universities, governments, international organizations, a for-profit REC, and an ad hoc committee established during a disaster. Interviews were analyzed inductively using constant comparative techniques. Through this process, three elements were identified as characterizing effective and high-quality review: timeliness, responsiveness and rigorousness. To ensure timeliness, many RECs rely on adaptations of review procedures for urgent protocols. Respondents emphasized that responsive review requires awareness of and sensitivity to the particularities of disaster settings and disaster research. Rigorous review was linked with providing careful assessment of ethical considerations related to the research, as well as ensuring independence of the review process. Both the frequency of disasters and the conduct of disaster research are on the rise. Ensuring effective and high quality review of disaster research is crucial, yet challenges, including time pressures for urgent protocols, exist for achieving this goal. Adapting standard REC procedures may be necessary. However, steps should be taken to ensure that ethics review of disaster research remains diligent and thorough.

The Challenge of Timely, Responsive and Rigorous Ethics Review of Disaster Research: Views of Research Ethics Committee Members

PubMed Central

Hunt, Matthew; Tansey, Catherine M.

2016-01-01

Background Research conducted following natural disasters such as earthquakes, floods or hurricanes is crucial for improving relief interventions. Such research, however, poses ethical, methodological and logistical challenges for researchers. Oversight of disaster research also poses challenges for research ethics committees (RECs), in part due to the rapid turnaround needed to initiate research after a disaster. Currently, there is limited knowledge available about how RECs respond to and appraise disaster research. To address this knowledge gap, we investigated the experiences of REC members who had reviewed disaster research conducted in low- or middle-income countries. Methods We used interpretive description methodology and conducted in-depth interviews with 15 respondents. Respondents were chairs, members, advisors, or coordinators from 13 RECs, including RECs affiliated with universities, governments, international organizations, a for-profit REC, and an ad hoc committee established during a disaster. Interviews were analyzed inductively using constant comparative techniques. Results Through this process, three elements were identified as characterizing effective and high-quality review: timeliness, responsiveness and rigorousness. To ensure timeliness, many RECs rely on adaptations of review procedures for urgent protocols. Respondents emphasized that responsive review requires awareness of and sensitivity to the particularities of disaster settings and disaster research. Rigorous review was linked with providing careful assessment of ethical considerations related to the research, as well as ensuring independence of the review process. Conclusion Both the frequency of disasters and the conduct of disaster research are on the rise. Ensuring effective and high quality review of disaster research is crucial, yet challenges, including time pressures for urgent protocols, exist for achieving this goal. Adapting standard REC procedures may be necessary. However, steps should be taken to ensure that ethics review of disaster research remains diligent and thorough. PMID:27327165

Selecting a measure for assessing secondary trauma in nurses.

PubMed

Watts, Jenny; Robertson, Noelle

2015-11-01

To summarise the usefulness of available psychometric tools in assessing secondary trauma in nursing staff and examine their limitations, as well as their strengths, to enable researchers to select the most suitable measures. Secondary trauma is an extreme persistent reaction that can be experienced by nursing staff following exposure to a potentially life-threatening situation. This relatively new concept is increasingly used to explore staff distress, but is complicated by various definitions. In this growing and popular field, few rigorously tested measures are used. Therefore, it is timely to examine the measures available and their robustness. In March 2014 the following databases were used: BNI, CINAHL, EMBASE, PILOTS, Medline, PsycINFO and the Cochrane Library. A systematic search of nurse and health research databases was conducted from 1980 to 2014 using the terms nurs* AND PTSD OR Posttraumatic Stress Disorder OR secondary trauma OR secondary traumatic stress OR STS OR compassion fatigue. To strengthen confidence in research findings and make the most useful contribution to practice, researchers should use the most rigorous measures available. Of the assessment tools used, the only one subject to robust peer review is the Secondary Traumatic Stress Scale (STSS). The scale most frequently used to assess secondary traumatic stress is the Professional Quality of Life Scale (ProQOL); its lack of psychometric evaluation is a potential weakness. CONCLUSION The STSS is the only validated tool reported in the peer-reviewed, published literature and the authors suggest greater application when secondary trauma is a suspected consequence of nursing work. Validated tools such as the HADS and GHQ-28 are more useful in assessing broader-based psychological morbidity. The authors suggest greater application of the STSS when secondary trauma is a suspected consequence of nursing work. Researchers interested in assessing more than trauma responses are advised to use HADS and GHQ-28.

Nuclear energy acceptance and potential role to meet future energy demand. Which technical/scientific achievements are needed?

DOE Office of Scientific and Technical Information (OSTI.GOV)

Schenkel, Roland

25 years after Chernobyl, the Fukushima disaster has changed the perspectives of nuclear power. The disaster has shed a negative light on the independence, reliability and rigor of the national nuclear regulator and plant operator and the usefulness of the international IAEA guidelines on nuclear safety. It has become clear that, in the light of the most severe earthquake in the history of Japan, the plants at Fukushima Daiichi were not adequately protected against tsunamis. Nuclear acceptance has suffered enormously and has changed the perspectives of nuclear energy dramatically in countries that have a very risk-sensitive population, Germany is anmore » example. The paper analyses the reactions in major countries and the expected impact on future deployment of reactors and on R and D activities. On the positive side, the disaster has demonstrated a remarkable robustness of most of the 14 reactors closest to the epicentre of the Tohoku Seaquake although not designed to an event of level 9.0. Public acceptance can only be regained with a rigorous and worldwide approach towards inherent reactor safety and design objectives that limit the impact of severe accidents to the plant itself (like many of the new Gen III reactors). A widespread release of radioactivity and the evacuation (temporary or permanent) of the population up to 30 km around a facility are simply not acceptable. Several countries have announced to request more stringent international standards for reactor safety. The IAEA should take this move forward and intensify and strengthen the different peer review mission schemes. The safety guidelines and peer reviews should in fact become legally binding for IAEA members. The paper gives examples of the new safety features developed over the last 20 years and which yield much safer reactors with lesser burden to the environment under severe accident conditions. The compatibility of these safety systems with the current concepts for fusion-fission hybrids, which have recently been proposed for energy production, is critically reviewed. There are major challenges remaining that are shortly outlined. Scientific/technical achievements that are required in the light of the Fukushima accident are highlighted.« less

Nuclear energy acceptance and potential role to meet future energy demand. Which technical/scientific achievements are needed?

NASA Astrophysics Data System (ADS)

Schenkel, Roland

2012-06-01

25 years after Chernobyl, the Fukushima disaster has changed the perspectives of nuclear power. The disaster has shed a negative light on the independence, reliability and rigor of the national nuclear regulator and plant operator and the usefulness of the international IAEA guidelines on nuclear safety. It has become clear that, in the light of the most severe earthquake in the history of Japan, the plants at Fukushima Daiichi were not adequately protected against tsunamis. Nuclear acceptance has suffered enormously and has changed the perspectives of nuclear energy dramatically in countries that have a very risk-sensitive population, Germany is an example. The paper analyses the reactions in major countries and the expected impact on future deployment of reactors and on R&D activities. On the positive side, the disaster has demonstrated a remarkable robustness of most of the 14 reactors closest to the epicentre of the Tohoku Seaquake although not designed to an event of level 9.0. Public acceptance can only be regained with a rigorous and worldwide approach towards inherent reactor safety and design objectives that limit the impact of severe accidents to the plant itself (like many of the new Gen III reactors). A widespread release of radioactivity and the evacuation (temporary or permanent) of the population up to 30 km around a facility are simply not acceptable. Several countries have announced to request more stringent international standards for reactor safety. The IAEA should take this move forward and intensify and strengthen the different peer review mission schemes. The safety guidelines and peer reviews should in fact become legally binding for IAEA members. The paper gives examples of the new safety features developed over the last 20 years and which yield much safer reactors with lesser burden to the environment under severe accident conditions. The compatibility of these safety systems with the current concepts for fusion-fission hybrids, which have recently been proposed for energy production, is critically reviewed. There are major challenges remaining that are shortly outlined. Scientific/technical achievements that are required in the light of the Fukushima accident are highlighted.

Helping working Equidae and their owners in developing countries: monitoring and evaluation of evidence-based interventions.

PubMed

Upjohn, Melissa M; Pfeiffer, Dirk U; Verheyen, Kristien L P

2014-02-01

There are an estimated 112 million Equidae (horses, donkeys, mules) in the developing world, providing essential resources for their owners' livelihoods and well-being. The impoverished situation of their owners and the often harsh conditions in which they work mean that the animals' welfare is a cause for concern. A number of equine non-governmental organisations (NGOs) operate within working equid communities providing veterinary care, education and training programmes aimed at improving equine welfare. However, there is little published information available that describes monitoring and evaluation (M&E) of such interventions using objective outcome-based indicators and where baseline data are available. The aim of this paper is to summarise the peer-reviewed reports of M&E in this sector and identify the key issues which need to be addressed in ensuring that such evaluations provide useful information on the work of these organisations. A rigorous evidence base for designing future interventions will provide an opportunity for enhancing the effectiveness of working equid NGO operations. Increased availability of M&E reports in the peer-reviewed literature will enable NGOs to learn from one another and disseminate to a wider audience information on the role of working Equidae and the issues they face. Copyright © 2013 Elsevier Ltd. All rights reserved.

Methods used in adaptation of health-related guidelines: A systematic survey.

PubMed

Abdul-Khalek, Rima A; Darzi, Andrea J; Godah, Mohammad W; Kilzar, Lama; Lakis, Chantal; Agarwal, Arnav; Abou-Jaoude, Elias; Meerpohl, Joerg J; Wiercioch, Wojtek; Santesso, Nancy; Brax, Hneine; Schünemann, Holger; Akl, Elie A

2017-12-01

Adaptation refers to the systematic approach for considering the endorsement or modification of recommendations produced in one setting for application in another as an alternative to de novo development. To describe and assess the methods used for adapting health-related guidelines published in peer-reviewed journals, and to assess the quality of the resulting adapted guidelines. We searched Medline and Embase up to June 2015. We assessed the method of adaptation, and the quality of included guidelines. Seventy-two papers were eligible. Most adapted guidelines and their source guidelines were published by professional societies (71% and 68% respectively), and in high-income countries (83% and 85% respectively). Of the 57 adapted guidelines that reported any detail about adaptation method, 34 (60%) did not use a published adaptation method. The number (and percentage) of adapted guidelines fulfilling each of the ADAPTE steps ranged between 2 (4%) and 57 (100%). The quality of adapted guidelines was highest for the "scope and purpose" domain and lowest for the "editorial independence" domain (respective mean percentages of the maximum possible scores were 93% and 43%). The mean score for "rigor of development" was 57%. Most adapted guidelines published in peer-reviewed journals do not report using a published adaptation method, and their adaptation quality was variable.

28 CFR 34.109 - Qualifications of peer reviewers.

Code of Federal Regulations, 2010 CFR

2010-07-01

... Section 34.109 Judicial Administration DEPARTMENT OF JUSTICE OJJDP COMPETITION AND PEER REVIEW PROCEDURES Peer Review § 34.109 Qualifications of peer reviewers. The general reviewer qualification criteria to...). Additional details concerning peer reviewer qualifications are provided in the OJJDP “Peer Review Guideline”. ...

Review of HIV Testing Efforts in Historically Black Churches

PubMed Central

Pichon, Latrice Crystal; Powell, Terrinieka Williams

2015-01-01

This paper aims to critically assess the state of HIV testing in African American churches. A comprehensive review of peer-reviewed publications on HIV testing in church-based settings was conducted by two independent coders. Twenty-six papers published between 1991 and 2015, representing 24 unique projects, were identified addressing at least one dimension of HIV testing. Thirteen faith-based projects have implemented HIV testing events or had clergy promote the importance of testing and knowing one’s HIV status, but empirical data and rigorous study designs were limited. Only eight papers reported onsite HIV testing in churches. Less than 5% of the studies reported the percentage of congregants who returned for their test results. Finally, no study has examined at baseline or post-intervention behavioral intentions to be screened for HIV. Future research is needed to evaluate the effectiveness of HIV testing in churches and to explore the possibilities of the role of the church and leadership structure in the promotion of HIV treatment and care. PMID:26030470

Peer-supported review of teaching: an evaluation.

PubMed

Thampy, Harish; Bourke, Michael; Naran, Prasheena

2015-09-01

Peer-supported review (also called peer observation) of teaching is a commonly implemented method of ascertaining teaching quality that supplements student feedback. A large variety of scheme formats with rather differing purposes are described in the literature. They range from purely formative, developmental formats that facilitate a tutor's reflection of their own teaching to reaffirm strengths and identify potential areas for development through to faculty- or institution-driven summative quality assurance-based schemes. Much of the current literature in this field focuses within general higher education and on the development of rating scales, checklists or observation tools to help guide the process. This study reports findings from a qualitative evaluation of a purely formative peer-supported review of teaching scheme that was implemented for general practice clinical tutors at our medical school and describes tutors' attitudes and perceived benefits and challenges when undergoing observation.

Thank You to Our 2017 Peer Reviewers

NASA Astrophysics Data System (ADS)

Hauck, Steven A.; Baratoux, David; Stanley, Sabine; Stanley

2018-02-01

Science operates best by sharing accurate new knowledge in clear ways. In order to check our assumptions, our methods, and our interpretations of the observations, experiments, analyses, and calculations that we do, we ask others to look at our work. We call this peer review—other experts who were not involved in a given study read and critically evaluate the descriptions of our work. They look for completeness, accuracy, whether work is new, and how clearly we have written the descriptions. We continue to be humbled by the time, effort, and careful insights that our colleagues share with each other through the process of peer review. In 2017, JGR Planets benefited from more than 610 reviews provided by 398 of our peers for papers submitted to the journal. Thank you all for your awesome efforts toward advancing planetary science now and for the future.

Systematic review of the effectiveness of training programs in writing for scholarly publication, journal editing, and manuscript peer review (protocol).

PubMed

Galipeau, James; Moher, David; Skidmore, Becky; Campbell, Craig; Hendry, Paul; Cameron, D William; Hébert, Paul C; Palepu, Anita

2013-06-17

An estimated $100 billion is lost to 'waste' in biomedical research globally, annually, much of which comes from the poor quality of published research. One area of waste involves bias in reporting research, which compromises the usability of published reports. In response, there has been an upsurge in interest and research in the scientific process of writing, editing, peer reviewing, and publishing (that is, journalology) of biomedical research. One reason for bias in reporting and the problem of unusable reports could be due to authors lacking knowledge or engaging in questionable practices while designing, conducting, or reporting their research. Another might be that the peer review process for journal publication has serious flaws, including possibly being ineffective, and having poorly trained and poorly motivated reviewers. Similarly, many journal editors have limited knowledge related to publication ethics. This can ultimately have a negative impact on the healthcare system. There have been repeated calls for better, more numerous training opportunities in writing for publication, peer review, and publishing. However, little research has taken stock of journalology training opportunities or evaluations of their effectiveness. We will conduct a systematic review to synthesize studies that evaluate the effectiveness of training programs in journalology. A comprehensive three-phase search approach will be employed to identify evaluations of training opportunities, involving: 1) forward-searching using the Scopus citation database, 2) a search of the MEDLINE In-Process and Non-Indexed Citations, MEDLINE, Embase, ERIC, and PsycINFO databases, as well as the databases of the Cochrane Library, and 3) a grey literature search. This project aims to provide evidence to help guide the journalological training of authors, peer reviewers, and editors. While there is ample evidence that many members of these groups are not getting the necessary training needed to excel at their respective journalology-related tasks, little is known about the characteristics of existing training opportunities, including their effectiveness. The proposed systematic review will provide evidence regarding the effectiveness of training, therefore giving potential trainees, course designers, and decision-makers evidence to help inform their choices and policies regarding the merits of specific training opportunities or types of training.

The Joy of Teaching Literacy. The Thirty-Fourth Yearbook: A Double Peer Reviewed Publication of the Association of Literacy Educators and Researchers

ERIC Educational Resources Information Center

Marin, Linda, Ed.; Boggs, Merry, Ed.; Szabo, Susan, Ed.; Morrision, Timothy, Ed.; Garza-Garcia, Lizabeth, Ed.

2012-01-01

The Association of Literacy Educators and Researchers (ALER) Yearbook, Volume 34, includes papers presented at the annual conference, which have gone through a double peer review process. It also includes the Presidential Address and the keynote addresses given at the conference. For ALER's 55th annual meeting, the Association of Literacy…

Pedagogical Merit Review of Animal Use for Education in Canada

PubMed Central

Griffin, Gilly

2016-01-01

There are two components to the review of animal based protocols in Canada: review for the merit of the study itself, and review of the ethical acceptability of the work. Despite the perceived importance for the quality assurance these reviews provide; there are few studies of the peer-based merit review system for animal-based protocols for research and education. Institutional animal care committees (ACC)s generally rely on the external peer review of scientific merit for animal-based research. In contrast, peer review for animal based teaching/training is dependent on the review of pedagogical merit carried out by the ACC itself or another committee within the institution. The objective of this study was to evaluate the views of ACC members about current practices and policies as well as alternate policies for the review of animal based teaching/training. We conducted a national web-based survey of ACC members with both quantitative and qualitative response options. Responses from 167 ACC members indicated broad concerns about administrative burden despite strong support for both the current and alternate policies. Participants’ comments focused mostly on the merit review process (54%) relative to the efficiency (21%), impact (13%), and other (12%) aspects of evaluation. Approximately half (49%) of the comments were classified into emergent themes that focused on some type of burden: burden from additional pedagogical merit review (16%), a limited need for the review (12%), and a lack of resources (expertise 11%; people/money 10%). Participants indicated that the current system for pedagogical merit review is effective (60%); but most also indicated that there was at least some challenge (86%) with the current peer review process. There was broad support for additional guidance on the justification, criteria, types of animal use, and objectives of pedagogical merit review. Participants also supported the ethical review and application of the Three Rs in the review process. A clear priority from participants in the survey was updating guidance to better facilitate the merit review process of animal-based protocols for education. Balancing the need for improved guidance with the reality of limited resources at local institutions will be essential to do this successfully; a familiar dilemma to both scientists and policy makers alike. PMID:27352243

Pedagogical Merit Review of Animal Use for Education in Canada.

PubMed

Avey, Marc T; Griffin, Gilly

2016-01-01

There are two components to the review of animal based protocols in Canada: review for the merit of the study itself, and review of the ethical acceptability of the work. Despite the perceived importance for the quality assurance these reviews provide; there are few studies of the peer-based merit review system for animal-based protocols for research and education. Institutional animal care committees (ACC)s generally rely on the external peer review of scientific merit for animal-based research. In contrast, peer review for animal based teaching/training is dependent on the review of pedagogical merit carried out by the ACC itself or another committee within the institution. The objective of this study was to evaluate the views of ACC members about current practices and policies as well as alternate policies for the review of animal based teaching/training. We conducted a national web-based survey of ACC members with both quantitative and qualitative response options. Responses from 167 ACC members indicated broad concerns about administrative burden despite strong support for both the current and alternate policies. Participants' comments focused mostly on the merit review process (54%) relative to the efficiency (21%), impact (13%), and other (12%) aspects of evaluation. Approximately half (49%) of the comments were classified into emergent themes that focused on some type of burden: burden from additional pedagogical merit review (16%), a limited need for the review (12%), and a lack of resources (expertise 11%; people/money 10%). Participants indicated that the current system for pedagogical merit review is effective (60%); but most also indicated that there was at least some challenge (86%) with the current peer review process. There was broad support for additional guidance on the justification, criteria, types of animal use, and objectives of pedagogical merit review. Participants also supported the ethical review and application of the Three Rs in the review process. A clear priority from participants in the survey was updating guidance to better facilitate the merit review process of animal-based protocols for education. Balancing the need for improved guidance with the reality of limited resources at local institutions will be essential to do this successfully; a familiar dilemma to both scientists and policy makers alike.