A multi-disciplinary perspective on emergent and future innovations in peer review

PubMed Central

Tennant, Jonathan P.; Dugan, Jonathan M.; Graziotin, Daniel; Jacques, Damien C.; Waldner, François; Mietchen, Daniel; Elkhatib, Yehia; B. Collister, Lauren; Pikas, Christina K.; Crick, Tom; Masuzzo, Paola; Caravaggi, Anthony; Berg, Devin R.; Niemeyer, Kyle E.; Ross-Hellauer, Tony; Mannheimer, Sara; Rigling, Lillian; Katz, Daniel S.; Greshake Tzovaras, Bastian; Pacheco-Mendoza, Josmel; Fatima, Nazeefa; Poblet, Marta; Isaakidis, Marios; Irawan, Dasapta Erwin; Renaut, Sébastien; Madan, Christopher R.; Matthias, Lisa; Nørgaard Kjær, Jesper; O'Donnell, Daniel Paul; Neylon, Cameron; Kearns, Sarah; Selvaraju, Manojkumar; Colomb, Julien

2017-01-01

Peer review of research articles is a core part of our scholarly communication system. In spite of its importance, the status and purpose of peer review is often contested. What is its role in our modern digital research and communications infrastructure? Does it perform to the high standards with which it is generally regarded? Studies of peer review have shown that it is prone to bias and abuse in numerous dimensions, frequently unreliable, and can fail to detect even fraudulent research. With the advent of web technologies, we are now witnessing a phase of innovation and experimentation in our approaches to peer review. These developments prompted us to examine emerging models of peer review from a range of disciplines and venues, and to ask how they might address some of the issues with our current systems of peer review. We examine the functionality of a range of social Web platforms, and compare these with the traits underlying a viable peer review system: quality control, quantified performance metrics as engagement incentives, and certification and reputation. Ideally, any new systems will demonstrate that they out-perform and reduce the biases of existing models as much as possible. We conclude that there is considerable scope for new peer review initiatives to be developed, each with their own potential issues and advantages. We also propose a novel hybrid platform model that could, at least partially, resolve many of the socio-technical issues associated with peer review, and potentially disrupt the entire scholarly communication system. Success for any such development relies on reaching a critical threshold of research community engagement with both the process and the platform, and therefore cannot be achieved without a significant change of incentives in research environments. PMID:29188015

A multi-disciplinary perspective on emergent and future innovations in peer review.

PubMed

Tennant, Jonathan P; Dugan, Jonathan M; Graziotin, Daniel; Jacques, Damien C; Waldner, François; Mietchen, Daniel; Elkhatib, Yehia; B Collister, Lauren; Pikas, Christina K; Crick, Tom; Masuzzo, Paola; Caravaggi, Anthony; Berg, Devin R; Niemeyer, Kyle E; Ross-Hellauer, Tony; Mannheimer, Sara; Rigling, Lillian; Katz, Daniel S; Greshake Tzovaras, Bastian; Pacheco-Mendoza, Josmel; Fatima, Nazeefa; Poblet, Marta; Isaakidis, Marios; Irawan, Dasapta Erwin; Renaut, Sébastien; Madan, Christopher R; Matthias, Lisa; Nørgaard Kjær, Jesper; O'Donnell, Daniel Paul; Neylon, Cameron; Kearns, Sarah; Selvaraju, Manojkumar; Colomb, Julien

2017-01-01

Peer review of research articles is a core part of our scholarly communication system. In spite of its importance, the status and purpose of peer review is often contested. What is its role in our modern digital research and communications infrastructure? Does it perform to the high standards with which it is generally regarded? Studies of peer review have shown that it is prone to bias and abuse in numerous dimensions, frequently unreliable, and can fail to detect even fraudulent research. With the advent of web technologies, we are now witnessing a phase of innovation and experimentation in our approaches to peer review. These developments prompted us to examine emerging models of peer review from a range of disciplines and venues, and to ask how they might address some of the issues with our current systems of peer review. We examine the functionality of a range of social Web platforms, and compare these with the traits underlying a viable peer review system: quality control, quantified performance metrics as engagement incentives, and certification and reputation. Ideally, any new systems will demonstrate that they out-perform and reduce the biases of existing models as much as possible. We conclude that there is considerable scope for new peer review initiatives to be developed, each with their own potential issues and advantages. We also propose a novel hybrid platform model that could, at least partially, resolve many of the socio-technical issues associated with peer review, and potentially disrupt the entire scholarly communication system. Success for any such development relies on reaching a critical threshold of research community engagement with both the process and the platform, and therefore cannot be achieved without a significant change of incentives in research environments.

Using Nominal Group Technique to Develop a Consensus Derived Model for Peer Review of Teaching across a Multi-School Faculty

ERIC Educational Resources Information Center

Burrows, Tracy; Findlay, Naomi; Killen, Chloe; Dempsey, Shane E.; Hunter, Sharyn; Chiarelli, Pauline; Snodgrass, Suzanne

2011-01-01

This paper describes the development of a peer review of teaching model for the Faculty of Health at the University of Newcastle, Australia. The process involved using the nominal group technique to engage Faculty academic staff to consider seven key decision points that informed the development of the peer review of teaching model. Use of the…

Peer Review Documents Related to the Evaluation of ...

EPA Pesticide Factsheets

BMDS is one of the Agency's premier tools for estimating risk assessments, therefore the validity and reliability of its statistical models are of paramount importance. This page provides links to peer review and expert summaries of the BMDS application and its models as they were developed and eventually released documenting the rigorous review process taken to provide the best science tools available for statistical modeling. This page provides links to peer reviews and expert summaries of the BMDS applications and its models as they were developed and eventually released.

Redefining the Practice of Peer Review Through Intelligent Automation Part 1: Creation of a Standardized Methodology and Referenceable Database.

PubMed

Reiner, Bruce I

2017-10-01

Conventional peer review practice is compromised by a number of well-documented biases, which in turn limit standard of care analysis, which is fundamental to determination of medical malpractice. In addition to these intrinsic biases, other existing deficiencies exist in current peer review including the lack of standardization, objectivity, retrospective practice, and automation. An alternative model to address these deficiencies would be one which is completely blinded to the peer reviewer, requires independent reporting from both parties, utilizes automated data mining techniques for neutral and objective report analysis, and provides data reconciliation for resolution of finding-specific report differences. If properly implemented, this peer review model could result in creation of a standardized referenceable peer review database which could further assist in customizable education, technology refinement, and implementation of real-time context and user-specific decision support.

How Long Is Too Long in Contemporary Peer Review? Perspectives from Authors Publishing in Conservation Biology Journals

PubMed Central

Nguyen, Vivian M.; Haddaway, Neal R.; Gutowsky, Lee F. G.; Wilson, Alexander D. M.; Gallagher, Austin J.; Donaldson, Michael R.; Hammerschlag, Neil; Cooke, Steven J.

2015-01-01

Delays in peer reviewed publication may have consequences for both assessment of scientific prowess in academia as well as communication of important information to the knowledge receptor community. We present an analysis on the perspectives of authors publishing in conservation biology journals regarding their opinions on the importance of speed in peer-review as well as how to improve review times. Authors were invited to take part in an online questionnaire, of which the data was subjected to both qualitative (open coding, categorizing) and quantitative analyses (generalized linear models). We received 637 responses to 6,547 e-mail invitations sent. Peer-review speed was generally perceived as slow, with authors experiencing a typical turnaround time of 14 weeks while their perceived optimal review time was six weeks. Male and younger respondents seem to have higher expectations of review speed than females and older respondents. The majority of participants attributed lengthy review times to reviewer and editor fatigue, while editor persistence and journal prestige were believed to speed up the review process. Negative consequences of lengthy review times were perceived to be greater for early career researchers and to have impact on author morale (e.g. motivation or frustration). Competition among colleagues was also of concern to respondents. Incentivizing peer-review was among the top suggested alterations to the system along with training graduate students in peer-review, increased editorial persistence, and changes to the norms of peer-review such as opening the peer-review process to the public. It is clear that authors surveyed in this study viewed the peer-review system as under stress and we encourage scientists and publishers to push the envelope for new peer-review models. PMID:26267491

Evaluation of the Inhalation Carcinogenicity of Ethylene Oxide ...

EPA Pesticide Factsheets

EPA is seeking peer review of the scientific basis supporting the human health hazard and dose-response assessment of ethylene oxide (cancer) that will appear in the Integrated Risk Information System (IRIS) database. EPA seeks external peer review on how the Agency responded to the SAB panel recommendations, the exposure-response modeling of epidemiologic data, including new analyses since the 2007 external peer review, and on the adequacy, transparency, and clarity of the revised draft. The peer review will include an opportunity for the public to address the peer reviewers.

The Global Burden of Journal Peer Review in the Biomedical Literature: Strong Imbalance in the Collective Enterprise.

PubMed

Kovanis, Michail; Porcher, Raphaël; Ravaud, Philippe; Trinquart, Ludovic

2016-01-01

The growth in scientific production may threaten the capacity for the scientific community to handle the ever-increasing demand for peer review of scientific publications. There is little evidence regarding the sustainability of the peer-review system and how the scientific community copes with the burden it poses. We used mathematical modeling to estimate the overall quantitative annual demand for peer review and the supply in biomedical research. The modeling was informed by empirical data from various sources in the biomedical domain, including all articles indexed at MEDLINE. We found that for 2015, across a range of scenarios, the supply exceeded by 15% to 249% the demand for reviewers and reviews. However, 20% of the researchers performed 69% to 94% of the reviews. Among researchers actually contributing to peer review, 70% dedicated 1% or less of their research work-time to peer review while 5% dedicated 13% or more of it. An estimated 63.4 million hours were devoted to peer review in 2015, among which 18.9 million hours were provided by the top 5% contributing reviewers. Our results support that the system is sustainable in terms of volume but emphasizes a considerable imbalance in the distribution of the peer-review effort across the scientific community. Finally, various individual interactions between authors, editors and reviewers may reduce to some extent the number of reviewers who are available to editors at any point.

The Global Burden of Journal Peer Review in the Biomedical Literature: Strong Imbalance in the Collective Enterprise

PubMed Central

Porcher, Raphaël; Ravaud, Philippe; Trinquart, Ludovic

2016-01-01

The growth in scientific production may threaten the capacity for the scientific community to handle the ever-increasing demand for peer review of scientific publications. There is little evidence regarding the sustainability of the peer-review system and how the scientific community copes with the burden it poses. We used mathematical modeling to estimate the overall quantitative annual demand for peer review and the supply in biomedical research. The modeling was informed by empirical data from various sources in the biomedical domain, including all articles indexed at MEDLINE. We found that for 2015, across a range of scenarios, the supply exceeded by 15% to 249% the demand for reviewers and reviews. However, 20% of the researchers performed 69% to 94% of the reviews. Among researchers actually contributing to peer review, 70% dedicated 1% or less of their research work-time to peer review while 5% dedicated 13% or more of it. An estimated 63.4 million hours were devoted to peer review in 2015, among which 18.9 million hours were provided by the top 5% contributing reviewers. Our results support that the system is sustainable in terms of volume but emphasizes a considerable imbalance in the distribution of the peer-review effort across the scientific community. Finally, various individual interactions between authors, editors and reviewers may reduce to some extent the number of reviewers who are available to editors at any point. PMID:27832157

Final Report: Fourth Peer Review of the CMAQ Model

EPA Science Inventory

The CMAQ Model External Peer Review Panel conducted a two and a half day review view on June 27, 28, and 29, 2011. This report summarizes its findings, and follows other reviews conducted in 2004, 2005, and 2006 [Amar et al., 2004; 2005 and 2007].

Clinical Nurse Specialists Guide Staff Nurses to Promote Practice Accountability Through Peer Review.

PubMed

Semper, Julie; Halvorson, Betty; Hersh, Mary; Torres, Clare; Lillington, Linda

2016-01-01

The aim of the study was to describe the clinical nurse specialist role in developing and implementing a staff nurse education program to promote practice accountability using peer review principles. Peer review is essential for professional nursing practice demanding a significant culture change. Clinical nurse specialists in a Magnet-designated community hospital were charged with developing a staff nurse peer review education program. Peer review is a recognized mechanism of professional self-regulation to ensure delivery of quality care. The American Nurses Association strongly urges incorporating peer review in professional nursing practice models. Clinical nurse specialists play a critical role in educating staff nurses about practice accountability. Clinical nurse specialists developed an education program guided by the American Nurses Association's principles of peer review. A baseline needs assessment identified potential barriers and learning needs. Content incorporated tools and strategies to build communication skills, collaboration, practice change, and peer accountability. The education program resulted in increased staff nurse knowledge about peer review and application of peer review principles in practice. Clinical nurse specialists played a critical role in helping staff nurses understand peer review and its application to practice. The clinical nurse specialist role will continue to be important in sustaining the application of peer review principles in practice.

External Peer Review Team Report for Corrective Action Unit 97: Yucca Flat/Climax Mine, Nevada National Security Site, Nye County, Nevada, Revision 0

DOE Office of Scientific and Technical Information (OSTI.GOV)

Marutzky, Sam J.; Andrews, Robert

The peer review team commends the Navarro-Intera, LLC (N-I), team for its efforts in using limited data to model the fate of radionuclides in groundwater at Yucca Flat. Recognizing the key uncertainties and related recommendations discussed in Section 6.0 of this report, the peer review team has concluded that U.S. Department of Energy (DOE) is ready for a transition to model evaluation studies in the corrective action decision document (CADD)/corrective action plan (CAP) stage. The DOE, National Nuclear Security Administration Nevada Field Office (NNSA/NFO) clarified the charge to the peer review team in a letter dated October 9, 2014, frommore » Bill R. Wilborn, NNSA/NFO Underground Test Area (UGTA) Activity Lead, to Sam J. Marutzky, N-I UGTA Project Manager: “The model and supporting information should be sufficiently complete that the key uncertainties can be adequately identified such that they can be addressed by appropriate model evaluation studies. The model evaluation studies may include data collection and model refinements conducted during the CADD/CAP stage. One major input to identifying ‘key uncertainties’ is the detailed peer review provided by independent qualified peers.” The key uncertainties that the peer review team recognized and potential concerns associated with each are outlined in Section 6.0, along with recommendations corresponding to each uncertainty. The uncertainties, concerns, and recommendations are summarized in Table ES-1. The number associated with each concern refers to the section in this report where the concern is discussed in detail.« less

Peer-supported review of teaching: making the grade in midwifery and nursing education.

PubMed

Murphy Tighe, Sylvia; Bradshaw, Carmel

2013-11-01

This paper outlines the value of peer-supported review of teaching for nurse and midwifery educators in an academic environment. Reflection and continuing professional development are important tenets of an educators' practice and can be addressed via peer observation. Definitions and models of peer observation are presented. The strengths and challenges associated with peer-supported review of teaching are discussed. The reasons why peer observation is underutilised are explored with some suggestions on how to overcome these challenges. Recent developments in relation to peer observation and peer-supported review are outlined. The need for tangible evidence of development and enhancement of existing teaching expertise is very pronounced in the current economic climate, it is concluded that peer-supported review of teaching can provide such evidence. Copyright © 2012 Elsevier Ltd. All rights reserved.

Lessons Learned from the Frenchman Flat Flow and Transport Modeling External Peer Review

NASA Astrophysics Data System (ADS)

Becker, N. M.; Crowe, B. M.; Ruskauff, G.; Kwicklis, E. M.; Wilborn, B.

2011-12-01

The objective of the U.S. Department of Energy's Underground Test Area Program program is to forecast, using computer modeling, the contaminant boundary of radionuclide transport in groundwater at the Nevada National Security Site that exceeds the Safe Drinking Water Act after 1000 yrs. This objective is defined within the Federal Facilities Agreement and Consent Order between the Department of Energy, Department of Defense and State of Nevada Division of Environmental Protection . At one of the Corrective Action Units, Frenchman Flat, a Phase I flow and transport model underwent peer review in 1999 to determine if the model approach, assumptions and results adequate to be used as a decision tool as a basis to negotiate a compliance boundary with Nevada Division of Environmental Protection. The external peer review decision was that the model was not fully tested under a full suite of possible conceptual models, including boundary conditions, flow mechanisms, other transport processes, hydrological framework models, sensitivity and uncertainty analysis, etc. The program went back to collect more data, expand modeling to consider other alternatives that were not adequately tested, and conduct sensitivity and uncertainty analysis. A second external peer review was held in August 2010. Their conclusion that the new Frenchman Flat flow and transport modeling analysis were adequate as a decision tool and that the model was ready to advance to the next step in the Federal Facilities Agreement and Consent Order strategy. We will discuss the processes to changing the modeling that occurred between the first and second peer reviews, and then present the second peer review general comments. Finally, we present the lessons learned from the total model acceptance process required for federal regulatory compliance.

Evaluation of the Inhalation Carcinogenicity of Ethylene Oxide ...

EPA Pesticide Factsheets

EPA is initiating a public comment period prior to peer review of the scientific basis supporting the human health hazard and dose-response assessment of ethylene oxide (cancer) that will appear in the Integrated Risk Information System (IRIS) database. EPA seeks external peer review on how the Agency responded to the SAB panel recommendations, the exposure-response modeling of epidemiologic data, including new analyses since the 2007 external peer review, and on the adequacy, transparency, and clarity of the revised draft. The peer review will include an opportunity for the public to address the peer reviewers.

o'Peer: open peer review

NASA Astrophysics Data System (ADS)

Brewer, J. H.

2014-12-01

I have built a "demonstration" website at http://oPeer.org to illustrate how peer review and publication might be improved relative to the current model, which was designed and implemented in an era when scientific communication was either face-to-face or relied upon human delivery of ink marks on dead trees.

Complex systems approach to scientific publication and peer-review system: development of an agent-based model calibrated with empirical journal data.

PubMed

Kovanis, Michail; Porcher, Raphaël; Ravaud, Philippe; Trinquart, Ludovic

Scientific peer-review and publication systems incur a huge burden in terms of costs and time. Innovative alternatives have been proposed to improve the systems, but assessing their impact in experimental studies is not feasible at a systemic level. We developed an agent-based model by adopting a unified view of peer review and publication systems and calibrating it with empirical journal data in the biomedical and life sciences. We modeled researchers, research manuscripts and scientific journals as agents. Researchers were characterized by their scientific level and resources, manuscripts by their scientific value, and journals by their reputation and acceptance or rejection thresholds. These state variables were used in submodels for various processes such as production of articles, submissions to target journals, in-house and external peer review, and resubmissions. We collected data for a sample of biomedical and life sciences journals regarding acceptance rates, resubmission patterns and total number of published articles. We adjusted submodel parameters so that the agent-based model outputs fit these empirical data. We simulated 105 journals, 25,000 researchers and 410,000 manuscripts over 10 years. A mean of 33,600 articles were published per year; 19 % of submitted manuscripts remained unpublished. The mean acceptance rate was 21 % after external peer review and rejection rate 32 % after in-house review; 15 % publications resulted from the first submission, 47 % the second submission and 20 % the third submission. All decisions in the model were mainly driven by the scientific value, whereas journal targeting and persistence in resubmission defined whether a manuscript would be published or abandoned after one or many rejections. This agent-based model may help in better understanding the determinants of the scientific publication and peer-review systems. It may also help in assessing and identifying the most promising alternative systems of peer review.

Influence of Peer Effects on Learning Outcomes: A Review of the Literature.

ERIC Educational Resources Information Center

Wilkinson, Ian A. G.; Hattie, John A.; Parr, Judy M.; Townsend, Michael A. R.; Fung, Irene; Ussher, Charlotte; Thrupp, Martin; Lauder, Hugh; Robinson, Tony

This report presents a literature review and conceptual model summarizing the influence of peer effects on learning outcomes. The report describes the approach to the review and provides a theoretical account of the environments, mechanisms, and processes that mediate learning among peers. It then summarizes the literature on compositional effects…

Research Integrity and Peer Review-past highlights and future directions.

PubMed

Boughton, Stephanie L; Kowalczuk, Maria K; Meerpohl, Joerg J; Wager, Elizabeth; Moylan, Elizabeth C

2018-01-01

In May 2016, we launched Research Integrity and Peer Review , an international, open access journal with fully open peer review (reviewers are identified on their reports and named reports are published alongside the article) to provide a home for research on research and publication ethics, research reporting, and research on peer review. As the journal enters its third year, we reflect on recent events and highlights for the journal and explore how the journal is faring in terms of gender and diversity in peer review. We also share the particular interests of our Editors-in-Chief regarding models of peer review, reporting quality, common research integrity issues that arise during the publishing process, and how people interact with the published literature. We continue to encourage further research into peer review, research and publication ethics and research reporting, as we believe that all new initiatives should be evidence-based. We also remain open to constructive discussions of the developments in the field that offer new solutions.

What's with all this peer-review stuff anyway?

DOE Office of Scientific and Technical Information (OSTI.GOV)

Warner, J. S.

2010-01-01

The Journal of Physical Security was ostensibly started to deal with a perceived lack of peer-reviewed journals related to the field of physical security. In fact, concerns have been expressed that the field of physical security is scarcely a field at all. A typical, well-developed field might include the following: multiple peer-reviewed journals devoted to the subject, rigor and critical thinking, metrics, fundamental principles, models and theories, effective standards and guidelines, R and D conferences, professional societies, certifications, its own academic department (or at least numerous academic experts), widespread granting of degrees in the field from 4-year research universities, mechanismsmore » for easily spotting 'snake oil' products and services, and the practice of professionals organizing to police themselves, provide quality control, and determine best practices. Physical Security seems to come up short in a number of these areas. Many of these attributes are difficult to quantify. This paper seeks to focus on one area that is quantifiable: the number of peer-reviewed journals dedicated to the field of Physical Security. In addition, I want to examine the number of overall periodicals (peer-reviewed and non-peer-reviewed) dedicated to physical security, as well as the number of papers published each year about physical security. These are potentially useful analyses because one can often infer how healthy or active a given field is by its publishing activity. For example, there are 2,754 periodicals dedicated to the (very healthy and active) field of physics. This paper concentrates on trade journal versus peer-reviewed journals. Trade journals typically focus on practice-related topics. A paper appropriate for a trade journal is usually based more on practical experience than rigorous studies or research. Models, theories, or rigorous experimental research results will usually not be included. A trade journal typically targets a specific market in an industry or trade. Such journals are often considered to be news magazines and may contain industry specific advertisements and/or job ads. A peer-reviewed journal, a.k.a 'referred journal', in contrast, contains peer-reviewed papers. A peer-reviewed paper is one that has been vetted by the peer review process. In this process, the paper is typically sent to independent experts for review and consideration. A peer-reviewed paper might cover experimental results, and/or a rigorous study, analyses, research efforts, theory, models, or one of many other scholarly endeavors.« less

Student Peer Review: Enhancing Formative Feedback with a Rebuttal

ERIC Educational Resources Information Center

Harland, Tony; Wald, Navé; Randhawa, Haseeb

2017-01-01

This study examines the use of peer review in an undergraduate ecology programme, in which students write a research proposal as a grant application, prior to carrying out the research project. Using a theoretical feedback model, we compared teacher and student peer reviews in a double blind exercise, and show how students responded to feedback…

Peer-review: An IOP Publishing Perspective

NASA Astrophysics Data System (ADS)

Smith, Timothy

2015-03-01

Online publishing is challenging, and potentially changing, the role of publishers in both managing the peer-review process and disseminating the work that they publish in meeting contrasting needs from diverse groups of research communities. Recognizing the value of peer-review as a fundamental service to authors and the research community, the underlying principles of managing the process for journals published by IOP Publishing remain unchanged and yet the potential and demand for alternative models exists. This talk will discuss the traditional approach to peer-review placed in the context of this changing demand.

The objective impact of clinical peer review on hospital quality and safety.

PubMed

Edwards, Marc T

2011-01-01

Despite its importance, the objective impact of clinical peer review on the quality and safety of care has not been studied. Data from 296 acute care hospitals show that peer review program and related organizational factors can explain up to 18% of the variation in standardized measures of quality and patient safety. The majority of programs rely on an outmoded and dysfunctional process model. Adoption of best practices informed by the continuing study of peer review program effectiveness has the potential to significantly improve patient outcomes.

A Review of Sex Differences in Peer Relationship Processes: Potential Trade-offs for the Emotional and Behavioral Development of Girls and Boys

PubMed Central

Rose, Amanda J.; Rudolph, Karen D.

2011-01-01

Theory and research on sex differences in adjustment focus largely on parental, societal, and biological influences. However, it also is important to consider how peers contribute to girls’ and boys’ development. This paper provides a critical review of sex differences in: several peer-relationship processes, including behavioral and social-cognitive styles, stress and coping, and relationship provisions. Based on this review, a speculative peer-socialization model is presented that considers the implications of these sex differences for girls’ and boys’ emotional and behavioral development. Central to this model is the idea that sex-linked relationship processes have costs and benefits for girls’ and boys’ adjustment. Finally, we present recent research testing certain model components and propose approaches for testing understudied aspects of the model. PMID:16435959

A novel approach to quality improvement in a safety-net practice: concurrent peer review visits.

PubMed

Fiscella, Kevin; Volpe, Ellen; Winters, Paul; Brown, Melissa; Idris, Amna; Harren, Tricia

2010-12-01

Concurrent peer review visits are structured office visits conducted by clinician peers of the primary care clinician that are specifically designed to reduce competing demands, clinical inertia, and bias. We assessed whether a single concurrent peer review visit reduced clinical inertia and improved control of hypertension, hyperlipidemia, and diabetes control among underserved patients. We conducted a randomized encouragement trial to evaluate concurrent peer review visits with a community health center. Seven hundred twenty-seven patients with hypertension, hyperlipidemia, and/or diabetes who were not at goal for systolic blood pressure (SBP), low-density lipoprotein cholesterol (LDL-C), and/or glycated hemoglobin (A1c) were randomly assigned to an invitation to participate in a concurrent peer review visit or to usual care. We compared change in these measures using mixed models and rates of therapeutic intensification during concurrent peer review visits with control visits. One hundred seventy-one patients completed a concurrent peer review visit. SBP improved significantly (p < .01) more among those completing concurrent peer review visits than among those who failed to respond to a concurrent peer review invitation or those randomized to usual care. There were no differences seen for changes in LDL-C or A1c. Concurrent peer review visits were associated with statistically significant greater clinician intensification of blood pressure (p < .001), lipid (p < .001), and diabetes (p < .005) treatment than either for control visits for patients in either the nonresponse group or usual care group. Concurrent peer review visits represent a promising strategy for improving blood pressure control and improving therapeutic intensification in community health centers.

A Developmental Perspective on Peer Rejection, Deviant Peer Affiliation, and Conduct Problems Among Youth.

PubMed

Chen, Diane; Drabick, Deborah A G; Burgers, Darcy E

2015-12-01

Peer rejection and deviant peer affiliation are linked consistently to the development and maintenance of conduct problems. Two proposed models may account for longitudinal relations among these peer processes and conduct problems: the (a) sequential mediation model, in which peer rejection in childhood and deviant peer affiliation in adolescence mediate the link between early externalizing behaviors and more serious adolescent conduct problems; and (b) parallel process model, in which peer rejection and deviant peer affiliation are considered independent processes that operate simultaneously to increment risk for conduct problems. In this review, we evaluate theoretical models and evidence for associations among conduct problems and (a) peer rejection and (b) deviant peer affiliation. We then consider support for the sequential mediation and parallel process models. Next, we propose an integrated model incorporating both the sequential mediation and parallel process models. Future research directions and implications for prevention and intervention efforts are discussed.

A Developmental Perspective on Peer Rejection, Deviant Peer Affiliation, and Conduct Problems among Youth

PubMed Central

Chen, Diane; Drabick, Deborah A. G.; Burgers, Darcy E.

2015-01-01

Peer rejection and deviant peer affiliation are linked consistently to the development and maintenance of conduct problems. Two proposed models may account for longitudinal relations among these peer processes and conduct problems: the (a) sequential mediation model, in which peer rejection in childhood and deviant peer affiliation in adolescence mediate the link between early externalizing behaviors and more serious adolescent conduct problems; and (b) parallel process model, in which peer rejection and deviant peer affiliation are considered independent processes that operate simultaneously to increment risk for conduct problems. In this review, we evaluate theoretical models and evidence for associations among conduct problems and (a) peer rejection and (b) deviant peer affiliation. We then consider support for the sequential mediation and parallel process models. Next, we propose an integrated model incorporating both the sequential mediation and parallel process models. Future research directions and implications for prevention and intervention efforts are discussed. PMID:25410430

What is open peer review? A systematic review.

PubMed

Ross-Hellauer, Tony

2017-01-01

Background : "Open peer review" (OPR), despite being a major pillar of Open Science, has neither a standardized definition nor an agreed schema of its features and implementations. The literature reflects this, with numerous overlapping and contradictory definitions. While for some the term refers to peer review where the identities of both author and reviewer are disclosed to each other, for others it signifies systems where reviewer reports are published alongside articles. For others it signifies both of these conditions, and for yet others it describes systems where not only "invited experts" are able to comment. For still others, it includes a variety of combinations of these and other novel methods. Methods : Recognising the absence of a consensus view on what open peer review is, this article undertakes a systematic review of definitions of "open peer review" or "open review", to create a corpus of 122 definitions. These definitions are systematically analysed to build a coherent typology of the various innovations in peer review signified by the term, and hence provide the precise technical definition currently lacking. Results : This quantifiable data yields rich information on the range and extent of differing definitions over time and by broad subject area. Quantifying definitions in this way allows us to accurately portray exactly how ambiguously the phrase "open peer review" has been used thus far, for the literature offers 22 distinct configurations of seven traits, effectively meaning that there are 22 different definitions of OPR in the literature reviewed. Conclusions : I propose a pragmatic definition of open peer review as an umbrella term for a number of overlapping ways that peer review models can be adapted in line with the aims of Open Science, including making reviewer and author identities open, publishing review reports and enabling greater participation in the peer review process.

External Peer Review Team Report Underground Testing Area Subproject for Frenchman Flat, Revision 1

DOE Office of Scientific and Technical Information (OSTI.GOV)

Sam Marutzky

2010-09-01

An external peer review was conducted to review the groundwater models used in the corrective action investigation stage of the Underground Test Area (UGTA) subproject to forecast zones of potential contamination in 1,000 years for the Frenchman Flat area. The goal of the external peer review was to provide technical evaluation of the studies and to assist in assessing the readiness of the UGTA subproject to progress to monitoring activities for further model evaluation. The external peer review team consisted of six independent technical experts with expertise in geology, hydrogeology,'''groundwater modeling, and radiochemistry. The peer review team was tasked withmore » addressing the following questions: 1. Are the modeling approaches, assumptions, and model results for Frenchman Flat consistent with the use of modeling studies as a decision tool for resolution of environmental and regulatory requirements? 2. Do the modeling results adequately account for uncertainty in models of flow and transport in the Frenchman Flat hydrological setting? a. Are the models of sufficient scale/resolution to adequately predict contaminant transport in the Frenchman Flat setting? b. Have all key processes been included in the model? c. Are the methods used to forecast contaminant boundaries from the transport modeling studies reasonable and appropriate? d. Are the assessments of uncertainty technically sound and consistent with state-of-the-art approaches currently used in the hydrological sciences? 3. Are the datasets and modeling results adequate for a transition to Corrective Action Unit monitoring studies—the next stage in the UGTA strategy for Frenchman Flat? The peer review team is of the opinion that, with some limitations, the modeling approaches, assumptions, and model results are consistent with the use of modeling studies for resolution of environmental and regulatory requirements. The peer review team further finds that the modeling studies have accounted for uncertainty in models of flow and transport in the Frenchman Flat except for a few deficiencies described in the report. Finally, the peer review team concludes that the UGTA subproject has explored a wide range of variations in assumptions, methods, and data, and should proceed to the next stage with an emphasis on monitoring studies. The corrective action strategy, as described in the Federal Facility Agreement and Consent Order, states that the groundwater flow and transport models for each corrective action unit will consider, at a minimum, the following: • Alternative hydrostratigraphic framework models of the modeling domain. • Uncertainty in the radiological and hydrological source terms. • Alternative models of recharge. • Alternative boundary conditions and groundwater flows. • Multiple permissive sets of calibrated flow models. • Probabilistic simulations of transport using plausible sets of alternative framework and recharge models, and boundary and groundwater flows from calibrated flow models. • Ensembles of forecasts of contaminant boundaries. • Sensitivity and uncertainty analyses of model outputs. The peer review team finds that these minimum requirements have been met. While the groundwater modeling and uncertainty analyses have been quite detailed, the peer review team has identified several modeling-related issues that should be addressed in the next phase of the corrective action activities: • Evaluating and using water-level gradients from the pilot wells at the Area 5 Radioactive Waste Management Site in model calibration. • Re-evaluating the use of geochemical age-dating data to constrain model calibrations. • Developing water budgets for the alluvial and upper volcanic aquifer systems in Frenchman Flat. • Considering modeling approaches in which calculated groundwater flow directions near the water table are not predetermined by model boundary conditions and areas of recharge, all of which are very uncertain. • Evaluating local-scale variations in hydraulic conductivity on the calculated contaminant boundaries. • Evaluating the effects of non-steady-state flow conditions on calculated contaminant boundaries, including the effects of long-term declines in water levels, climatic change, and disruption of groundwater system by potential earthquake faulting along either of the two major controlling fault zones in the flow system (the Cane Spring and Rock Valley faults). • Considering the use of less-complex modeling approaches. • Evaluating the large change in water levels in the vicinity of the Frenchman Flat playa and developing a conceptual model to explain these water-level changes. • Developing a long-term groundwater level monitoring program for Frenchman Flat with regular monitoring of water levels at key monitoring wells. Despite these reservations, the peer review team strongly believes that the UGTA subproject should proceed to the next stage.« less

Is Peer Victimization Associated with Academic Achievement? A Meta-Analytic Review

ERIC Educational Resources Information Center

Nakamoto, Jonathan; Schwartz, David

2010-01-01

This paper presents a meta-analytic review of 33 studies, with a total of 29,552 participants, that examined the concurrent association between peer victimization and academic achievement. The results revealed a small but significant negative correlation between peer victimization and academic achievement under both the random-effects model (r =…

Expanding Group Peer Review: A Proposal for Medical Education Scholarship.

PubMed

Dumenco, Luba; Engle, Deborah L; Goodell, Kristen; Nagler, Alisa; Ovitsh, Robin K; Whicker, Shari A

2017-02-01

After participating in a group peer-review exercise at a workshop presented by Academic Medicine and MedEdPORTAL editors at the 2015 Association of American Medical Colleges Medical Education Meeting, the authors realized that the way their work group reviewed a manuscript was very different from the way by which they each would have reviewed the paper as an individual. Further, the group peer-review process yielded more robust feedback for the manuscript's authors than did the traditional individual peer-review process. This realization motivated the authors to reconvene and collaborate to write this Commentary to share their experience and propose the expanded use of group peer review in medical education scholarship.The authors consider the benefits of a peer-review process for reviewers, including learning how to improve their own manuscripts. They suggest that the benefits of a team review model may be similar to those of teamwork and team-based learning in medicine and medical education. They call for research to investigate this, to provide evidence to support group review, and to determine whether specific paper types would benefit most from team review (e.g., particularly complex manuscripts, those receiving widely disparate initial individual reviews). In addition, the authors propose ways in which a team-based approach to peer review could be expanded by journals and institutions. They believe that exploring the use of group peer review potentially could create a new methodology for skill development in research and scholarly writing and could enhance the quality of medical education scholarship.

Implementation and evaluation of a peer review process for advanced practice nurses in a university hospital setting.

PubMed

Bergum, Shelly K; Canaan, Talitha; Delemos, Christi; Gall, Elizabeth Funke; McCracken, Bonnie; Rowen, Dave; Salvemini, Steve; Wiens, Kimberly

2017-07-01

Over the past decade, implementation of the peer review process for the development of the advanced practice nurse (APN) has been emphasized. However, little exists in the literature regarding APN peer review. The peer review process is intended to help demonstrate competency of care, enhance quality improvement measures, and foster the professional growth of the APN. APNs serving on a professional governance council within a university teaching hospital developed a model of peer review for APNs. Nine months after the tool was implemented, an anonymous follow-up survey was conducted. A follow-up request was sent 4 weeks later to increase the number of respondents. Likert scales were used to elicit subjective data regarding the process. Of 81 APNs who participated in the survey, more than half (52%) felt that the process would directly improve their professional practice. Survey results show that the peer review process affected APN professional practice positively. Additional research might include pathways for remediation and education of staff, evaluation of alternate methods to improve application to clinical practice, and collection of outcome data. The models presented provide a foundation for future refinement to accommodate different APN practice settings. ©2017 American Association of Nurse Practitioners.

MELCOR Peer Review

DOE Office of Scientific and Technical Information (OSTI.GOV)

Boyack, B.E.; Dhir, V.K.; Gieseke, J.A.

1992-03-01

MELCOR is a fully integrated, engineering-level computer code that models the progression of severe accidents in light water reactor nuclear power plants. The newest version of MELCOR is Version 1.8.1, July 1991. MELCOR development has reached the point that the United States Nuclear Regulatory Commission sponsored a broad technical review by recognized experts to determine or confirm the technical adequacy of the code for the serious and complex analyses it is expected to perform. For this purpose, an eight-member MELCOR Peer Review Committee was organized. The Committee has completed its review of the MELCOR code: the review process and findingsmore » of the MELCOR Peer Review Committee are documented in this report. The Committee has determined that recommendations in five areas are appropriate: (1) MELCOR numerics, (2) models missing from MELCOR Version 1.8.1, (3) existing MELCOR models needing revision, (4) the need for expanded MELCOR assessment, and (5) documentation.« less

Evaluating the Pros and Cons of Different Peer Review Policies via Simulation.

PubMed

Zhu, Jia; Fung, Gabriel; Wong, Wai Hung; Li, Zhixu; Xu, Chuanhua

2016-08-01

In the academic world, peer review is one of the major processes in evaluating a scholars contribution. In this study, we are interested in quantifying the merits of different policies in a peer review process, such as single-blind review, double-blind review, and obtaining authors feedback. Currently, insufficient work has been undertaken to evaluate the benefits of different peer review policies. One of the major reasons for this situation is the inability to conduct any empirical study because data are presently unavailable. In this case, a computer simulation is one of the best ways to conduct a study. We perform a series of simulations to study the effects of different policies on a peer review process. In this study, we focus on the peer review process of a typical computer science conference. Our results point to the crucial role of program chairs in determining the quality and diversity of the articles to be accepted for publication. We demonstrate the importance of discussion among reviewers, suggest circumstances in which the double-blind review policy should be adopted, and question the credibility of the authors feedback mechanism. Finally, we stress that randomness plays an important role in the peer review process, and this role cannot be eliminated. Although our model may not capture every component of a peer review process, it covers some of the most essential elements. Thus, even the simulation results clearly cannot be taken as literal descriptions of an actual peer review process. However, we can at least still use them to identify alternative directions for future study.

Timely deposition of macromolecular structures is necessary for peer review

DOE Office of Scientific and Technical Information (OSTI.GOV)

Joosten, Robbie P.; Soueidan, Hayssam; Wessels, Lodewyk F. A.

2013-12-01

Deposition of crystallographic structures should be concurrent with or prior to manuscript submission for peer review, enabling validation and increasing reliability of the PDB. Most of the macromolecular structures in the Protein Data Bank (PDB), which are used daily by thousands of educators and scientists alike, are determined by X-ray crystallography. It was examined whether the crystallographic models and data were deposited to the PDB at the same time as the publications that describe them were submitted for peer review. This condition is necessary to ensure pre-publication validation and the quality of the PDB public archive. It was found thatmore » a significant proportion of PDB entries were submitted to the PDB after peer review of the corresponding publication started, and many were only submitted after peer review had ended. It is argued that clear description of journal policies and effective policing is important for pre-publication validation, which is key in ensuring the quality of the PDB and of peer-reviewed literature.« less

A longitudinal study of clinical peer review's impact on quality and safety in U.S. hospitals.

PubMed

Edwards, Marc T

2013-01-01

Clinical peer review is the dominant method of event analysis in U.S. hospitals. It is pivotal to medical staff efforts to improve quality and safety, yet the quality assurance process model that has prevailed for the past 30 years evokes fear and is fundamentally antithetical to a culture of safety. Two prior national studies characterized a quality improvement model that corrects this dysfunction but failed to demonstrate progress toward its adoption despite a high rate of program change between 2007 and 2009. This study's online survey of 470 organizations participating in either of the prior studies further assessed relationships between clinical peer review program factors, including the degree of conformance to the quality improvement model (the QI model score), and subjectively measured program impact variables. Among the 300 hospitals (64%) that responded, the median QI model score was only 60 on a 100-point scale. Scores increased somewhat for the 2007 cohort (mean pair-wise difference of 5.9 [2-10]), but not for the 2009 cohort. The QI model is expanded as the result of the finding that self-reporting of adverse events, near misses, and hazardous conditions--an essential practice in high-reliability organizations--is no longer rare in hospitals. Self-reporting and the quality of case review are additional multivariate predictors of the perceived ongoing impact of clinical peer review on quality and safety, medical staff perceptions of the program, and medical staff engagement in quality and safety initiatives. Hospital leaders and trustees who seek to improve patient outcomes should facilitate the adoption of this best practice model for clinical peer review.

Maintaining live discussion in two-stage open peer review.

PubMed

Sandewall, Erik

2012-01-01

Open peer review has been proposed for a number of reasons, in particular, for increasing the transparency of the article selection process for a journal, and for obtaining a broader basis for feedback to the authors and for the acceptance decision. The review discussion may also in itself have a value for the research community. These goals rely on the existence of a lively review discussion, but several experiments with open-process peer review in recent years have encountered the problem of faltering review discussions. The present article addresses the question of how lively review discussion may be fostered by relating the experience of the journal Electronic Transactions on Artificial Intelligence (ETAI) which was an early experiment with open peer review. Factors influencing the discussion activity are identified. It is observed that it is more difficult to obtain lively discussion when the number of contributed articles increases, which implies difficulties for scaling up the open peer review model. Suggestions are made for how this difficulty may be overcome.

Maintaining Live Discussion in Two-Stage Open Peer Review

PubMed Central

Sandewall, Erik

2011-01-01

Open peer review has been proposed for a number of reasons, in particular, for increasing the transparency of the article selection process for a journal, and for obtaining a broader basis for feedback to the authors and for the acceptance decision. The review discussion may also in itself have a value for the research community. These goals rely on the existence of a lively review discussion, but several experiments with open-process peer review in recent years have encountered the problem of faltering review discussions. The present article addresses the question of how lively review discussion may be fostered by relating the experience of the journal Electronic Transactions on Artificial Intelligence (ETAI) which was an early experiment with open peer review. Factors influencing the discussion activity are identified. It is observed that it is more difficult to obtain lively discussion when the number of contributed articles increases, which implies difficulties for scaling up the open peer review model. Suggestions are made for how this difficulty may be overcome. PMID:22363282

Beyond Homophily: A Decade of Advances in Understanding Peer Influence Processes.

PubMed

Brechwald, Whitney A; Prinstein, Mitchell J

2011-03-01

This article reviews empirical and theoretical contributions to a multidisciplinary understanding of peer influence processes in adolescence over the past decade. Five themes of peer influence research from this decade were identified, including a broadening of the range of behaviors for which peer influence occurs, distinguishing the sources of influence, probing the conditions under which influence is amplified/attenuated (moderators), testing theoretically based models of peer influence processes (mechanisms), and preliminary exploration of behavioral neuroscience perspectives on peer influence. This review highlights advances in each of these areas, underscores gaps in current knowledge of peer influence processes, and outlines important challenges for future research.

Beyond Homophily: A Decade of Advances in Understanding Peer Influence Processes

PubMed Central

Brechwald, Whitney A.; Prinstein, Mitchell J.

2013-01-01

This article reviews empirical and theoretical contributions to a multidisciplinary understanding of peer influence processes in adolescence over the past decade. Five themes of peer influence research from this decade were identified, including a broadening of the range of behaviors for which peer influence occurs, distinguishing the sources of influence, probing the conditions under which influence is amplified/attenuated (moderators), testing theoretically based models of peer influence processes (mechanisms), and preliminary exploration of behavioral neuroscience perspectives on peer influence. This review highlights advances in each of these areas, underscores gaps in current knowledge of peer influence processes, and outlines important challenges for future research. PMID:23730122

Can editors save peer review from peer reviewers?

PubMed

D'Andrea, Rafael; O'Dwyer, James P

2017-01-01

Peer review is the gold standard for scientific communication, but its ability to guarantee the quality of published research remains difficult to verify. Recent modeling studies suggest that peer review is sensitive to reviewer misbehavior, and it has been claimed that referees who sabotage work they perceive as competition may severely undermine the quality of publications. Here we examine which aspects of suboptimal reviewing practices most strongly impact quality, and test different mitigating strategies that editors may employ to counter them. We find that the biggest hazard to the quality of published literature is not selfish rejection of high-quality manuscripts but indifferent acceptance of low-quality ones. Bypassing or blacklisting bad reviewers and consulting additional reviewers to settle disagreements can reduce but not eliminate the impact. The other editorial strategies we tested do not significantly improve quality, but pairing manuscripts to reviewers unlikely to selfishly reject them and allowing revision of rejected manuscripts minimize rejection of above-average manuscripts. In its current form, peer review offers few incentives for impartial reviewing efforts. Editors can help, but structural changes are more likely to have a stronger impact.

Response to External Peer Review comments regarding the C ...

EPA Pesticide Factsheets

This report documents the external peer review of the C-PORT Tool. C-PORT is intended to provide users with the capability to estimate changes in the concentration of air pollutants in the community resulting from changes in emissions from traffic and port activities. C-PORT is an EPA web-based, easy-to-use modeling system, that allows users to visualize and evaluate different planning scenarios under consideration, helping them identify the best alternatives for making long-term decisions that protect community health and sustainability. In addition, C-PORT is designed to identify local hotspots, focus on specific populations and locations, and inform citizen science and data collection activities. The model is not intended to support or replace any regulatory models or programs. Peer Review report to be posted on Community Modeling and Analysis System (CMAS) along with C-PORT model

The Effects of Peer Tutoring on the Reading Comprehension Performance of Secondary Students with Disabilities: A Systematic Review

ERIC Educational Resources Information Center

Alzahrani, Turkey; Leko, Melinda

2018-01-01

The purposes of this review were to examine the effects of peer tutoring models on the reading comprehension performance of secondary students with disabilities and to provide evidence of the extent to which peer tutoring can be considered an evidence-based practice (EBP) for improving reading comprehension performance among secondary students…

Quantum Computation and Simulation Using Neutral Fermionic Atoms

DTIC Science & Technology

2014-06-06

labeled n = 1) Efimov trimer crosses the three-atom scattering threshold. Working in the context of nuclear physics in the early 1970’s, Vitaly Efimov...permit the observation of anti-ferromagnetic ordering in the Hubbard model. (a) Papers published in peer-reviewed journals ( N /A for none) Enter List of...Physics, (06 2011): 0. doi: TOTAL: 7 Number of Papers published in peer-reviewed journals: (b) Papers published in non-peer-reviewed journals ( N /A for

Peer Review of “LDT Weight Reduction Study with Crash Model, Feasibility and Detailed Cost Analyses – Chevrolet Silverado 1500 Pickup”

EPA Science Inventory

The contractor will conduct an independent peer review of FEV’s light-duty truck (LDT) mass safety study, “Light-Duty Vehicle Weight Reduction Study with Crash Model, Feasibility and Detailed Cost Analysis – Silverado 1500”, and its corresponding computer-aided engineering (CAE) ...

What is open peer review? A systematic review

PubMed Central

Ross-Hellauer, Tony

2017-01-01

Background: “Open peer review” (OPR), despite being a major pillar of Open Science, has neither a standardized definition nor an agreed schema of its features and implementations. The literature reflects this, with numerous overlapping and contradictory definitions. While for some the term refers to peer review where the identities of both author and reviewer are disclosed to each other, for others it signifies systems where reviewer reports are published alongside articles. For others it signifies both of these conditions, and for yet others it describes systems where not only “invited experts” are able to comment. For still others, it includes a variety of combinations of these and other novel methods. Methods: Recognising the absence of a consensus view on what open peer review is, this article undertakes a systematic review of definitions of “open peer review” or “open review”, to create a corpus of 122 definitions. These definitions are systematically analysed to build a coherent typology of the various innovations in peer review signified by the term, and hence provide the precise technical definition currently lacking. Results: This quantifiable data yields rich information on the range and extent of differing definitions over time and by broad subject area. Quantifying definitions in this way allows us to accurately portray exactly how ambiguously the phrase “open peer review” has been used thus far, for the literature offers 22 distinct configurations of seven traits, effectively meaning that there are 22 different definitions of OPR in the literature reviewed. Conclusions: I propose a pragmatic definition of open peer review as an umbrella term for a number of overlapping ways that peer review models can be adapted in line with the aims of Open Science, including making reviewer and author identities open, publishing review reports and enabling greater participation in the peer review process. PMID:28580134

Assessment of Programming Language Learning Based on Peer Code Review Model: Implementation and Experience Report

ERIC Educational Resources Information Center

Wang, Yanqing; Li, Hang; Feng, Yuqiang; Jiang, Yu; Liu, Ying

2012-01-01

The traditional assessment approach, in which one single written examination counts toward a student's total score, no longer meets new demands of programming language education. Based on a peer code review process model, we developed an online assessment system called "EduPCR" and used a novel approach to assess the learning of computer…

Independent Peer Review of Communications, Navigation, and Networking re-Configurable Testbed (CoNNeCT) Project Antenna Pointing Subsystem (APS) Integrated Gimbal Assembly (IGA) Structural Analysis

NASA Technical Reports Server (NTRS)

Raju, Ivatury S.; Larsen, Curtis E.; Pellicciotti, Joseph W.

2010-01-01

Glenn Research Center Chief Engineer's Office requested an independent review of the structural analysis and modeling of the Communications, Navigation, and Networking re-Configurable Testbed (CoNNeCT) Project Antenna Pointing Subsystem (APS) Integrated Gimbal Assembly (IGA) to be conducted by the NASA Engineering and Safety Center (NESC). At this time, the IGA had completed its critical design review (CDR). The assessment was to be a peer review of the NEi-NASTRAN1 model of the APS Antenna, and not a peer review of the design and the analysis that had been completed by the GRC team for CDR. Thus, only a limited amount of information was provided on the structural analysis. However, the NESC team had difficulty separating analysis concerns from modeling issues. The team studied the NASTRAN model, but did not fully investigate how the model was used by the CoNNeCT Project and how the Project was interpreting the results. The team's findings, observations, and NESC recommendations are contained in this report.

Predatory Publishing, Questionable Peer Review, and Fraudulent Conferences

PubMed Central

2014-01-01

Open-access is a model for publishing scholarly, peer-reviewed journals on the Internet that relies on sources of funding other than subscription fees. Some publishers and editors have exploited the author-pays model of open-access, publishing for their own profit. Submissions are encouraged through widely distributed e-mails on behalf of a growing number of journals that may accept many or all submissions and subject them to little, if any, peer review or editorial oversight. Bogus conference invitations are distributed in a similar fashion. The results of these less than ethical practices might include loss of faculty member time and money, inappropriate article inclusions in curriculum vitae, and costs to the college or funding source. PMID:25657363

Reciprocal peer review for quality improvement: an ethnographic case study of the Improving Lung Cancer Outcomes Project.

PubMed

Aveling, Emma-Louise; Martin, Graham; Jiménez García, Senai; Martin, Lisa; Herbert, Georgia; Armstrong, Natalie; Dixon-Woods, Mary; Woolhouse, Ian

2012-12-01

Peer review offers a promising way of promoting improvement in health systems, but the optimal model is not yet clear. We aimed to describe a specific peer review model-reciprocal peer-to-peer review (RP2PR)-to identify the features that appeared to support optimal functioning. We conducted an ethnographic study involving observations, interviews and documentary analysis of the Improving Lung Cancer Outcomes Project, which involved 30 paired multidisciplinary lung cancer teams participating in facilitated reciprocal site visits. Analysis was based on the constant comparative method. Fundamental features of the model include multidisciplinary participation, a focus on discussion and observation of teams in action, rather than paperwork; facilitated reflection and discussion on data and observations; support to develop focused improvement plans. Five key features were identified as important in optimising this model: peers and pairing methods; minimising logistic burden; structure of visits; independent facilitation; and credibility of the process. Facilitated RP2PR was generally a positive experience for participants, but implementing improvement plans was challenging and required substantial support. RP2PR appears to be optimised when it is well organised; a safe environment for learning is created; credibility is maximised; implementation and impact are supported. RP2PR is seen as credible and legitimate by lung cancer teams and can act as a powerful stimulus to produce focused quality improvement plans and to support implementation. Our findings have identified how RP2PR functioned and may be optimised to provide a constructive, open space for identifying opportunities for improvement and solutions.

Peer Review of Launch Environments

NASA Technical Reports Server (NTRS)

Wilson, Timmy R.

2011-01-01

Catastrophic failures of launch vehicles during launch and ascent are currently modeled using equivalent trinitrotoluene (TNT) estimates. This approach tends to over-predict the blast effect with subsequent impact to launch vehicle and crew escape requirements. Bangham Engineering, located in Huntsville, Alabama, assembled a less-conservative model based on historical failure and test data coupled with physical models and estimates. This white paper summarizes NESC's peer review of the Bangham analytical work completed to date.

The gender gap in peer-reviewed publications by physical therapy faculty members: a productivity puzzle.

PubMed

Kaufman, Regina R; Chevan, Julia

2011-01-01

Studies of peer-reviewed article publication by faculty in higher education show men publish more than women. Part of the difference in publishing appears to be attributable directly to gender. Gender differences in publishing productivity have not been explored in physical therapy. The purpose of this study was to explore effects of gender on peer-reviewed publication productivity in physical therapy. This was a cross-sectional study using survey methods. A survey was administered to a random sample of 881 physical therapy faculty members; 459 responses were used for analysis. Men were more likely than women to be married, have children, hold a PhD degree, be tenured or on a tenure track, and hold the position of department chair. There was a significant difference in peer-reviewed publication rates between male and female respondents. Negative binomial regression models revealed that female gender was a negative predictor of peer-reviewed publication, accounting for between 0.51 and 0.58 fewer articles per year for women than for men over the course of a career. Reasons for the gender differences are not clear. Factors such as grant funding, laboratory resources, nature of collaborative relationships, values for different elements of the teaching/research/service triad, and ability to negotiate the academic culture were not captured by our model. The gender gap in peer-reviewed publishing productivity may have implications for individuals and the profession of physical therapy and should be subject to further exploration.

Active Minds: Creating Peer-to-Peer Mental Health Awareness

ERIC Educational Resources Information Center

Walther, Willliam A.; Abelson, Sara; Malmon, Alison

2014-01-01

Utilizing student peers is one vital avenue for improving the prevention, detection, and treatment of mental health disorders on college campuses (The Campus Suicide Prevention Center of Virginia, 2011). This article will briefly review research findings indicating the importance of student peers and then focus on a promising model and growing…

The effect of peer influence and selection processes on adolescent alcohol use: a systematic review of longitudinal studies.

PubMed

Leung, Rachel K; Toumbourou, John W; Hemphill, Sheryl A

2014-01-01

Adolescent alcohol use remains an important public health concern. One of the most salient and consistent predictors for drinking behaviour among young people is peer influence. A systematic review of longitudinal studies that examined the effect of peer influence on adolescent alcohol use between January 1997 and February 2011 is presented. Twenty-two studies fulfilled inclusion criteria and were reviewed. All but one study confirmed affiliation with alcohol-using or deviant peers as prospective predictors for the development of adolescent alcohol use. Findings revealed that existing longitudinal studies that have used multivariate analytic techniques to segregate peer influence (whereby adolescents start drinking after exposure to alcohol-using friends) and peer selection (whereby adolescents that start drinking without alcohol-using friends subsequently seek out drinking peers) effects consistently report significant peer influence effects. However, studies are unable to elucidate the relative contribution and developmental sequence of peer influence and selection. Existing research is synthesised to model the developmental influence of peer processes on adolescent alcohol use. Future research directions are recommended to inform better designed investigations that can lead to more effective endeavours to address peer processes in prevention efforts.

Transformation of Adolescent Peer Relations in the Social Media Context: Part 2-Application to Peer Group Processes and Future Directions for Research.

PubMed

Nesi, Jacqueline; Choukas-Bradley, Sophia; Prinstein, Mitchell J

2018-04-07

As social media use becomes increasingly widespread among adolescents, research in this area has accumulated rapidly. Researchers have shown a growing interest in the impact of social media on adolescents' peer experiences, including the ways that the social media context shapes a variety of peer relations constructs. This paper represents Part 2 of a two-part theoretical review. In this review, we offer a new model for understanding the transformative role of social media in adolescents' peer experiences, with the goal of stimulating future empirical work that is grounded in theory. The transformation framework suggests that the features of the social media context transform adolescents' peer experiences by changing their frequency or immediacy, amplifying demands, altering their qualitative nature, and/or offering new opportunities for compensatory or novel behaviors. In the current paper, we consider the ways that social media may transform peer relations constructs that often occur at the group level. Our review focuses on three key constructs: peer victimization, peer status, and peer influence. We selectively review and highlight existing evidence for the transformation of these domains through social media. In addition, we discuss methodological considerations and key conceptual principles for future work. The current framework offers a new theoretical perspective through which peer relations researchers may consider adolescent social media use.

An Exploratory Study: Assessment of Modeled Dioxin ...

EPA Pesticide Factsheets

EPA has released an external review draft entitled, An Exploratory Study: Assessment of Modeled Dioxin Exposure in Ceramic Art Studios(External Review Draft). The public comment period and the external peer-review workshop are separate processes that provide opportunities for all interested parties to comment on the document. In addition to consideration by EPA, all public comments submitted in accordance with this notice will also be forwarded to EPA’s contractor for the external peer-review panel prior to the workshop. EPA has realeased this draft document solely for the purpose of pre-dissemination peer review under applicable information quality guidelines. This document has not been formally disseminated by EPA. It does not represent and should not be construed to represent any Agency policy or determination. The purpose of this report is to describe an exploratory investigation of potential dioxin exposures to artists/hobbyists who use ball clay to make pottery and related products.

76 FR 68518 - Request for Information: Public Access to Peer-Reviewed Scholarly Publications Resulting From...

Federal Register 2010, 2011, 2012, 2013, 2014

2011-11-04

... there models or new ideas for public-private partnerships that take advantage of existing publisher... OFFICE OF SCIENCE AND TECHNOLOGY POLICY Request for Information: Public Access to Peer-Reviewed Scholarly Publications Resulting From Federally Funded Research ACTION: Notice of Request for Information...

76 FR 80418 - Request for Information: Public Access to Peer-Reviewed Scholarly Publications Resulting From...

Federal Register 2010, 2011, 2012, 2013, 2014

2011-12-23

... there models or new ideas for public-private partnerships that take advantage of existing publisher... OFFICE OF SCIENCE AND TECHNOLOGY POLICY Request for Information: Public Access to Peer-Reviewed Scholarly Publications Resulting From Federally Funded Research ACTION: Notice of Request for Information...

An Online Peer Assisted Learning Community Model and its Application in ZJNU

ERIC Educational Resources Information Center

Gaofeng, Ruan; Yeyu, Lin

2007-01-01

Peer coaching, or peer assisting, was established in 1970s by Joyce and Showers. Initially used in teachers' professional development, it refers to a process that two or more teacher peers evaluate current practice mutually; expand skills, extract and build new skills; share ideas, and review & solve problems of classroom teaching in a way of…

NASA Product Peer Review Process

NASA Technical Reports Server (NTRS)

Jenks, Ken

2009-01-01

This viewgraph presentation describes NASA's product peer review process. The contents include: 1) Inspection/Peer Review at NASA; 2) Reasons for product peer reviews; 3) Different types of peer reviews; and 4) NASA requirements for peer reviews. This presentation also includes a demonstration of an actual product peer review.

Economic Evaluation Research in the Context of Child Welfare Policy: A Structured Literature Review and Recommendations

PubMed Central

Goldhaber-Fiebert, Jeremy D.; Snowden, Lonnie R.; Wulczyn, Fred; Landsverk, John; Horwitz, Sarah M.

2011-01-01

Objectives With over 1 million children served by the U.S. Child Welfare system at a cost of $20 billion annually, this study examines the economic evaluation literature on interventions to improve outcomes for children at risk for and currently involved with the system, identifies areas where additional research is needed, and discusses the use of decision-analytic modeling to advance Child Welfare policy and practice. Methods The review included 19 repositories of peer-reviewed and non-peer-reviewed “gray” literatures, including items in English published before November, 2009. Original research articles were included if they evaluated interventions based on costs and outcomes. Review articles were included to assess the relevance of these techniques over time and to highlight the increasing discussion of methods needed to undertake such research. Items were categorized by their focus on: interventions for the U.S. Child Welfare system; primary prevention of entry into the system; and use of models to make long-term projections of costs and outcomes. Results Searches identified 2,640 articles, with 49 ultimately included (19 reviews and 30 original research articles). Between 1988 and 2009, reviews consistently advocated economic evaluation and increasingly provided methodological guidance. 21 of the original research articles focused on Child Welfare, while 9 focused on child mental health. Of the 21 Child Welfare articles, 81% (17) focused on the U.S. system. 47% (8/17) focused exclusively on primary prevention, though 83% of the U.S. system, peer-reviewed articles focused exclusively on prevention (5/6). 9 of the 17 articles included empirical follow-up (mean sample size: 264 individuals; mean follow-up: 3.8 years). 10 of the 17 articles used modeling to project longer-term outcomes, but 80% of the articles using modeling were not peer-reviewed. Although 60% of modeling studies included interventions for children in the system, all peer-reviewed modeling articles focused on prevention. Conclusions Methodological guidance for economic evaluations in Child Welfare is increasingly available. Such analyses are feasible given the availability of nationally-representative data on children involved with Child Welfare and evidence-based interventions. Practice Implications Policy analyses considering the long-term costs and effects of interventions to improve Child Welfare outcomes are scarce, feasible, and urgently needed. PMID:21944552

To Name or Not to Name: The Effect of Changing Author Gender on Peer Review

ERIC Educational Resources Information Center

Borsuk, Robyn M.; Aarssen, Lonnie W.; Budden, Amber E.; Koricheva, Julia; Leimu, Roosa; Tregenza, Tom; Lortie, Christopher J.

2009-01-01

The peer review model is one of the most important tools used in science to assess the relative merit of research. We manipulated a published article to reflect one of the following four author designations: female, male, initial, and no name provided. This article was then reviewed by referees of both genders at various stages of scientific…

Innovative Peer Review Model for Rural Physicians: System Design and Implementation

ERIC Educational Resources Information Center

Williams, Josie R.; Mechler, Kathy; Akins, Ralitsa B.

2008-01-01

Context: The peer review process in small rural hospitals is complicated by limited numbers of physicians, conflict of interest, issues related to appropriate utilization of new technology, possibility for conflicting recommendations, and need for external expertise. Purpose: The purpose of this project was to design, test, and implement a virtual…

Nurturing Professional Growth: A Peer Review Model for Independent Evaluators

ERIC Educational Resources Information Center

Bond, Sally L.; Ray, Marilyn L.

2006-01-01

There has been a recent groundswell of support in the American Evaluation Association's Independent Consulting Topical Interest Group (IC TIG) for evaluating evaluators' work just as evaluators evaluate the work of their clients. To facilitate this self-evaluation, the IC TIG elected to create a peer review process that focuses on written…

Impact of interventions to improve the quality of peer review of biomedical journals: a systematic review and meta-analysis.

PubMed

Bruce, Rachel; Chauvin, Anthony; Trinquart, Ludovic; Ravaud, Philippe; Boutron, Isabelle

2016-06-10

The peer review process is a cornerstone of biomedical research. We aimed to evaluate the impact of interventions to improve the quality of peer review for biomedical publications. We performed a systematic review and meta-analysis. We searched CENTRAL, MEDLINE (PubMed), Embase, Cochrane Database of Systematic Reviews, and WHO ICTRP databases, for all randomized controlled trials (RCTs) evaluating the impact of interventions to improve the quality of peer review for biomedical publications. We selected 22 reports of randomized controlled trials, for 25 comparisons evaluating training interventions (n = 5), the addition of a statistical peer reviewer (n = 2), use of a checklist (n = 2), open peer review (i.e., peer reviewers informed that their identity would be revealed; n = 7), blinded peer review (i.e., peer reviewers blinded to author names and affiliation; n = 6) and other interventions to increase the speed of the peer review process (n = 3). Results from only seven RCTs were published since 2004. As compared with the standard peer review process, training did not improve the quality of the peer review report and use of a checklist did not improve the quality of the final manuscript. Adding a statistical peer review improved the quality of the final manuscript (standardized mean difference (SMD), 0.58; 95 % CI, 0.19 to 0.98). Open peer review improved the quality of the peer review report (SMD, 0.14; 95 % CI, 0.05 to 0.24), did not affect the time peer reviewers spent on the peer review (mean difference, 0.18; 95 % CI, -0.06 to 0.43), and decreased the rate of rejection (odds ratio, 0.56; 95 % CI, 0.33 to 0.94). Blinded peer review did not affect the quality of the peer review report or rejection rate. Interventions to increase the speed of the peer review process were too heterogeneous to allow for pooling the results. Despite the essential role of peer review, only a few interventions have been assessed in randomized controlled trials. Evidence-based peer review needs to be developed in biomedical journals.

How to Assess Quality of Research in Iran, From Input to Impact? Introduction of Peer-Based Research Evaluation Model in Iran.

PubMed

Ebadifar, Asghar; Baradaran Eftekhari, Monir; Owlia, Parviz; Habibi, Elham; Ghalenoee, Elham; Bagheri, Mohammad Reza; Falahat, Katayoun; Eltemasi, Masoumeh; Sobhani, Zahra; Akhondzadeh, Shahin

2017-11-01

Research evaluation is a systematic and objective process to measure relevance, efficiency and effectiveness of research activities, and peer review is one of the most important tools for assessing quality of research. The aim of this study was introducing research evaluation indicators based on peer reviewing. This study was implemented in 4 stages. A list of objective-oriented evaluation indicators were designed in 4 axes, including; governance and leadership, structure, knowledge production and research impact. The top 10% medical sciences research centers (RCs) were evaluated based on peer review. Adequate equipment and laboratory instruments, high quality research publication and national or international cooperation were the main strengths in medical sciences RCs and the most important weaknesses included failure to adhere to strategic plans, parallel actions in similar fields, problems in manpower recruitment, knowledge translation & exchange (KTE) in service providers and policy makers' levels. Peer review evaluation can improve the quality of research.

Storm Water Management Model (SWMM): Performance Review and Gap Analysis

EPA Science Inventory

The Storm Water Management Model (SWMM) is a widely used tool for urban drainage design and planning. Hundreds of peer-reviewed articles and conference proceedings have been written describing applications of SWMM. This review focused on collecting information on model performanc...

28 CFR 34.109 - Qualifications of peer reviewers.

Code of Federal Regulations, 2010 CFR

2010-07-01

... Section 34.109 Judicial Administration DEPARTMENT OF JUSTICE OJJDP COMPETITION AND PEER REVIEW PROCEDURES Peer Review § 34.109 Qualifications of peer reviewers. The general reviewer qualification criteria to...). Additional details concerning peer reviewer qualifications are provided in the OJJDP “Peer Review Guideline”. ...

The continued movement for open access to peer-reviewed literature.

PubMed

Liesegang, Thomas J

2013-09-01

To provide a current overview of the movement for open access to the peer review literature. Perspective. Literature review of recent advances in the open access movement with a personal viewpoint of the nuances of the movement. The open access movement is complex, with many different constituents. The idealists for the open access movement are seeking open access to the literature but also to the data that constitute the research within the manuscript. The business model of the traditional subscription journal is being scrutinized in relation to the surge in the number of open access journals. Within this environment authors should beware predatory practices. More government and funding agencies are mandating open access to their funded research. This open access movement will continue to be disruptive until a business model ensures continuity of the scientific record. A flood of open access articles that might enrich, but also might pollute or confuse, the medical literature has altered the filtering mechanism provided by the traditional peer review system. At some point there may be a shake-out, with some literature being lost in cyberspace. The open access movement is maturing and must be embraced in some format. The challenge is to establish a sustainable financial business model that will permit the use of digital technology but yet not endanger the decades-old traditional publication model and peer review system. Authors seem to be slower in adopting open access than the idealists in the movement. Copyright © 2013 Elsevier Inc. All rights reserved.

Healthcare system intervention for prevention of birth injuries - process evaluation of self-assessment, peer review, feedback and agreement for change.

PubMed

Nyström, Monica E; Westerlund, Anna; Höög, Elisabet; Millde-Luthander, Charlotte; Högberg, Ulf; Grunewald, Charlotta

2012-08-24

Patient safety is fundamental in high quality healthcare systems but despite an excellent record of perinatal care in Sweden some children still suffer from substandard care and unnecessary birth injuries. Sustainable patient safety improvements assume changes in key actors' mental models, norms and culture as well as in the tools, design and organisation of work. Interventions positively affecting team mental models on safety issues are a first step to enhancing change. Our purpose was to study a national intervention programme for the prevention of birth injuries with the aim to elucidate how the main interventions of self-assessment, peer review, feedback and written agreement for change affected the teams and their mental model of patient safety, and thereby their readiness for change. Knowledge of relevant considerations before implementing this type of patient safety intervention series could thereby be increased. Eighty participants in twenty-seven maternity units were interviewed after the first intervention sequence of the programme. A content analysis using a priori coding was performed in order to relate results to the anticipated outcomes of three basic interventions: self-assessment, peer review and written feedback, and agreement for change. The self-assessment procedure was valuable and served as a useful tool for elucidating strengths and weaknesses and identifying areas for improvement for a safer delivery in maternity units. The peer-review intervention was appreciated, despite it being of less value when considering the contribution to explicit outcome effects (i.e. new input to team mental models and new suggestions for actions). The feedback report and the mutual agreement on measures for improvements reached when signing the contract seemed exert positive pressures for change. Our findings are in line with several studies stressing the importance of self-evaluation by encouraging a thorough review of objectives, practices and outcomes for the continuous improvement of an organisation. Even though effects of the peer review were limited, feedback from peers, or other change agents involved, and the support that a clear and well-structured action plan can provide are considered to be two important complements to future self-assessment procedures related to patient safety improvement.

Process modeling and bottleneck mining in online peer-review systems.

PubMed

Premchaiswadi, Wichian; Porouhan, Parham

2015-01-01

This paper is divided into three main parts. In the first part of the study, we captured, collected and formatted an event log describing the handling of reviews for proceedings of an international conference in Thailand. In the second part, we used several process mining techniques in order to discover process models, social, organizational, and hierarchical structures from the proceeding's event log. In the third part, we detected the deviations and bottlenecks of the peer review process by comparing the observed events (i.e., authentic dataset) with a pre-defined model (i.e., master map). Finally, we investigated the performance information as well as the total waiting time in order to improve the effectiveness and efficiency of the online submission and peer review system for the prospective conferences and seminars. Consequently, the main goals of the study were as follows: (1) to convert the collected event log into the appropriate format supported by process mining analysis tools, (2) to discover process models and to construct social networks based on the collected event log, and (3) to find deviations, discrepancies and bottlenecks between the collected event log and the master pre-defined model. The results showed that although each paper was initially sent to three different reviewers; it was not always possible to make a decision after the first round of reviewing; therefore, additional reviewers were invited. In total, all the accepted and rejected manuscripts were reviewed by an average of 3.9 and 3.2 expert reviewers, respectively. Moreover, obvious violations of the rules and regulations relating to careless or inappropriate peer review of a manuscript-committed by the editorial board and other staff-were identified. Nine blocks of activity in the authentic dataset were not completely compatible with the activities defined in the master model. Also, five of the activity traces were not correctly enabled, and seven activities were missed within the online submission system. On the other hand, dealing with the feedback (comments) received from the first and the third reviewers; the conference committee members and the organizers did not attend to those feedback/comments in a timely manner.

Implementing a Peer Mentoring Model in the Clemson Eportfolio Program

ERIC Educational Resources Information Center

Ring, Gail L.

2015-01-01

Since the implementation of the ePortfolio Program in 2006, Clemson University has incorporated peer review for the formative feedback process. One of the challenges with this large-scale implementation has been ensuring that all work is reviewed and constructive feedback is provided in a timely manner. In this article, I discuss the strategies…

Long-term follow-up of a facilitated peer mentoring program.

PubMed

Mayer, Anita P; Blair, Janis E; Ko, Marcia G; Patel, Salma I; Files, Julia A

2014-03-01

Mentoring plays an important role in career success of academic medical faculty. New mentoring models such as peer mentoring have emerged. To evaluate the long-term impact of a facilitated peer mentoring program on academic achievements. Women faculty at the instructor or assistant professor rank were recruited to voluntarily participate in a facilitated peer mentoring program. Recruitment occurred over 3.8 years between 2005 and 2009. A 26-item questionnaire to assess academic skill, career satisfaction, and self-efficacy was administered before program participation and again with seven additional questions in 2011. Curriculum vitae were reviewed retrospectively to tally peer-reviewed publications, other academic activities, and promotions. Participants had long-term improvement in their perceived mastery of academic skills. Peer-reviewed publications, book chapters, abstracts, posters, and other academic activities increased when activities before the program were compared to those in the five years after program enrollment. At follow-up, participants reported positive perceptions of the program and 44% continued to work with their original peer mentor groups. Involvement in the facilitated peer mentoring program was associated with increased skills and academic activities for most participants. Future studies are needed to assess its applicability and success among various demographic groups in academic medicine.

Peer Observation of Teaching: The Interaction between Peer Review and Developmental Models of Practice

ERIC Educational Resources Information Center

Yiend, Jenny; Weller, Saranne; Kinchin, Ian

2014-01-01

Teaching observation is widely promoted as a mechanism for developing teaching practice in higher education. Specifically, formative peer observation is considered by many to be a powerful tool for providing feedback to individual teachers, disseminating disciplinary good practice and fostering a local evaluative enhancement culture. Despite its…

Peer reviewing e-learning: opportunities, challenges, and solutions.

PubMed

Ruiz, Jorge G; Candler, Chris; Teasdale, Thomas A

2007-05-01

Peer review is the foundation of academic publication and a necessary step in the scrutiny of any scholarly work. Simply defined, peer review is the attentive, unbiased assessment of any scholarly work that is submitted for formal scrutiny. Although medical school faculty increasingly use technology in clinical teaching, e-learning materials are often not subjected to a rigorous peer review process. The authors contrast peer review of e-learning materials with that of print materials, describe peer review issues regarding e-learning materials, propose approaches to address the challenges of peer review of e-learning materials, and outline directions for refinement of the e-learning peer review process. At its core, the peer review of e-learning materials should not differ substantially from that of traditional manuscripts. However, e-learning introduces new demands that impel reviewers to consider aspects that are unique to educational technology, including pedagogy, format, usability, navigation, interactivity, delivery, ease of updating, distribution, and access. Four approaches are offered to ease the burden and improve the quality of e-learning peer review: develop peer review training, embrace multidisciplinary peer review, develop guidelines, and provide incentives and compensation. The authors conclude with suggestions about peer review research.

28 CFR 34.106 - Number of peer reviewers.

Code of Federal Regulations, 2010 CFR

2010-07-01

... 28 Judicial Administration 1 2010-07-01 2010-07-01 false Number of peer reviewers. 34.106 Section 34.106 Judicial Administration DEPARTMENT OF JUSTICE OJJDP COMPETITION AND PEER REVIEW PROCEDURES Peer Review § 34.106 Number of peer reviewers. The number of peer reviewers will vary by program (as...

28 CFR 34.106 - Number of peer reviewers.

Code of Federal Regulations, 2013 CFR

2013-07-01

... 28 Judicial Administration 1 2013-07-01 2013-07-01 false Number of peer reviewers. 34.106 Section 34.106 Judicial Administration DEPARTMENT OF JUSTICE OJJDP COMPETITION AND PEER REVIEW PROCEDURES Peer Review § 34.106 Number of peer reviewers. The number of peer reviewers will vary by program (as...

Analysis of Atmospheric Aerosol Data Sets and Application of Radiative Transfer Models to Compute Aerosol Effects

NASA Technical Reports Server (NTRS)

Schmid, Beat; Bergstrom, Robert W.; Redemann, Jens

2002-01-01

This report is the final report for "Analysis of Atmospheric Aerosol Data Sets and Application of Radiative Transfer Models to Compute Aerosol Effects". It is a bibliographic compilation of 29 peer-reviewed publications (published, in press or submitted) produced under this Cooperative Agreement and 30 first-authored conference presentations. The tasks outlined in the various proposals are listed below with a brief comment as to the research performed. Copies of title/abstract pages of peer-reviewed publications are attached.

Clinical peer review in the United States: history, legal development and subsequent abuse.

PubMed

Vyas, Dinesh; Hozain, Ahmed E

2014-06-07

The Joint Commission on Accreditation requires hospitals to conduct peer review to retain accreditation. Despite the intended purpose of improving quality medical care, the peer review process has suffered several setbacks throughout its tenure. In the 1980s, abuse of peer review for personal economic interest led to a highly publicized multimillion-dollar verdict by the United States Supreme Court against the perpetrating physicians and hospital. The verdict led to decreased physician participation for fear of possible litigation. Believing that peer review was critical to quality medical care, Congress subsequently enacted the Health Care Quality Improvement Act (HCQIA) granting comprehensive legal immunity for peer reviewers to increase participation. While serving its intended goal, HCQIA has also granted peer reviewers significant immunity likely emboldening abuses resulting in Sham Peer Reviews. While legal reform of HCQIA is necessary to reduce sham peer reviews, further measures including the need for standardization of the peer review process alongside external organizational monitoring are critical to improving peer review and reducing the prevalence of sham peer reviews.

Clinical peer review in the United States: History, legal development and subsequent abuse

PubMed Central

Vyas, Dinesh; Hozain, Ahmed E

2014-01-01

The Joint Commission on Accreditation requires hospitals to conduct peer review to retain accreditation. Despite the intended purpose of improving quality medical care, the peer review process has suffered several setbacks throughout its tenure. In the 1980s, abuse of peer review for personal economic interest led to a highly publicized multimillion-dollar verdict by the United States Supreme Court against the perpetrating physicians and hospital. The verdict led to decreased physician participation for fear of possible litigation. Believing that peer review was critical to quality medical care, Congress subsequently enacted the Health Care Quality Improvement Act (HCQIA) granting comprehensive legal immunity for peer reviewers to increase participation. While serving its intended goal, HCQIA has also granted peer reviewers significant immunity likely emboldening abuses resulting in Sham Peer Reviews. While legal reform of HCQIA is necessary to reduce sham peer reviews, further measures including the need for standardization of the peer review process alongside external organizational monitoring are critical to improving peer review and reducing the prevalence of sham peer reviews. PMID:24914357

Continuing Education: The Emergence of a Functioning Model.

ERIC Educational Resources Information Center

Graziano, John A.; Roberts, Elizabeth H.

1980-01-01

The basic models of mandated, postlicensing, educational activity for professionals are reviewed including: (1) podiatry model (course content, mode of delivery, lecturer credentials, and administrative controls); (2) continuing competence model; and (3) peer review model. The podiatry model is thought to be the most logical, expedient, and…

Open peer review at four STEM journals: an observational overview.

PubMed

Ford, Emily

2015-01-01

Open peer review, peer review where authors' and reviewers' identities are disclosed to one another, is a growing trend in scholarly publishing. Through observation of four journals in STEM disciplines, PLOS One, Atmospheric Chemistry & Physics, PeerJ, and F1000Research, an observational overview is conducted. The overview relies on defined characteristics of open peer review. Results show that despite differing open peer review implementations, each journal retains editorial involvement in scholarly publishing. Further, the analysis shows that only one of these implementations is fully transparent in its peer review and decision making process. Finally, the overview contends that journals should clearly outline peer review and editorial processes in order to allow for open peer review to be better understood and adopted by authors, reviewers, editors, and readers of science communications.

Dyadic, Triadic, and Group Models of Peer Supervision/Consultation: What Are Their Components, and Is There Evidence of Their Effectiveness?

ERIC Educational Resources Information Center

Borders, L. DiAnne

2012-01-01

Models that meet the Psychology Board of Australia's definition of peer consultation include dyadic, triadic, and group formats. Components of these models (e.g., goals, theoretical basis, role of leader, members' roles, structure, and steps in procedure, stages in group development) are presented, and evidence of their effectiveness is reviewed.…

An Exploratory Study: Assessment of Modeled Dioxin Exposure in Ceramic Art Studios (External Review Draft)

EPA Science Inventory

EPA has released an external review draft entitled, An Exploratory Study: Assessment of Modeled Dioxin Exposure in Ceramic Art Studios(External Review Draft). The public comment period and the external peer-review workshop are separate processes that provide opportunities ...

Peer review and the publication process.

PubMed

Ali, Parveen Azam; Watson, Roger

2016-10-01

To provide an overview of the peer review process, its various types, selection of peer reviewers, the purpose and significance of the peer review with regard to the assessment and management of quality of publications in academic journals. Discussion paper. This paper draws on information gained from literature on the peer review process and the authors' knowledge and experience of contributing as peer reviewers and editors in the field of health care, including nursing. There are various types of peer review: single blind; double blind; open; and post-publication review. The role of the reviewers in reviewing manuscripts and their contribution to the scientific and academic community remains important.

How does peer teaching compare to faculty teaching? A systematic review and meta-analysis (.).

PubMed

Rees, Eliot L; Quinn, Patrick J; Davies, Benjamin; Fotheringham, Victoria

2016-08-01

In undergraduate medical education, peer-teaching has become an established and common method to enhance student learning. Evidence suggests that peer-teaching provides learning benefits for both learners and tutors. We aimed to describe the outcomes for medical students taught by peers through systematic review and meta-analysis of existing literature. Seven databases were searched through 21 terms and their Boolean combinations. Studies reporting knowledge or skills outcomes of students taught by peers compared to those taught by faculty or qualified clinicians were included. Extracted data on students' knowledge and skills outcomes were synthesised through a random effects model meta-analysis. The search yielded 2292 studies. Five hundred and fifty-three duplicates and 1611 irrelevant articles were removed during title-screening. The abstracts of 128 papers were screened against the inclusion and exclusion criteria. Ten studies have been included in the review. Meta-analyses showed no significant difference in peer-teaching compared to faculty teaching for knowledge or skills outcomes, standardised mean differences were 0.07 (95% CI: -0.07, 0.21) and 0.11 (95% CI: -0.07, 1.29), respectively. Students taught by peers do not have significantly different outcomes to those taught by faculty. As the process of teaching helps to develop both tutor knowledge and teaching skills, peer-teaching should be supported.

The validation of peer review through research impact measures and the implications for funding strategies.

PubMed

Gallo, Stephen A; Carpenter, Afton S; Irwin, David; McPartland, Caitlin D; Travis, Joseph; Reynders, Sofie; Thompson, Lisa A; Glisson, Scott R

2014-01-01

There is a paucity of data in the literature concerning the validation of the grant application peer review process, which is used to help direct billions of dollars in research funds. Ultimately, this validation will hinge upon empirical data relating the output of funded projects to the predictions implicit in the overall scientific merit scores from the peer review of submitted applications. In an effort to address this need, the American Institute of Biological Sciences (AIBS) conducted a retrospective analysis of peer review data of 2,063 applications submitted to a particular research program and the bibliometric output of the resultant 227 funded projects over an 8-year period. Peer review scores associated with applications were found to be moderately correlated with the total time-adjusted citation output of funded projects, although a high degree of variability existed in the data. Analysis over time revealed that as average annual scores of all applications (both funded and unfunded) submitted to this program improved with time, the average annual citation output per application increased. Citation impact did not correlate with the amount of funds awarded per application or with the total annual programmatic budget. However, the number of funded applications per year was found to correlate well with total annual citation impact, suggesting that improving funding success rates by reducing the size of awards may be an efficient strategy to optimize the scientific impact of research program portfolios. This strategy must be weighed against the need for a balanced research portfolio and the inherent high costs of some areas of research. The relationship observed between peer review scores and bibliometric output lays the groundwork for establishing a model system for future prospective testing of the validity of peer review formats and procedures.

The Validation of Peer Review through Research Impact Measures and the Implications for Funding Strategies

PubMed Central

Gallo, Stephen A.; Carpenter, Afton S.; Irwin, David; McPartland, Caitlin D.; Travis, Joseph; Reynders, Sofie; Thompson, Lisa A.; Glisson, Scott R.

2014-01-01

There is a paucity of data in the literature concerning the validation of the grant application peer review process, which is used to help direct billions of dollars in research funds. Ultimately, this validation will hinge upon empirical data relating the output of funded projects to the predictions implicit in the overall scientific merit scores from the peer review of submitted applications. In an effort to address this need, the American Institute of Biological Sciences (AIBS) conducted a retrospective analysis of peer review data of 2,063 applications submitted to a particular research program and the bibliometric output of the resultant 227 funded projects over an 8-year period. Peer review scores associated with applications were found to be moderately correlated with the total time-adjusted citation output of funded projects, although a high degree of variability existed in the data. Analysis over time revealed that as average annual scores of all applications (both funded and unfunded) submitted to this program improved with time, the average annual citation output per application increased. Citation impact did not correlate with the amount of funds awarded per application or with the total annual programmatic budget. However, the number of funded applications per year was found to correlate well with total annual citation impact, suggesting that improving funding success rates by reducing the size of awards may be an efficient strategy to optimize the scientific impact of research program portfolios. This strategy must be weighed against the need for a balanced research portfolio and the inherent high costs of some areas of research. The relationship observed between peer review scores and bibliometric output lays the groundwork for establishing a model system for future prospective testing of the validity of peer review formats and procedures. PMID:25184367

Peer Review of Best Practices

NASA Astrophysics Data System (ADS)

Pearlman, J.; Buttigieg, P. L.; Simpson, P.; Munoz, C.; Dufois, F.; Heslop, E. E.

2017-12-01

To ensure the quality of oceanographic data, there is a clear need to employ best practices (BPs) for ocean observation and information management. However, effectively discovering these BPs is a challenge, hindering harmonized quality assurance across projects and programmes. To remedy this, we are prototyping a resource for the stable archiving and efficient discovery of BPs through a granular, semantically indexed, and consistently formatted web resource. While these technical advances have value, they cannot ensure improved oceanographic data quality without effective and inclusive peer review processes. Peer review of digitized best practices can take a number of forms from traditional (blind) peer review as practiced by journal publishers through to the evolving "open" approach where community reviews have both the authors and reviewers identified. This presentation will discuss the options for peer review mechanisms for best practices, including a hybrid approach where both expert panels and open community review are used to improve methodologies and thus downstream data quality. It is not yet clear if the ocean community prefers open versus blind reviews for best practices. It is also unclear the extent to which innovation versus solid technical base should have a higher priority in the reviews. Further, it is not clear whether the reviews should use an internal expert panel of the IODE OceanBestPractices Repository (http://www.oceanbestpractices.net/) or should be done as part of a journal publications process or both, as mentioned above. Thus, we will also describe our future approach to `field test' these review models on a multi-stakeholder compendium of digitized best practice documents.

A Scoping Review: Conceptualizations and Pedagogical Models of Learning in Nursing Simulation

ERIC Educational Resources Information Center

Poikela, Paula; Teräs, Marianne

2015-01-01

Simulations have been implemented globally in nursing education for years with diverse conceptual foundations. The aim of this scoping review is to examine the literature regarding the conceptualizations of learning and pedagogical models in nursing simulations. A scoping review of peer-reviewed articles published between 2000 and 2013 was…

Healthcare system intervention for prevention of birth injuries – process evaluation of self-assessment, peer review, feedback and agreement for change

PubMed Central

2012-01-01

Background Patient safety is fundamental in high quality healthcare systems but despite an excellent record of perinatal care in Sweden some children still suffer from substandard care and unnecessary birth injuries. Sustainable patient safety improvements assume changes in key actors’ mental models, norms and culture as well as in the tools, design and organisation of work. Interventions positively affecting team mental models on safety issues are a first step to enhancing change. Our purpose was to study a national intervention programme for the prevention of birth injuries with the aim to elucidate how the main interventions of self-assessment, peer review, feedback and written agreement for change affected the teams and their mental model of patient safety, and thereby their readiness for change. Knowledge of relevant considerations before implementing this type of patient safety intervention series could thereby be increased. Methods Eighty participants in twenty-seven maternity units were interviewed after the first intervention sequence of the programme. A content analysis using a priori coding was performed in order to relate results to the anticipated outcomes of three basic interventions: self-assessment, peer review and written feedback, and agreement for change. Results The self-assessment procedure was valuable and served as a useful tool for elucidating strengths and weaknesses and identifying areas for improvement for a safer delivery in maternity units. The peer-review intervention was appreciated, despite it being of less value when considering the contribution to explicit outcome effects (i.e. new input to team mental models and new suggestions for actions). The feedback report and the mutual agreement on measures for improvements reached when signing the contract seemed exert positive pressures for change. Conclusions Our findings are in line with several studies stressing the importance of self-evaluation by encouraging a thorough review of objectives, practices and outcomes for the continuous improvement of an organisation. Even though effects of the peer review were limited, feedback from peers, or other change agents involved, and the support that a clear and well-structured action plan can provide are considered to be two important complements to future self-assessment procedures related to patient safety improvement. PMID:22920327

28 CFR 34.110 - Management of peer reviews.

Code of Federal Regulations, 2010 CFR

2010-07-01

... 28 Judicial Administration 1 2010-07-01 2010-07-01 false Management of peer reviews. 34.110 Section 34.110 Judicial Administration DEPARTMENT OF JUSTICE OJJDP COMPETITION AND PEER REVIEW PROCEDURES Peer Review § 34.110 Management of peer reviews. A technical support contractor may assist in managing...

28 CFR 34.102 - Peer review procedures.

Code of Federal Regulations, 2010 CFR

2010-07-01

...” describes a process that evolves in accordance with experience and opportunities to effect improvements. The... Review § 34.102 Peer review procedures. The OJJDP peer review process is contained in an OJJDP “Peer... substantive and procedural matters related to the peer review process, the “Guideline” addresses such issues...

Ethics of reviewing scientific publications.

PubMed

Napolitani, Federica; Petrini, Carlo; Garattini, Silvio

2017-05-01

The approval or rejection of scientific publications can have important consequences for scientific knowledge, so considerable responsibility lies on those who have to assess or review them. Today it seems that the peer review process, far from being considered an outdated system to be abandoned, is experiencing a new upturn. This article proposes criteria for the conduct of reviewers and of those who select them. While commenting on new emerging models, it provides practical recommendations for improving the peer-review system, like strengthening the role of guidelines and training and supporting reviewers. The process of peer review is changing, it is getting more open and collaborative, but those same ethical principles which guided it from its very origin should remain untouched and be firmly consolidated. The paper highlights how the ethics of reviewing scientific publications is needed now more than ever, in particular with regard to competence, conflict of interest, willingness to discuss decisions, complete transparency and integrity. Copyright © 2016 European Federation of Internal Medicine. Published by Elsevier B.V. All rights reserved.

The ethics of peer review in bioethics

PubMed Central

Wendler, David; Miller, Franklin

2014-01-01

A good deal has been written on the ethics of peer review, especially in the scientific and medical literatures. In contrast, we are unaware of any articles on the ethics of peer review in bioethics. Recognising this gap, we evaluate the extant proposals regarding ethical standards for peer review in general and consider how they apply to bioethics. We argue that scholars have an obligation to perform peer review based on the extent to which they personally benefit from the peer review process. We also argue, contrary to existing proposals and guidelines, that it can be appropriate for peer reviewers to benefit in their own scholarship from the manuscripts they review. With respect to bioethics in particular, we endorse double-blind review and suggest several ways in which the peer review process might be improved. PMID:24131903

Primary process and peer consultation: an experiential model to work through countertransference.

PubMed

Markus, Howard E; Cross, Wendi F; Halewski, Paula G; Quallo, Hope; Smith, Sherrie; Sullivan, Marilyn; Sullivan, Peter; Tantillo, Mary

2003-01-01

Various models exist for peer supervision and consultation of group therapy. This article documents the authors' experience using an experiential group consultation of group therapy model that relies on primary process to overcome countertransference dilemmas. A review of group therapy supervision and consultation models is followed by vignettes from the authors' experience. Discussion of the vignettes highlight critical issues in group consultation and expound upon the strengths and challenges of using an experiential model.

Multilevel Modeling: A Review of Methodological Issues and Applications

ERIC Educational Resources Information Center

Dedrick, Robert F.; Ferron, John M.; Hess, Melinda R.; Hogarty, Kristine Y.; Kromrey, Jeffrey D.; Lang, Thomas R.; Niles, John D.; Lee, Reginald S.

2009-01-01

This study analyzed the reporting of multilevel modeling applications of a sample of 99 articles from 13 peer-reviewed journals in education and the social sciences. A checklist, derived from the methodological literature on multilevel modeling and focusing on the issues of model development and specification, data considerations, estimation, and…

45 CFR 1388.9 - Peer review.

Code of Federal Regulations, 2010 CFR

2010-10-01

... 45 Public Welfare 4 2010-10-01 2010-10-01 false Peer review. 1388.9 Section 1388.9 Public Welfare... PROGRAM THE UNIVERSITY AFFILIATED PROGRAMS § 1388.9 Peer review. (a) The purpose of the peer review... D, Section 152 of the Act, must be evaluated through the peer review process. (c) Panels must be...

Peer Review in Higher Education: Student Perceptions before and after Participation

ERIC Educational Resources Information Center

Mulder, Raoul A.; Pearce, Jon M.; Baik, Chi

2014-01-01

Peer review is integral to academic endeavour, but opportunities for students to benefit from peer review in higher education remain limited, and relatively little is known about how student perceptions influence their appreciation of peer review. University student perceptions were examined before and after experiencing student peer review in…

Peer Review: Has It a Future?

ERIC Educational Resources Information Center

Soh, Kay Cheng

2013-01-01

Although its history is short, peer review has fast become a fixture of journal publications acquiring the status of a ritual in the academia. Many relevant and important issues have been raised leading to doubts about the value of peer review. The advent of electronic publishing further threatens the future of peer review. For peer review to…

40 CFR 194.27 - Peer review.

Code of Federal Regulations, 2010 CFR

2010-07-01

... 40 Protection of Environment 24 2010-07-01 2010-07-01 false Peer review. 194.27 Section 194.27... § 194.27 Peer review. (a) Any compliance application shall include documentation of peer review that has... barrier evaluation as required in § 194.44. (b) Peer review processes required in paragraph (a) of this...

The privilege and burden of peer review.

PubMed

Blume, Arthur W; Schmaling, Karen B

2016-01-01

Peer review is a core value and method of quality control in psychological research, academic psychology, and other disciplines, but little is known about the peer-reviewing behavior of ethnic minority reviewers in particular. The purpose of this study was to examine the self-identified ethnicity of those invited to peer review articles for 76 journals that utilized the American Psychological Association's Journals Back Office (JBO) system from 2003 to 2012. It was hypothesized that a modest increase in the ratio of requests for reviews from self-identified ethnic minority reviewers would be observed over time, that self-identified ethnic minority reviewers would be less likely to refuse a review request than those who do not self-identify as an ethnic minority, and finally that increases in reviewer burden would be evident in significant increases in declines to requests by all reviewers. Reviewer requests and responses were examined among the 76 journals that used the JBO system over a 10-year period. Using hierarchical linear models, the percentage of review invitations extended to ethnic minorities was found to significantly increase over time: Initially, an estimated 8.34% of review requests were made to ethnic minority reviewers, and that percentage increased an average of 0.41% per year. Ethnic minority reviewers were significantly less likely to refuse a review request than ethnic majority reviewers. Results are discussed in terms of perceived pressure to demonstrate scholastic impact and the disproportionate service burden often borne by ethnic minority psychologists. (c) 2016 APA, all rights reserved).

A prospective study on an innovative online forum for peer reviewing of surgical science.

PubMed

Almquist, Martin; von Allmen, Regula S; Carradice, Dan; Oosterling, Steven J; McFarlane, Kirsty; Wijnhoven, Bas

2017-01-01

Peer review is important to the scientific process. However, the present system has been criticised and accused of bias, lack of transparency, failure to detect significant breakthrough and error. At the British Journal of Surgery (BJS), after surveying authors' and reviewers' opinions on peer review, we piloted an open online forum with the aim of improving the peer review process. In December 2014, a web-based survey assessing attitudes towards open online review was sent to reviewers with a BJS account in Scholar One. From April to June 2015, authors were invited to allow their manuscripts to undergo online peer review in addition to the standard peer review process. The quality of each review was evaluated by editors and editorial assistants using a validated instrument based on a Likert scale. The survey was sent to 6635 reviewers. In all, 1454 (21.9%) responded. Support for online peer review was strong, with only 10% stating that they would not subject their manuscripts to online peer review. The most prevalent concern was about intellectual property, being highlighted in 118 of 284 comments (41.5%). Out of 265 eligible manuscripts, 110 were included in the online peer review trial. Around 7000 potential reviewers were invited to review each manuscript. In all, 44 of 110 manuscripts (40%) received 100 reviews from 59 reviewers, alongside 115 conventional reviews. The quality of the open forum reviews was lower than for conventional reviews (2.13 (± 0.75) versus 2.84 (± 0.71), P<0.001). Open online peer review is feasible in this setting, but it attracts few reviews, of lower quality than conventional peer reviews.

The Effects of Resident Peer- and Self-Chart Review on Outpatient Laboratory Result Follow-up.

PubMed

Hale, Andrew J; Nall, Ryan W; Mukamal, Kenneth J; Libman, Howard; Smith, C Christopher; Sternberg, Scot B; Kim, Hans S; Kriegel, Gila

2016-05-01

Performing and teaching appropriate follow-up of outpatient laboratory results (LRs) is a challenge. The authors tested peer-review among residents as a potentially valuable intervention. Investigators assigned residents to perform self-review (n = 27), peer-review (n = 21), or self- + peer-review (n = 30) of outpatient charts. They also compared residence performance with that of historical controls (n = 20). In September 2012, residents examined 10 LRs from April 2012 onward. A second review in November 2012 ascertained whether performing chart review improved residents' practice behaviors. Initially, the least-square (LS) mean number of LRs without documentation of follow-up per resident in the self-, peer-, and self- + peer-review group was, respectively, 0.5 (SD 1.0), 1.0 (SD 1.7), and 0.9 (SD 1.3), and post intervention, this was 1.0 (SD 0.2), 0.3 (SD 0.2), and 0.6 (SD 0.2) (self- versus peer-review P = .03). Initially the LS mean follow-up time per resident in the self-, peer-, and self- + peer-review group was, respectively, 4.2 (SD 1.2), 6.9 (SD 1.4), and 5.9 (SD 1.2) days, and after the intervention, LS mean time was 5.0 (SD 0.5), 2.5 (SD 0.6), and 3.9 (SD 0.5) days (self- versus peer-review P < .01). Self-review was not associated with significant improvements in practice. In this comparison of self- and peer-review, only residents who performed peer-review demonstrated significant improvements in their documentation practices. These findings support the use of resident peer-review in improving LR follow-up, and potentially, in other, broader resident quality improvement initiatives.

Defining "peerness": Developing peer supports for parents with mental illnesses.

PubMed

Nicholson, Joanne; Valentine, Anne

2018-06-01

This article addresses critical considerations in the development of peer supports for parents with mental illnesses, focusing on the question of what makes a peer a peer in the parent peer specialist domain. The implementation and testing of parent peer supports requires specification of the critical components of the model, including the qualities, characteristics, and unique contributions of the parent peer specialist. Themes emerged in Parent Peer Specialist Project Advisory Group discussions, with members drawing from lived experience, practice expertise, and conversations with experts. In addition to literature review, strategic stakeholder interviews were conducted. Lived experience of mental illness and family life, training, and ongoing support for parent peer specialists, along with key ingredients conveyed by perceived peer-parent similarity, will likely enhance the benefits of peer supports to parents and promote job satisfaction and career advancement for parent peer specialists. (PsycINFO Database Record (c) 2018 APA, all rights reserved).

A prospective study on an innovative online forum for peer reviewing of surgical science

PubMed Central

von Allmen, Regula S.; Carradice, Dan; Oosterling, Steven J.; McFarlane, Kirsty; Wijnhoven, Bas

2017-01-01

Background Peer review is important to the scientific process. However, the present system has been criticised and accused of bias, lack of transparency, failure to detect significant breakthrough and error. At the British Journal of Surgery (BJS), after surveying authors’ and reviewers’ opinions on peer review, we piloted an open online forum with the aim of improving the peer review process. Methods In December 2014, a web-based survey assessing attitudes towards open online review was sent to reviewers with a BJS account in Scholar One. From April to June 2015, authors were invited to allow their manuscripts to undergo online peer review in addition to the standard peer review process. The quality of each review was evaluated by editors and editorial assistants using a validated instrument based on a Likert scale. Results The survey was sent to 6635 reviewers. In all, 1454 (21.9%) responded. Support for online peer review was strong, with only 10% stating that they would not subject their manuscripts to online peer review. The most prevalent concern was about intellectual property, being highlighted in 118 of 284 comments (41.5%). Out of 265 eligible manuscripts, 110 were included in the online peer review trial. Around 7000 potential reviewers were invited to review each manuscript. In all, 44 of 110 manuscripts (40%) received 100 reviews from 59 reviewers, alongside 115 conventional reviews. The quality of the open forum reviews was lower than for conventional reviews (2.13 (± 0.75) versus 2.84 (± 0.71), P<0.001). Conclusion Open online peer review is feasible in this setting, but it attracts few reviews, of lower quality than conventional peer reviews. PMID:28662046

Variability in Students' Evaluating Processes in Peer Assessment with Calibrated Peer Review

ERIC Educational Resources Information Center

Russell, J.; Van Horne, S.; Ward, A. S.; Bettis, E. A., III; Gikonyo, J.

2017-01-01

This study investigated students' evaluating process and their perceptions of peer assessment when they engaged in peer assessment using Calibrated Peer Review. Calibrated Peer Review is a web-based application that facilitates peer assessment of writing. One hundred and thirty-two students in an introductory environmental science course…

Peer Review as a Strategy for Improving Students' Writing Process

ERIC Educational Resources Information Center

Baker, Kimberly M.

2016-01-01

Peer review is an established strategy for improving the quality of students' writing. This study moves beyond the focus on outcomes to assess the peer-review process. In particular, this study focuses on the timing of the peer review, a highly structured feedback form, and student writers' revisions after engaging in peer review. This study draws…

Designing Peer Review for Pedagogical Success: What Can We Learn from Professional Science?

ERIC Educational Resources Information Center

Trautmann, Nancy M.

2009-01-01

This article compares peer review in professional versus education settings, summarizing key aspects of scientific peer review and reflecting on how these relate to the process as experienced by students. Consideration of professional peer review benefits educators in two ways. First, systems used for student peer review can employ some of the…

34 CFR 350.50 - What is the peer review process for this Program?

Code of Federal Regulations, 2010 CFR

2010-07-01

... 34 Education 2 2010-07-01 2010-07-01 false What is the peer review process for this Program? 350... peer review process for this Program? (a) The Secretary refers each application for a grant governed by those regulations in this part to a peer review panel established by the Secretary. (b) Peer review...

The Power of Peer Reviewing to Enhance Writing in Horticulture: Greenhouse Management

ERIC Educational Resources Information Center

Anderson, Neil O.; Flash, Pamela

2014-01-01

Peer review is not included in undergraduate horticultural curricula. Our research objectives in an 8- year study, which ranged from 2000 to 2007 in two sections (2000-2002 non-peer reviewed and 2003-2007 peer-reviewed) of Greenhouse Management students at the University of Minnesota were to determine whether iterative peer reviews would result in…

28 CFR 34.102 - Peer review procedures.

Code of Federal Regulations, 2011 CFR

2011-07-01

... 28 Judicial Administration 1 2011-07-01 2011-07-01 false Peer review procedures. 34.102 Section 34.102 Judicial Administration DEPARTMENT OF JUSTICE OJJDP COMPETITION AND PEER REVIEW PROCEDURES Peer... substantive and procedural matters related to the peer review process, the “Guideline” addresses such issues...

28 CFR 34.102 - Peer review procedures.

Code of Federal Regulations, 2014 CFR

2014-07-01

... 28 Judicial Administration 1 2014-07-01 2014-07-01 false Peer review procedures. 34.102 Section 34.102 Judicial Administration DEPARTMENT OF JUSTICE OJJDP COMPETITION AND PEER REVIEW PROCEDURES Peer... substantive and procedural matters related to the peer review process, the “Guideline” addresses such issues...

28 CFR 34.102 - Peer review procedures.

Code of Federal Regulations, 2012 CFR

2012-07-01

... 28 Judicial Administration 1 2012-07-01 2012-07-01 false Peer review procedures. 34.102 Section 34.102 Judicial Administration DEPARTMENT OF JUSTICE OJJDP COMPETITION AND PEER REVIEW PROCEDURES Peer... substantive and procedural matters related to the peer review process, the “Guideline” addresses such issues...

28 CFR 34.102 - Peer review procedures.

Code of Federal Regulations, 2013 CFR

2013-07-01

... 28 Judicial Administration 1 2013-07-01 2013-07-01 false Peer review procedures. 34.102 Section 34.102 Judicial Administration DEPARTMENT OF JUSTICE OJJDP COMPETITION AND PEER REVIEW PROCEDURES Peer... substantive and procedural matters related to the peer review process, the “Guideline” addresses such issues...

A survey of radiation treatment planning peer-review activities in a provincial radiation oncology programme: current practice and future directions

PubMed Central

Brundage, Michael; Foxcroft, Sophie; McGowan, Tom; Gutierrez, Eric; Sharpe, Michael; Warde, Padraig

2013-01-01

Objectives To describe current patterns of practice of radiation oncology peer review within a provincial cancer system, identifying barriers and facilitators to its use with the ultimate aim of process improvement. Design A survey of radiation oncology programmes at provincial cancer centres. Setting All cancer centres within the province of Ontario, Canada (n=14). These are community-based outpatient facilities overseen by Cancer Care Ontario, the provincial cancer agency. Participants A delegate from each radiation oncology programme filled out a single survey based on input from their multidisciplinary team. Outcome measures Rated importance of peer review; current utilisation; format of the peer-review process; organisation and timing; case attributes; outcomes of the peer-review process and perceived barriers and facilitators to expanding peer-review processes. Results 14 (100%) centres responded. All rated the importance of peer review as at least 8/10 (10=extremely important). Detection of medical error and improvement of planning processes were the highest rated perceived benefits of peer review (each median 9/10). Six centres (43%) reviewed at least 50% of curative cases; four of these centres (29%) conducted peer review in more than 80% of cases treated with curative intent. Fewer than 20% of cases treated with palliative intent were reviewed in most centres. Five centres (36%) reported usually conducting peer review prior to the initiation of treatment. Five centres (36%) recorded the outcomes of peer review on the medical record. Thirteen centres (93%) planned to expand peer-review activities; a critical mass of radiation oncologists was the most important limiting factor (median 6/10). Conclusions Radiation oncology peer-review practices can vary even within a cancer system with provincial oversight. The application of guidelines and standards for peer-review processes, and monitoring of implementation and outcomes, will require effective knowledge translation activities. PMID:23903814

Evaluation of the Inhalation Carcinogenicity of Ethylene Oxide ...

EPA Pesticide Factsheets

On September 22, 2006, the draft Evaluation of the Carinogenicity of Ethylene Oxide (EPA/635/R-06/003) and the draft charge to external peer reviewers were released for external peer review and public comment. This draft was reviewed by EPA’s Science Advisory Board (SAB) and the expert panel’s final report was made available December 21, 2007. Since that time the Agency implemented the May 2009 IRIS assessment development process in which other federal agencies and the Executive Offices of the President are provided two opportunities to comment on IRIS human health assessments; Interagency Science Consultation (Step 3) prior to public comment/peer review and Interagency Science Discussion (Step 6b) following peer review. In July, 2011, the draft assessment incorporating the SAB recommendations (December 2007) was sent to other federal agencies and Executive Offices of the President as part of Step 6 of the IRIS process. Following the May 2009 process, all written comments submitted by other agencies will be made publicly available. Accordingly, the interagency comments for ethylene oxide and the interagency science discussion materials provided to the other agencies are posted on this site. Note: After further consideration EPA has decided to undertake an additional peer review of the revised draft assessment on how the Agency responded to the SAB panel recommendations (December 2007), the exposure-response modeling of epidemiologic data, including n

28 CFR 34.108 - Selection of reviewers.

Code of Federal Regulations, 2010 CFR

2010-07-01

....108 Judicial Administration DEPARTMENT OF JUSTICE OJJDP COMPETITION AND PEER REVIEW PROCEDURES Peer Review § 34.108 Selection of reviewers. The Program Manager, through the Director of the OJJDP program... by the Administrator. The selection process for peer reviewers is detailed in the OJJDP “Peer Review...

7 CFR 3400.21 - Scientific peer review for research activities.

Code of Federal Regulations, 2011 CFR

2011-01-01

... 7 Agriculture 15 2011-01-01 2011-01-01 false Scientific peer review for research activities. 3400... § 3400.21 Scientific peer review for research activities. Scientific peer review is an evaluation of a... with the scientific knowledge and technical skills to conduct the proposed research work. Peer...

Web quality control for lectures: Supercourse and Amazon.com.

PubMed

Linkov, Faina; LaPorte, Ronald; Lovalekar, Mita; Dodani, Sunita

2005-12-01

Peer review has been at the corner stone of quality control of the biomedical journals in the past 300 years. With the emergency of the Internet, new models of quality control and peer review are emerging. However, such models are poorly investigated. We would argue that the popular system of quality control used in Amazon.com offers a way to ensure continuous quality improvement in the area of research communications on the Internet. Such system is providing an interesting alternative to the traditional peer review approaches used in the biomedical journals and challenges the traditional paradigms of scientific publishing. This idea is being explored in the context of Supercourse, a library of 2,350 prevention lectures, shared for free by faculty members from over 150 countries. Supercourse is successfully utilizing quality control approaches that are similar to Amazon.com model. Clearly, the existing approaches and emerging alternatives for quality control in scientific communications needs to be assessed scientifically. Rapid explosion of internet technologies could be leveraged to produce better, more cost effective systems for quality control in the biomedical publications and across all sciences.

Peer Review in Scientific Publications: Benefits, Critiques, & A Survival Guide

PubMed Central

Kelly, Jacalyn; Sadeghieh, Tara

2014-01-01

Peer review has been defined as a process of subjecting an author’s scholarly work, research or ideas to the scrutiny of others who are experts in the same field. It functions to encourage authors to meet the accepted high standards of their discipline and to control the dissemination of research data to ensure that unwarranted claims, unacceptable interpretations or personal views are not published without prior expert review. Despite its wide-spread use by most journals, the peer review process has also been widely criticised due to the slowness of the process to publish new findings and due to perceived bias by the editors and/or reviewers. Within the scientific community, peer review has become an essential component of the academic writing process. It helps ensure that papers published in scientific journals answer meaningful research questions and draw accurate conclusions based on professionally executed experimentation. Submission of low quality manuscripts has become increasingly prevalent, and peer review acts as a filter to prevent this work from reaching the scientific community. The major advantage of a peer review process is that peer-reviewed articles provide a trusted form of scientific communication. Since scientific knowledge is cumulative and builds on itself, this trust is particularly important. Despite the positive impacts of peer review, critics argue that the peer review process stifles innovation in experimentation, and acts as a poor screen against plagiarism. Despite its downfalls, there has not yet been a foolproof system developed to take the place of peer review, however, researchers have been looking into electronic means of improving the peer review process. Unfortunately, the recent explosion in online only/electronic journals has led to mass publication of a large number of scientific articles with little or no peer review. This poses significant risk to advances in scientific knowledge and its future potential. The current article summarizes the peer review process, highlights the pros and cons associated with different types of peer review, and describes new methods for improving peer review. PMID:27683470

Random Versus Nonrandom Peer Review: A Case for More Meaningful Peer Review.

PubMed

Itri, Jason N; Donithan, Adam; Patel, Sohil H

2018-05-10

Random peer review programs are not optimized to discover cases with diagnostic error and thus have inherent limitations with respect to educational and quality improvement value. Nonrandom peer review offers an alternative approach in which diagnostic error cases are targeted for collection during routine clinical practice. The objective of this study was to compare error cases identified through random and nonrandom peer review approaches at an academic center. During the 1-year study period, the number of discrepancy cases and score of discrepancy were determined from each approach. The nonrandom peer review process collected 190 cases, of which 60 were scored as 2 (minor discrepancy), 94 as 3 (significant discrepancy), and 36 as 4 (major discrepancy). In the random peer review process, 1,690 cases were reviewed, of which 1,646 were scored as 1 (no discrepancy), 44 were scored as 2 (minor discrepancy), and none were scored as 3 or 4. Several teaching lessons and quality improvement measures were developed as a result of analysis of error cases collected through the nonrandom peer review process. Our experience supports the implementation of nonrandom peer review as a replacement to random peer review, with nonrandom peer review serving as a more effective method for collecting diagnostic error cases with educational and quality improvement value. Copyright © 2018 American College of Radiology. Published by Elsevier Inc. All rights reserved.

Peer Review Practices for Evaluating Biomedical Research Grants: A Scientific Statement From the American Heart Association.

PubMed

Liaw, Lucy; Freedman, Jane E; Becker, Lance B; Mehta, Nehal N; Liscum, Laura

2017-08-04

The biomedical research enterprise depends on the fair and objective peer review of research grants, leading to the distribution of resources through efficient and robust competitive methods. In the United States, federal funding agencies and foundations collectively distribute billions of dollars annually to support biomedical research. For the American Heart Association, a Peer Review Subcommittee is charged with establishing the highest standards for peer review. This scientific statement reviews the current literature on peer review practices, describes the current American Heart Association peer review process and those of other agencies, analyzes the strengths and weaknesses of American Heart Association peer review practices, and recommends best practices for the future. © 2017 American Heart Association, Inc.

The Impact of Peer Review on Writing in a Psychology Course: Lessons Learned

ERIC Educational Resources Information Center

Bhullar, Naureen; Rose, Karen C.; Utell, Janine M.; Healey, Kathryn N.

2014-01-01

The authors assessed the impact of peer review on student writing in four sections of an undergraduate Developmental Psychology course. They hypothesized that peer review would result in better writing in the peer review group compared to the group with no peer review. Writing was rated independently by two instructors who were blind to the…

28 CFR 34.111 - Compensation.

Code of Federal Regulations, 2010 CFR

2010-07-01

... Judicial Administration DEPARTMENT OF JUSTICE OJJDP COMPETITION AND PEER REVIEW PROCEDURES Peer Review § 34.111 Compensation. All peer reviewers will be eligible to be paid according to applicable regulations... provided in the OJJDP “Peer Review Guideline”. ...

Scholarly publishing depends on peer reviewers.

PubMed

Fernandez-Llimos, Fernando

2018-01-01

The peer-review crisis is posing a risk to the scholarly peer-reviewed journal system. Journals have to ask many potential peer reviewers to obtain a minimum acceptable number of peers accepting reviewing a manuscript. Several solutions have been suggested to overcome this shortage. From reimbursing for the job, to eliminating pre-publication reviews, one cannot predict which is more dangerous for the future of scholarly publishing. And, why not acknowledging their contribution to the final version of the article published? PubMed created two categories of contributors: authors [AU] and collaborators [IR]. Why not a third category for the peer-reviewer?

The ethics of peer review in bioethics.

PubMed

Wendler, David; Miller, Franklin

2014-10-01

A good deal has been written on the ethics of peer review, especially in the scientific and medical literatures. In contrast, we are unaware of any articles on the ethics of peer review in bioethics. Recognising this gap, we evaluate the extant proposals regarding ethical standards for peer review in general and consider how they apply to bioethics. We argue that scholars have an obligation to perform peer review based on the extent to which they personally benefit from the peer review process. We also argue, contrary to existing proposals and guidelines, that it can be appropriate for peer reviewers to benefit in their own scholarship from the manuscripts they review. With respect to bioethics in particular, we endorse double-blind review and suggest several ways in which the peer review process might be improved. Published by the BMJ Publishing Group Limited. For permission to use (where not already granted under a licence) please go to http://group.bmj.com/group/rights-licensing/permissions.

Medical journal peer review: process and bias.

PubMed

Manchikanti, Laxmaiah; Kaye, Alan D; Boswell, Mark V; Hirsch, Joshua A

2015-01-01

Scientific peer review is pivotal in health care research in that it facilitates the evaluation of findings for competence, significance, and originality by qualified experts. While the origins of peer review can be traced to the societies of the eighteenth century, it became an institutionalized part of the scholarly process in the latter half of the twentieth century. This was a response to the growth of research and greater subject specialization. With the current increase in the number of specialty journals, the peer review process continues to evolve to meet the needs of patients, clinicians, and policy makers. The peer review process itself faces challenges. Unblinded peer review might suffer from positive or negative bias towards certain authors, specialties, and institutions. Peer review can also suffer when editors and/or reviewers might be unable to understand the contents of the submitted manuscript. This can result in an inability to detect major flaws, or revelations of major flaws after acceptance of publication by the editors. Other concerns include potentially long delays in publication and challenges uncovering plagiarism, duplication, corruption and scientific misconduct. Conversely, a multitude of these challenges have led to claims of scientific misconduct and an erosion of faith. These challenges have invited criticism of the peer review process itself. However, despite its imperfections, the peer review process enjoys widespread support in the scientific community. Peer review bias is one of the major focuses of today's scientific assessment of the literature. Various types of peer review bias include content-based bias, confirmation bias, bias due to conservatism, bias against interdisciplinary research, publication bias, and the bias of conflicts of interest. Consequently, peer review would benefit from various changes and improvements with appropriate training of reviewers to provide quality reviews to maintain the quality and integrity of research without bias. Thus, an appropriate, transparent peer review is not only ideal, but necessary for the future to facilitate scientific progress.

Peer Review and the Assessment of Higher Education Quality: An International Perspective. Higher Education Report No. 3.

ERIC Educational Resources Information Center

Brennan, John; And Others

This report examines the practices of 19 peer review agencies in the United States, Britain, Denmark, Germany, France, the Netherlands, and Hong Kong to determine variations in peer review in the field of higher education. The report addresses: (1) the sources of authority for peer review; (2) the types and status of peer reviewers; (3) the…

Four Mechanistic Models of Peer Influence on Adolescent Cannabis Use

PubMed Central

Caouette, Justin D.; Feldstein Ewing, Sarah W.

2017-01-01

Purpose of review Most adolescents begin exploring cannabis in peer contexts, but the neural mechanisms that underlie peer influence on adolescent cannabis use are still unknown. This theoretical overview elucidates the intersecting roles of neural function and peer factors in cannabis use in adolescents. Recent findings Novel paradigms using functional magnetic resonance imaging (fMRI) in adolescents have identified distinct neural mechanisms of risk decision-making and incentive processing in peer contexts, centered on reward-motivation and affect regulatory neural networks; these findings inform a theoretical model of peer-driven cannabis use decisions in adolescents. Summary We propose four “mechanistic profiles” of social facilitation of cannabis use in adolescents: (1) peer influence as the primary driver of use; (2) cannabis exploration as the primary driver, which may be enhanced in peer contexts; (3) social anxiety; and (4) negative peer experiences. Identification of “neural targets” involved in motivating cannabis use may inform clinicians about which treatment strategies work best in adolescents with cannabis use problems, and via which social and neurocognitive processes. PMID:29104847

Re-Viewing Peer Review

ERIC Educational Resources Information Center

Flynn, Elizabeth A.

2011-01-01

In this article, the author revisits her essay, "Students as Readers of Their Classmates' Writing," by providing a review of the literature on peer review over the past three decades and comments on patterns she sees in waves of peer review research and theorizing. She describes her subsequent experience with peer review in her own classes, and…

Comparison of self-citation by peer reviewers in a journal with single-blind peer review versus a journal with open peer review.

PubMed

Levis, Alexander W; Leentjens, Albert F G; Levenson, James L; Lumley, Mark A; Thombs, Brett D

2015-12-01

Some peer reviewers may inappropriately, or coercively request that authors include references to the reviewers' own work. The objective of this study was to evaluate whether, compared to reviews for a journal with single-blind peer review, reviews for a journal with open peer review included (1) fewer self-citations; (2) a lower proportion of self-citations without a rationale; and (3) a lower ratio of proportions of citations without a rationale in self-citations versus citations to others' work. Peer reviews for published manuscripts submitted in 2012 to a single-blind peer review journal, the Journal of Psychosomatic Research, were previously evaluated (Thombs et al., 2015). These were compared to publically available peer reviews of manuscripts published in 2012 in an open review journal, BMC Psychiatry. Two investigators independently extracted data for both journals. There were no significant differences between journals in the proportion of all reviewer citations that were self-citations (Journal of Psychosomatic Research: 71/225, 32%; BMC Psychiatry: 90/315, 29%; p=.50), or in the proportion of self-citations without a rationale (Journal of Psychosomatic Research: 15/71, 21%; BMC Psychiatry: 12/90, 13%; p=.21). There was no significant difference between journals in the proportion of self-citations versus citations to others' work without a rationale (p=.31). Blind and open peer review methodologies have distinct advantages and disadvantages. The present study found that, in reasonably similar journals that use single-blind and open review, there were no substantive differences in the pattern of peer reviewer self-citations. Copyright © 2015 Elsevier Inc. All rights reserved.

Advancing Kinesiology through Improved Peer Review

ERIC Educational Resources Information Center

Knudson, Duane V.; Morrow, James R., Jr.; Thomas, Jerry R.

2014-01-01

Peer review of scholarship is essential to journal quality, evidence, knowledge advancement, and application of that knowledge in any field. This commentary summarizes recent literature on issues related to peer-review quality and current review practice in kinesiology and provides recommendations to improve peer review in kinesiology journals. We…

Demystifying the peer-review process - workshop

EPA Science Inventory

Scientific writing and peer-review are integral parts of the publishing process. This workshop aims to demystify the peer-review process for early career scientists and provide insightful tips for streamlining the submission and peer review process for all researchers. Providing ...

Academic Primer Series: Key Papers About Peer Review.

PubMed

Yarris, Lalena M; Gottlieb, Michael; Scott, Kevin; Sampson, Christopher; Rose, Emily; Chan, Teresa M; Ilgen, Jonathan

2017-06-01

Peer review, a cornerstone of academia, promotes rigor and relevance in scientific publishing. As educators are encouraged to adopt a more scholarly approach to medical education, peer review is becoming increasingly important. Junior educators both receive the reviews of their peers, and are also asked to participate as reviewers themselves. As such, it is imperative for junior clinician educators to be well-versed in the art of peer reviewing their colleagues' work. In this article, our goal was to identify and summarize key papers that may be helpful for faculty members interested in learning more about the peer-review process and how to improve their reviewing skills. The online discussions of the 2016-17 Academic Life in Emergency Medicine (ALiEM) Faculty Incubator program included a robust discussion about peer review, which highlighted a number of papers on that topic. We sought to augment this list with further suggestions by guest experts and by an open call on Twitter for other important papers. Via this process, we created a list of 24 total papers on the topic of peer review. After gathering these papers, our authorship group engaged in a consensus-building process incorporating Delphi methods to identify the papers that best described peer review, and also highlighted important tips for new reviewers. We found and reviewed 24 papers. In our results section, we present our authorship group's top five most highly rated papers on the topic of peer review. We also summarize these papers with respect to their relevance to junior faculty members and to faculty developers. We present five key papers on peer review that can be used for faculty development for novice writers and reviewers. These papers represent a mix of foundational and explanatory papers that may provide some basis from which junior faculty members might build upon as they both undergo the peer-review process and act as reviewers in turn.

Academic Primer Series: Key Papers About Peer Review

PubMed Central

Yarris, Lalena M.; Gottlieb, Michael; Scott, Kevin; Sampson, Christopher; Rose, Emily; Chan, Teresa M.; Ilgen, Jonathan

2017-01-01

Introduction Peer review, a cornerstone of academia, promotes rigor and relevance in scientific publishing. As educators are encouraged to adopt a more scholarly approach to medical education, peer review is becoming increasingly important. Junior educators both receive the reviews of their peers, and are also asked to participate as reviewers themselves. As such, it is imperative for junior clinician educators to be well-versed in the art of peer reviewing their colleagues’ work. In this article, our goal was to identify and summarize key papers that may be helpful for faculty members interested in learning more about the peer-review process and how to improve their reviewing skills. Methods The online discussions of the 2016–17 Academic Life in Emergency Medicine (ALiEM) Faculty Incubator program included a robust discussion about peer review, which highlighted a number of papers on that topic. We sought to augment this list with further suggestions by guest experts and by an open call on Twitter for other important papers. Via this process, we created a list of 24 total papers on the topic of peer review. After gathering these papers, our authorship group engaged in a consensus-building process incorporating Delphi methods to identify the papers that best described peer review, and also highlighted important tips for new reviewers. Results We found and reviewed 24 papers. In our results section, we present our authorship group’s top five most highly rated papers on the topic of peer review. We also summarize these papers with respect to their relevance to junior faculty members and to faculty developers. Conclusion We present five key papers on peer review that can be used for faculty development for novice writers and reviewers. These papers represent a mix of foundational and explanatory papers that may provide some basis from which junior faculty members might build upon as they both undergo the peer-review process and act as reviewers in turn. PMID:28611894

Peer Review and Publication of Research Protocols and Proposals: A Role for Open Access Journals

PubMed Central

2004-01-01

Peer-review and publication of research protocols offer several advantages to all parties involved. Among these are the following opportunities for authors: external expert opinion on the methods, demonstration to funding agencies of prior expert review of the protocol, proof of priority of ideas and methods, and solicitation of potential collaborators. We think that review and publication of protocols is an important role for Open Access journals. Because of their electronic form, openness for readers, and author-pays business model, they are better suited than traditional journals to ensure the sustainability and quality of protocol reviews and publications. In this editorial, we describe the workflow for investigators in eHealth research, from protocol submission to a funding agency, to protocol review and (optionally) publication at JMIR, to registration of trials at the International eHealth Study Registry (IESR), and to publication of the report. One innovation at JMIR is that protocol peer reviewers will be paid a honorarium, which will be drawn partly from a new submission fee for protocol reviews. Separating the article processing fee into a submission and a publishing fee will allow authors to opt for “peer-review only” (without subsequent publication) at reduced costs, if they wish to await a funding decision or for other reasons decide not to make the protocol public. PMID:15471763

Peer-review and publication of research protocols and proposals: a role for open access journals.

PubMed

Eysenbach, Gunther

2004-09-30

Peer-review and publication of research protocols offer several advantages to all parties involved. Among these are the following opportunities for authors: external expert opinion on the methods, demonstration to funding agencies of prior expert review of the protocol, proof of priority of ideas and methods, and solicitation of potential collaborators. We think that review and publication of protocols is an important role for Open Access journals. Because of their electronic form, openness for readers, and author-pays business model, they are better suited than traditional journals to ensure the sustainability and quality of protocol reviews and publications. In this editorial, we describe the workflow for investigators in eHealth research, from protocol submission to a funding agency, to protocol review and (optionally) publication at JMIR, to registration of trials at the International eHealth Study Registry (IESR), and to publication of the report. One innovation at JMIR is that protocol peer reviewers will be paid a honorarium, which will be drawn partly from a new submission fee for protocol reviews. Separating the article processing fee into a submission and a publishing fee will allow authors to opt for "peer-review only" (without subsequent publication) at reduced costs, if they wish to await a funding decision or for other reasons decide not to make the protocol public.

Paired peer review of university classroom teaching in a school of nursing and midwifery.

PubMed

Bennett, Paul N; Parker, Steve; Smigiel, Heather

2012-08-01

Peer review of university classroom teaching can increase the quality of teaching but is not universally practiced in Australian universities. To report an evaluation of paired peer-review process using both paper and web based teaching evaluation tools. Twenty university teachers in one metropolitan Australian School of Nursing and Midwifery were randomly paired and then randomly assigned to a paper based or web-based peer review tool. Each teacher reviewed each other's classroom teaching as part of a peer review program. The participants then completed an 18 question survey evaluating the peer review tool and paired evaluation process. Responses were analyzed using frequencies and percentages. Regardless of the tool used, participants found this process of peer review positive (75%), collegial (78%), supportive (61%) and non-threatening (71%). Participants reported that the peer review will improve their own classroom delivery (61%), teaching evaluation (61%) and planning (53%). The web-based tool was found to be easier to use and allowed more space than the paper-based tool. Implementation of a web-based paired peer review system can be a positive method of peer review of university classroom teaching. Pairing of teachers to review each other's classroom teaching is a promising strategy and has the potential to improve teaching in teaching universities. Copyright © 2011 Elsevier Ltd. All rights reserved.

Development and Evaluation of a Peer Support Program for Parents Facing Perinatal Loss.

PubMed

Diamond, Rachel M; Roose, Rosmarie E

2016-01-01

The purpose of this program evaluation was to understand the perspectives of peer parents and parents receiving support within a peer support program for perinatal bereavement at a midsized hospital within the midwestern United States. To document participants' perceptions of the program, a focus group was conducted with peer parents, and surveys were completed by both peer parents and parents receiving support. In this article we review our model of a peer support program for perinatal bereavement and report on parents' evaluation of the program. Recommendations through which other organizations can develop peer support programs for parents who have experienced a perinatal loss are provided. © 2016 AWHONN, the Association of Women’s Health, Obstetric and Neonatal Nurses.

"I sleep better at night:" How peer review of radiation treatment plans indirectly improves quality of care across radiation treatment programs.

PubMed

Brundage, Michael D; Hart, Margaret; O'Donnell, Jennifer; Reddeman, Lindsay; Gutierrez, Eric; Foxcroft, Sophie; Warde, Padraig

Peer review of radiation oncology treatment plans is increasingly recognized as an important component of quality assurance in radiation treatment planning and delivery. Peer review of treatment plans can directly improve the quality of those plans and can also have indirect effects on radiation treatment programs. We undertook a systematic, qualitative approach to describing the indirect benefits of peer review, factors that were seen to facilitate or act as barriers to the implementation of peer review, and strategies to address these barriers across a provincial jurisdiction of radiation oncology programs (ROPs). Semistructured qualitative interviews were held with radiation oncology department heads and radiation therapy managers (or delegates) in all 14 ROPs in Ontario, Canada. We used a theoretically guided phenomenological qualitative approach to design and analyze the interview content. Themes were recorded by 2 independent reviewers, and any discordance was resolved by consensus. A total of 28 interviews were completed with 32 interviewees. Twenty-two unique themes addressed perceived benefits of peer review, relating to either peer review structure (n = 3), process (n = 9), or outcome (n = 10). Of these 22 themes, 19 related to indirect benefits to ROPs. In addition, 18 themes related to factors that facilitated peer review activities and 30 themes related to key barriers to implementing peer review were identified. Findings were consistent with, and enhanced the understanding of, previous survey-based assessments of the benefits and challenges of implementing peer review programs. Although challenges and concerns regarding the implementation of peer review were evident, the indirect benefits to radiation programs are numerous, far outweigh the implementation challenges, and strongly complement the direct individual-patient benefits that result from peer review quality assurance of radiation treatment plans. Copyright © 2016. Published by Elsevier Inc.

Mechanism change in a simulation of peer review: from junk support to elitism.

PubMed

Paolucci, Mario; Grimaldo, Francisco

2014-01-01

Peer review works as the hinge of the scientific process, mediating between research and the awareness/acceptance of its results. While it might seem obvious that science would regulate itself scientifically, the consensus on peer review is eroding; a deeper understanding of its workings and potential alternatives is sorely needed. Employing a theoretical approach supported by agent-based simulation, we examined computational models of peer review, performing what we propose to call redesign , that is, the replication of simulations using different mechanisms . Here, we show that we are able to obtain the high sensitivity to rational cheating that is present in literature. In addition, we also show how this result appears to be fragile against small variations in mechanisms. Therefore, we argue that exploration of the parameter space is not enough if we want to support theoretical statements with simulation, and that exploration at the level of mechanisms is needed. These findings also support prudence in the application of simulation results based on single mechanisms, and endorse the use of complex agent platforms that encourage experimentation of diverse mechanisms.

Peer review versus editorial review and their role in innovative science.

PubMed

Steinhauser, Georg; Adlassnig, Wolfram; Risch, Jesaka Ahau; Anderlini, Serena; Arguriou, Petros; Armendariz, Aaron Zolen; Bains, William; Baker, Clark; Barnes, Martin; Barnett, Jonathan; Baumgartner, Michael; Baumgartner, Thomas; Bendall, Charles A; Bender, Yvonne S; Bichler, Max; Biermann, Teresa; Bini, Ronaldo; Blanco, Eduardo; Bleau, John; Brink, Anthony; Brown, Darin; Burghuber, Christopher; Calne, Roy; Carter, Brian; Castaño, Cesar; Celec, Peter; Celis, Maria Eugenia; Clarke, Nicky; Cockrell, David; Collins, David; Coogan, Brian; Craig, Jennifer; Crilly, Cal; Crowe, David; Csoka, Antonei B; Darwich, Chaza; Del Kebos, Topiciprin; Derinaldi, Michele; Dlamini, Bongani; Drewa, Tomasz; Dwyer, Michael; Eder, Fabienne; de Palma, Raúl Ehrichs; Esmay, Dean; Rött, Catherine Evans; Exley, Christopher; Falkov, Robin; Farber, Celia Ingrid; Fearn, William; Felsmann, Sophie; Flensmark, Jarl; Fletcher, Andrew K; Foster, Michaela; Fountoulakis, Kostas N; Fouratt, Jim; Blanca, Jesus Garcia; Sotelo, Manuel Garrido; Gittler, Florian; Gittler, Georg; Gomez, Juan; Gomez, Juan F; Polar, Maria Grazia Gonzales; Gonzalez, Jossina; Gösselsberger, Christoph; Habermacher, Lynn; Hajek, Michael; Hakala, Faith; Haliburton, Mary-Sue; Hankins, John Robert; Hart, Jason; Hasslberger, Sepp; Hennessey, Donalyn; Herrmann, Andrea; Hersee, Mike; Howard, Connie; Humphries, Suzanne; Isharc, Laeeth; Ivanovski, Petar; Jenuth, Stephen; Jerndal, Jens; Johnson, Christine; Keleta, Yonas; Kenny, Anna; Kidd, Billie; Kohle, Fritz; Kolahi, Jafar; Koller-Peroutka, Marianne; Kostova, Lyubov; Kumar, Arunachalam; Kurosawa, Alejandro; Lance, Tony; Lechermann, Michael; Lendl, Bernhard; Leuchters, Michael; Lewis, Evan; Lieb, Edward; Lloyd, Gloria; Losek, Angelika; Lu, Yao; Maestracci, Saadia; Mangan, Dennis; Mares, Alberto W; Barnett, Juan Mazar; McClain, Valerie; McNair, John Sydney; Michael, Terry; Miller, Lloyd; Monzani, Partizia; Moran, Belen; Morris, Mike; Mößmer, Georg; Mountain, Johny; Phuthe, Onnie Mary Moyo; Muñoz, Marcos; Nakken, Sheri; Wambui, Anne Nduta; Neunteufl, Bettina; Nikolić, Dimitrije; Oberoi, Devesh V; Obmode, Gregory; Ogar, Laura; Ohara, Jo; Rybine, Naion Olej; Owen, Bryan; Owen, Kim Wilson; Parikh, Rakesh; Pearce, Nicholas J G; Pemmer, Bernhard; Piper, Chris; Prince, Ian; Reid, Terence; Rindermann, Heiner; Risch, Stefan; Robbins, Josh; Roberts, Seth; Romero, Ajeandro; Rothe, Michael Thaddäus; Ruiz, Sergio; Sacher, Juliane; Sackl, Wolfgang; Salletmaier, Markus; Sanand, Jairaj; Sauerzopf, Clemens; Schwarzgruber, Thomas; Scott, David; Seegers, Laura; Seppi, David; Shields, Kyle; Siller-Matula, Jolanta; Singh, Beldeu; Sithole, Sibusio; Six, Florian; Skoyles, John R; Slofstra, Jildou; Sole, Daphne Anne; Sommer, Werner F; Sonko, Mels; Starr-Casanova, Chrislie J; Steakley, Marjorie Elizabeth; Steinhauser, Wolfgang; Steinhoff, Konstantin; Sterba, Johannes H; Steppan, Martin; Stindl, Reinhard; Stokely, Joe; Stokely, Karri; St-Pierre, Gilles; Stratford, James; Streli, Christina; Stryg, Carl; Sullivan, Mike; Summhammer, Johann; Tadesse, Amhayes; Tavares, David; Thompson, Laura; Tomlinson, Alison; Tozer, Jack; Trevisanato, Siro I; Trimmel, Michaela; Turner, Nicole; Vahur, Paul; van der Byl, Jennie; van der Maas, Tine; Varela, Leo; Vega, Carlos A; Vermaak, Shiloh; Villasenor, Alex; Vogel, Matt; von Wintzigerode, Georg; Wagner, Christoph; Weinberger, Manuel; Weinberger, Peter; Wilson, Nick; Wolfe, Jennifer Finocchio; Woodley, Michael A; Young, Ian; Zuraw, Glenn; Zwiren, Nicole

2012-10-01

Peer review is a widely accepted instrument for raising the quality of science. Peer review limits the enormous unstructured influx of information and the sheer amount of dubious data, which in its absence would plunge science into chaos. In particular, peer review offers the benefit of eliminating papers that suffer from poor craftsmanship or methodological shortcomings, especially in the experimental sciences. However, we believe that peer review is not always appropriate for the evaluation of controversial hypothetical science. We argue that the process of peer review can be prone to bias towards ideas that affirm the prior convictions of reviewers and against innovation and radical new ideas. Innovative hypotheses are thus highly vulnerable to being "filtered out" or made to accord with conventional wisdom by the peer review process. Consequently, having introduced peer review, the Elsevier journal Medical Hypotheses may be unable to continue its tradition as a radical journal allowing discussion of improbable or unconventional ideas. Hence we conclude by asking the publisher to consider re-introducing the system of editorial review to Medical Hypotheses.

On the evolving open peer review culture for chemical information science.

PubMed

Walters, W Patrick; Bajorath, Jürgen

2015-01-01

Compared to the traditional anonymous peer review process, open post-publication peer review provides additional opportunities -and challenges- for reviewers to judge scientific studies. In this editorial, we comment on the open peer review culture and provide some guidance for reviewers of manuscripts submitted to the Chemical Information Science channel of F1000Research.

Why Participate in Peer Review as a Journal Manuscript Reviewer: What's in It for You?

PubMed

Pytynia, Kristen B

2017-06-01

The peer review process for scientific journals relies on the efforts of volunteer reviewers. Reviewers are selected due to their expertise in their fields. With so many demands on professional time, the benefits of participating in peer review may not be obvious. However, reviewers benefit by exposure to the latest developments in their fields, facilitating their keeping up-to-date with the latest publications. Tenure committees look favorably on participation in peer review, and invitations to review underscore that the reviewer is a respected subject matter expert. Contacts made during the peer review process can lead to long-lasting collaboration. Continuing medical education credit can be obtained through various mechanisms. Overall, participating in peer review is an important part of career development and should be viewed as a critical component of advancement.

Peer review of RELAP5/MOD3 documentation

DOE Office of Scientific and Technical Information (OSTI.GOV)

Craddick, W.G.

1993-12-31

A peer review was performed on a portion of the documentation of the RELAP5/MOD3 computer code. The review was performed in two phases. The first phase was a review of Volume 3, Developmental Assessment problems, and Volume 4, Models and Correlations. The reviewers for this phase were Dr. Peter Griffith, Dr. Yassin Hassan, Dr. Gerald S. Lellouche, Dr. Marino di Marzo and Mr. Mark Wendel. The reviewers recommended a number of improvements, including using a frozen version of the code for assessment guided by a validation plan, better justification for flow regime maps and extension of models beyond their datamore » base. The second phase was a review of Volume 6, Quality Assurance of Numerical Techniques in RELAP5/MOD3. The reviewers for the second phase were Mr. Mark Wendel and Dr. Paul T. Williams. Recommendations included correction of numerous grammatical and typographical errors and better justification for the use of Lax`s Equivalence Theorem.« less

Methodologies for simulating impacts of climate change on crop production

USDA-ARS?s Scientific Manuscript database

Ecophysiological models of crop growth have seen wide use in IPCC and related assessments. However, the diversity of modeling approaches constrains cross-study syntheses and increases potential for bias. We reviewed 139 peer-reviewed papers dealing with climate change and agriculture, considering si...

48 CFR 215.270 - Peer Reviews.

Code of Federal Regulations, 2010 CFR

2010-10-01

... 48 Federal Acquisition Regulations System 3 2010-10-01 2010-10-01 false Peer Reviews. 215.270 Section 215.270 Federal Acquisition Regulations System DEFENSE ACQUISITION REGULATIONS SYSTEM, DEPARTMENT... of Proposals and Information 215.270 Peer Reviews. Agency officials shall conduct Peer Reviews in...

Inspection of the Math Model Tools for On-Orbit Assessment of Impact Damage Report

NASA Technical Reports Server (NTRS)

Harris, Charles E.; Raju, Ivatury S.; Piascik, Robert S> ; KramerWhite, Julie A.; KramerWhite, Julie A.; Labbe, Steve G.; Rotter, Hank A.

2007-01-01

In Spring of 2005, the NASA Engineering Safety Center (NESC) was engaged by the Space Shuttle Program (SSP) to peer review the suite of analytical tools being developed to support the determination of impact and damage tolerance of the Orbiter Thermal Protection Systems (TPS). The NESC formed an independent review team with the core disciplines of materials, flight sciences, structures, mechanical analysis and thermal analysis. The Math Model Tools reviewed included damage prediction and stress analysis, aeroheating analysis, and thermal analysis tools. Some tools are physics-based and other tools are empirically-derived. Each tool was created for a specific use and timeframe, including certification, real-time pre-launch assessments. In addition, the tools are used together in an integrated strategy for assessing the ramifications of impact damage to tile and RCC. The NESC teams conducted a peer review of the engineering data package for each Math Model Tool. This report contains the summary of the team observations and recommendations from these reviews.

Optimal strategies to consider when peer reviewing a systematic review and meta-analysis.

PubMed

Moher, David

2015-11-02

Systematic reviews are popular. A recent estimate indicates that 11 new systematic reviews are published daily. Nevertheless, evidence indicates that the quality of reporting of systematic reviews is not optimal. One likely reason is that the authors' reports have received inadequate peer review. There are now many different types of systematic reviews and peer reviewing them can be enhanced by using a reporting guideline to supplement whatever template the journal editors have asked you, as a peer reviewer, to use. Additionally, keeping up with the current literature, whether as a content expert or being aware of advances in systematic review methods is likely be make for a more comprehensive and effective peer review. Providing a brief summary of what the systematic review has reported is an important first step in the peer review process (and not performed frequently enough). At its core, it provides the authors with some sense of what the peer reviewer believes was performed (Methods) and found (Results). Importantly, it also provides clarity regarding any potential problems in the methods, including statistical approaches for meta-analysis, results, and interpretation of the systematic review, for which the peer reviewer can seek explanations from the authors; these clarifications are best presented as questions to the authors.

Lessons from Peer Support Among Individuals with Mental Health Difficulties: A Review of the Literature

PubMed Central

Miyamoto, Yuki; Sono, Tamaki

2012-01-01

We conducted a comprehensive narrative review and used a systematic search strategy to identify studies related to peer support among adults with mental health difficulties. The purposes of this review were to describe the principles, effects and benefits of peer support documented in the published literature, to discuss challenging aspects of peer support and to investigate lessons from peer support. Fifty-one studies, including 8 review articles and 19 qualitative studies, met the inclusion criteria for this review. Most of the challenges for peer support were related to “role” and “relationship” issues; that is, how peer support providers relate to people who receive peer support and how peer support providers are treated in the system. The knowledge gained from peer support relationships, such as mutual responsibility and interdependence, might be a clue toward redefining the helper-helper relationship as well as the concepts of help and support. PMID:22563347

42 CFR 24.5 - Peer review.

Code of Federal Regulations, 2010 CFR

2010-10-01

... 42 Public Health 1 2010-10-01 2010-10-01 false Peer review. 24.5 Section 24.5 Public Health PUBLIC....5 Peer review. An individual may not be considered for appointment into the SBRS unless his/her qualifications have been reviewed by a PHS peer review committee and the committee has recommended appointment to...

Rethinking Feedback Practices in Higher Education: A Peer Review Perspective

ERIC Educational Resources Information Center

Nicol, David; Thomson, Avril; Breslin, Caroline

2014-01-01

Peer review is a reciprocal process whereby students produce feedback reviews on the work of peers and receive feedback reviews from peers on their own work. Prior research has primarily examined the learning benefits that result from the receipt of feedback reviews, with few studies specifically exploring the merits of producing feedback reviews…

Peer Review Quality and Transparency of the Peer-Review Process in Open Access and Subscription Journals.

PubMed

Wicherts, Jelte M

2016-01-01

Recent controversies highlighting substandard peer review in Open Access (OA) and traditional (subscription) journals have increased the need for authors, funders, publishers, and institutions to assure quality of peer-review in academic journals. I propose that transparency of the peer-review process may be seen as an indicator of the quality of peer-review, and develop and validate a tool enabling different stakeholders to assess transparency of the peer-review process. Based on editorial guidelines and best practices, I developed a 14-item tool to rate transparency of the peer-review process on the basis of journals' websites. In Study 1, a random sample of 231 authors of papers in 92 subscription journals in different fields rated transparency of the journals that published their work. Authors' ratings of the transparency were positively associated with quality of the peer-review process but unrelated to journal's impact factors. In Study 2, 20 experts on OA publishing assessed the transparency of established (non-OA) journals, OA journals categorized as being published by potential predatory publishers, and journals from the Directory of Open Access Journals (DOAJ). Results show high reliability across items (α = .91) and sufficient reliability across raters. Ratings differentiated the three types of journals well. In Study 3, academic librarians rated a random sample of 140 DOAJ journals and another 54 journals that had received a hoax paper written by Bohannon to test peer-review quality. Journals with higher transparency ratings were less likely to accept the flawed paper and showed higher impact as measured by the h5 index from Google Scholar. The tool to assess transparency of the peer-review process at academic journals shows promising reliability and validity. The transparency of the peer-review process can be seen as an indicator of peer-review quality allowing the tool to be used to predict academic quality in new journals.

Peer Review Quality and Transparency of the Peer-Review Process in Open Access and Subscription Journals

PubMed Central

Wicherts, Jelte M.

2016-01-01

Background Recent controversies highlighting substandard peer review in Open Access (OA) and traditional (subscription) journals have increased the need for authors, funders, publishers, and institutions to assure quality of peer-review in academic journals. I propose that transparency of the peer-review process may be seen as an indicator of the quality of peer-review, and develop and validate a tool enabling different stakeholders to assess transparency of the peer-review process. Methods and Findings Based on editorial guidelines and best practices, I developed a 14-item tool to rate transparency of the peer-review process on the basis of journals’ websites. In Study 1, a random sample of 231 authors of papers in 92 subscription journals in different fields rated transparency of the journals that published their work. Authors’ ratings of the transparency were positively associated with quality of the peer-review process but unrelated to journal’s impact factors. In Study 2, 20 experts on OA publishing assessed the transparency of established (non-OA) journals, OA journals categorized as being published by potential predatory publishers, and journals from the Directory of Open Access Journals (DOAJ). Results show high reliability across items (α = .91) and sufficient reliability across raters. Ratings differentiated the three types of journals well. In Study 3, academic librarians rated a random sample of 140 DOAJ journals and another 54 journals that had received a hoax paper written by Bohannon to test peer-review quality. Journals with higher transparency ratings were less likely to accept the flawed paper and showed higher impact as measured by the h5 index from Google Scholar. Conclusions The tool to assess transparency of the peer-review process at academic journals shows promising reliability and validity. The transparency of the peer-review process can be seen as an indicator of peer-review quality allowing the tool to be used to predict academic quality in new journals. PMID:26824759

Reviewing Instructional Studies Conducted Using Video Modeling to Children with Autism

ERIC Educational Resources Information Center

Acar, Cimen; Diken, Ibrahim H.

2012-01-01

This study explored 31 instructional research articles written using video modeling to children with autism and published in peer-reviewed journals. The studies in this research have been reached by searching EBSCO, Academic Search Complete, ERIC and other Anadolu University online search engines and using keywords such as "autism, video modeling,…

Effect of peer support interventions on cardiovascular disease risk factors in adults with diabetes: a systematic review and meta-analysis.

PubMed

Patil, Sonal J; Ruppar, Todd; Koopman, Richelle J; Lindbloom, Erik J; Elliott, Susan G; Mehr, David R; Conn, Vicki S

2018-03-23

Peer support by persons affected with diabetes improves peer supporter's diabetes self-management skills. Peer support interventions by individuals who have diabetes or are affected by diabetes have been shown to improve glycemic control; however, its effects on other cardiovascular disease risk factors in adults with diabetes are unknown. We aimed to estimate the effect of peer support interventions on cardiovascular disease risk factors other than glycemic control in adults with diabetes. We conducted a systematic review and meta-analysis of randomized controlled trials comparing peer support interventions to a control condition in adults affected by diabetes that measured any cardiovascular disease risk factors [Body Mass Index, smoking, diet, physical activity, cholesterol level, glucose control and blood pressure]. Quality was assessed by Cochrane's risk of bias tool. We calculated standardized mean difference effect sizes using random effects models. We retrieved 438 citations from multiple databases including OVID MEDLINE, Cochrane database and Scopus, and author searches. Of 233 abstracts reviewed, 16 articles met inclusion criteria. A random effects model in a total of 3243 participants showed a positive effect of peer support interventions on systolic BP with a pooled effect size of 2.07 mmHg (CI 0.35 mmHg to 3.79 mmHg, p = 0.02); baseline pooled systolic blood pressure was 137 mmHg. There was a non-significant effect of peer support interventions on diastolic blood pressure, cholesterol, body mass index, diet and physical activity. Cardiovascular disease risk factors other than glycemic control outcomes were secondary outcomes in most studies and baseline values were normal or mildly elevated. Only one study reported smoking outcomes. We found a small (2 mmHg) positive effect of peer support interventions on systolic blood pressure in adults with diabetes whose baseline blood pressure was on average minimally elevated. Additional studies need to be conducted to further understand the effect of peer support interventions on high-risk cardiovascular disease risk factors in adults with diabetes.

Detailed prospective peer review in a community radiation oncology clinic.

PubMed

Mitchell, James D; Chesnut, Thomas J; Eastham, David V; Demandante, Carlo N; Hoopes, David J

In 2012, we instituted detailed prospective peer review of new cases. We present the outcomes of peer review on patient management and time required for peer review. Peer review rounds were held 3 to 4 days weekly and required 2 physicians to review pertinent information from the electronic medical record and treatment planning system. Eight aspects were reviewed for each case: 1) workup and staging; 2) treatment intent and prescription; 3) position, immobilization, and simulation; 4) motion assessment and management; 5) target contours; 6) normal tissue contours; 7) target dosimetry; and 8) normal tissue dosimetry. Cases were marked as, "Meets standard of care," "Variation," or "Major deviation." Changes in treatment plan were noted. As our process evolved, we recorded the time spent reviewing each case. From 2012 to 2014, we collected peer review data on 442 of 465 (95%) radiation therapy patients treated in our hospital-based clinic. Overall, 91 (20.6%) of the cases were marked as having a variation, and 3 (0.7%) as major deviation. Forty-two (9.5%) of the cases were altered after peer review. An overall peer review score of "Variation" or "Major deviation" was highly associated with a change in treatment plan (P < .01). Changes in target contours were recommended in 10% of cases. Gastrointestinal cases were significantly associated with a change in treatment plan after peer review. Indicators on position, immobilization, simulation, target contours, target dosimetry, motion management, normal tissue contours, and normal tissue dosimetry were significantly associated with a change in treatment plan. The mean time spent on each case was 7 minutes. Prospective peer review is feasible in a community radiation oncology practice. Our process led to changes in 9.5% of cases. Peer review should focus on technical factors such as target contours and dosimetry. Peer review required 7 minutes per case. Published by Elsevier Inc.

Conflicts of interest in medical science: peer usage, peer review and 'CoI consultancy'.

PubMed

Charlton, Bruce G

2004-01-01

In recent years, the perception has grown that conflicts of interest are having a detrimental effect on medical science as it influences health policy and clinical practice, leading medical journals to enforce self-declaration of potential biases in the attempt to counteract or compensate for the problem. Conflict of interest (CoI) declarations have traditionally been considered inappropriate in pure science since its evaluation systems themselves constitute a mechanism for eliminating the effect of individual biases. Pure science is primarily evaluated by 'peer usage', in which scientific information is 'replicated' by being incorporated in the work of other scientists, and tested by further observation of the natural world. Over the long-term, the process works because significant biases impair the quality of science, and bad science tends to be neglected or refuted. However, scientific evaluation operates slowly over years and decades, and only a small proportion of published work is ever actually evaluated. But most of modern medical science no longer conforms to the model of pure science, and may instead be conceptualized as a system of 'applied' science having different aims and evaluation processes. The aim of applied medical science is to solve pre-specified problems, and to provide scientific information ready for implementation immediately following publication. The primary evaluation process of applied science is peer review, not peer usage. Peer review is much more rapid (with a timescale of weeks or months) and cheaper than peer usage and (consequently) has a much wider application: peer review is a prospective validation while peer usage is retrospective. Since applied science consists of incremental advances on existing knowledge achieved using established techniques, its results can usually be reliably evaluated by peer review. However, despite its considerable convenience, peer review has significant limitations related to its reliance on opinion. One major limitation of peer review has proved to be its inability to deal with conflicts of interest, especially in a 'big science' context when prestigious scientists may have similar biases, and conflicts of interest are widely shared among peer reviewers. When applied medical science has been later checked against the slower but more valid processes of peer usage, it seems that reliance on peer review may allow damaging distortions to become 'locked-in' to clinical practice and health policy for considerable periods. Scientific progress is generally underpinned by increasing specialization. Medical journals should specialize in the communication of scientific information, and they have neither the resources nor the motivation to investigate and measure conflicts of interest. Effectively dealing with the problem of conflicts of interest in applied medical science firstly requires a more explicit demarcation between the communications media of pure medical science and applied medical science. Greater specialization of these activities would then allow distinctive aims and evaluation systems to evolve with the expectation of improved performance in both pure and applied systems. In future, applied medical science should operate with an assumption of bias, with the onus of proof on applied medical scientists to facilitate the 'data transparency' necessary to validate their research. Journals of applied medical science will probably require more rigorous processes of peer review than at present, since their publications are intended to be ready for implementation. But since peer review does not adequately filter-out conflicts of interest in applied medical science, there is a need for the evolution of specialist post-publication institutional mechanisms. The suggested solution is to encourage the establishment of independent 'CoI consultancy' services, whose role would be to evaluate conflicts of interest and other biases in published applied medical science prior to their implementation. Such services would be paid-for by the groups who intend to implement applied medical research.

Peer review in hematopoietic cell transplantation: are we doing our fair share?

PubMed

Giralt, S; Korngold, R; Lazarus, H M

2016-09-01

Peer review is believed to be important in maintaining the quality and integrity of research in academic endeavors. Recently, the value of the current peer review process, which is more than 100 years old has come into question. In the field of hematopoietic cell transplantation (HCT), peer review was unable to prevent the publication of the largest and most notorious scientific fraud in our field. In order to assess how the HCT community views and how engaged it is with the peer review process, the American Society of Blood and Marrow Transplantation conducted a survey of all of its members in 2014. The survey was sent to all active members through multiple email communications in August and September 2014. Of a total of 1183 members, 149 responded. Almost all of the respondents had participated in the peer review process, with few respondents declining ever to review manuscripts. The most common cause for declining review requests was lack of time. Most respondents (68%) thought that the current peer review process was relatively fair and unbiased, whereas only 9% of the respondents stated that they did not believe in the peer review process. In conclusion, among the respondents of this survey most felt the peer review process to be valuable and fair, however, the lack of response suggests that further study into improving the peer review process in the field of HCT is warranted in the era of electronic publishing and communication.

The Potential of Peer Review

ERIC Educational Resources Information Center

Johnson, Susan Moore; Fiarman, Sarah E.

2012-01-01

Peer review of teachers is controversial for several reasons. Some say peer reviewers encroach on the rightful domain of the principal as instructional leader. Others argue that, because peer evaluators are fellow teachers, they may be biased or unwilling to make hard decisions. Many teachers find the prospect of peer evaluation unsettling because…

28 CFR 34.105 - Peer review methods.

Code of Federal Regulations, 2010 CFR

2010-07-01

... 28 Judicial Administration 1 2010-07-01 2010-07-01 false Peer review methods. 34.105 Section 34... Review § 34.105 Peer review methods. (a) For both competitive and noncompetitive applications, peer... announcement or otherwise established by the Administrator, together with the assignment of numerical values...

7 CFR 3400.21 - Scientific peer review for research activities.

Code of Federal Regulations, 2010 CFR

2010-01-01

... 7 Agriculture 15 2010-01-01 2010-01-01 false Scientific peer review for research activities. 3400... STATE RESEARCH, EDUCATION, AND EXTENSION SERVICE, DEPARTMENT OF AGRICULTURE SPECIAL RESEARCH GRANTS PROGRAM Peer and Merit Review Arranged by Grantees § 3400.21 Scientific peer review for research...

28 CFR 34.109 - Qualifications of peer reviewers.

Code of Federal Regulations, 2014 CFR

2014-07-01

... be used in the selection of peer reviewers are: (a) Generalized knowledge of juvenile justice or... 28 Judicial Administration 1 2014-07-01 2014-07-01 false Qualifications of peer reviewers. 34.109 Section 34.109 Judicial Administration DEPARTMENT OF JUSTICE OJJDP COMPETITION AND PEER REVIEW PROCEDURES...

28 CFR 34.109 - Qualifications of peer reviewers.

Code of Federal Regulations, 2013 CFR

2013-07-01

... be used in the selection of peer reviewers are: (a) Generalized knowledge of juvenile justice or... 28 Judicial Administration 1 2013-07-01 2013-07-01 false Qualifications of peer reviewers. 34.109 Section 34.109 Judicial Administration DEPARTMENT OF JUSTICE OJJDP COMPETITION AND PEER REVIEW PROCEDURES...

28 CFR 34.109 - Qualifications of peer reviewers.

Code of Federal Regulations, 2012 CFR

2012-07-01

... be used in the selection of peer reviewers are: (a) Generalized knowledge of juvenile justice or... 28 Judicial Administration 1 2012-07-01 2012-07-01 false Qualifications of peer reviewers. 34.109 Section 34.109 Judicial Administration DEPARTMENT OF JUSTICE OJJDP COMPETITION AND PEER REVIEW PROCEDURES...

28 CFR 34.109 - Qualifications of peer reviewers.

Code of Federal Regulations, 2011 CFR

2011-07-01

... be used in the selection of peer reviewers are: (a) Generalized knowledge of juvenile justice or... 28 Judicial Administration 1 2011-07-01 2011-07-01 false Qualifications of peer reviewers. 34.109 Section 34.109 Judicial Administration DEPARTMENT OF JUSTICE OJJDP COMPETITION AND PEER REVIEW PROCEDURES...

Peer Review of Teaching: Sharing Best Practices

ERIC Educational Resources Information Center

Golparian, Shaya; Chan, Judy; Cassidy, Alice

2015-01-01

In this paper, we share examples of best peer review of teaching practices, drawing on our involvement in the design and implementation of the Peer Review of Teaching program at the Centre for Teaching, Learning and Technology. We review the history of the Peer Review of Teaching Initiative at the University of British Columbia and explain key…

Adolescent Peer Relations and Socioemotional Development in Latin America: Translating International Theory into Local Research.

PubMed

Berger, Christian; Lisboa, Carolina; Cuadros, Olga; de Tezanos-Pinto, Pablo

2016-06-01

Peer relations constitute a main developmental context for adolescents. Peers offer an instance for identity definition and set the norms of acceptable and valued characteristics, behaviors, and attitudes, representing a societal model that allows and restrains avenues for adolescents' socioemotional development. The present article departs from these considerations to review research on adolescents' peer relations in Latin America from a socioemotional perspective. First, approaches to adolescence are discussed, with a main focus on attachment and identity theories, based on a bioecological framework. Then, a review of research in Latin America on friendships, school climate, and intergroup relations is presented. The discussion addresses the tension between theories and evidence generated in developed societies and highlights the particularities of Latin American youth, stressing the need for collecting local data. © 2016 Wiley Periodicals, Inc.

Adolescent peer group identification and characteristics: A review of the literature

PubMed Central

Sussman, Steve; Pokhrel, Pallav; Ashmore, Richard D.; Brown, B. Bradford

2011-01-01

This study provides an exhaustive review of 44 peer-reviewed quantitative or qualitative data-based peer-reviewed studies completed on adolescent peer group identification. Adolescent peer group identification is one’s self-perceived or other-perceived membership in discrete teenage peer groups. The studies reviewed suggest that adolescent peer groups consist of five general categories differentiable by lifestyle characteristics: Elites, Athletes, Academics, Deviants, and Others. We found that the Deviant adolescent group category reported relatively greater participation in drug use and other problem behaviors across studies, whereas Academics and Athletes exhibited the least participation in these problem behaviors. Additional research is needed in this arena to better understand the operation of adolescent group labels. PMID:17188815

28 CFR 34.104 - Use of peer review.

Code of Federal Regulations, 2010 CFR

2010-07-01

... 28 Judicial Administration 1 2010-07-01 2010-07-01 false Use of peer review. 34.104 Section 34.104 Judicial Administration DEPARTMENT OF JUSTICE OJJDP COMPETITION AND PEER REVIEW PROCEDURES Peer Review § 34... programs for which a large number of applications is expected, preapplications (concept papers) may be...

The Potential of Dual-Language Cross-Cultural Peer Review

ERIC Educational Resources Information Center

Ruecker, Todd

2011-01-01

This article explores the potential of dual-language cross-cultural peer review and how it improves on traditional monolingual and monocultural peer review. Drawing on scholarship related to international exchange programmes, peer review, and two-way immersion programmes in the United States as well as data collected while facilitating the…

7 CFR 550.17 - Peer review.

Code of Federal Regulations, 2010 CFR

2010-01-01

... 7 Agriculture 6 2010-01-01 2010-01-01 false Peer review. 550.17 Section 550.17 Agriculture... § 550.17 Peer review. Upon request of the REE Agency, cooperators may be requested to provide documentation in support of peer review activities and cooperator personnel may be requested to participate in...

7 CFR 3411.10 - Establishment and operation of peer review groups.

Code of Federal Regulations, 2011 CFR

2011-01-01

... INSTITUTE OF FOOD AND AGRICULTURE NATIONAL RESEARCH INITIATIVE COMPETITIVE GRANTS PROGRAM Scientific Peer Review of Research Grant Applications § 3411.10 Establishment and operation of peer review groups. Subject to § 3411.5, the Administrator shall adopt procedures for the conduct of peer reviews and the...

Toward the Integration of Peer Reviewing and Computational Linguistics Approaches

ERIC Educational Resources Information Center

Park, Juhwa; Cho, Kwangsu

2017-01-01

Previous research has shown the effectiveness of peer reviewing on the improvement of writing quality. However, the fact that students themselves, arguably novices, judged the improvement leads to concerns about the validity of peer reviewing. We measured writing quality before and after peer reviewing using Coh-Metrix, which computationally…

Collaborative Learning through Formative Peer Review: Pedagogy, Programs and Potential

ERIC Educational Resources Information Center

Sondergaard, Harald; Mulder, Raoul A.

2012-01-01

We examine student peer review, with an emphasis on formative practice and collaborative learning, rather than peer grading. Opportunities to engage students in such formative peer assessment are growing, as a range of online tools become available to manage and simplify the process of administering student peer review. We consider whether…

Writing to Learn: An Evaluation of the Calibrated Peer Review™ Program in Two Neuroscience Courses

PubMed Central

Prichard, J. Roxanne

2005-01-01

Although the majority of scientific information is communicated in written form, and peer review is the primary process by which it is validated, undergraduate students may receive little direct training in science writing or peer review. Here, I describe the use of Calibrated Peer Review™ (CPR), a free, web-based writing and peer review program designed to alleviate instructor workload, in two undergraduate neuroscience courses: an upper- level sensation and perception course (41 students, three assignments) and an introductory neuroscience course (50 students; two assignments). Using CPR online, students reviewed primary research articles on assigned ‘hot’ topics, wrote short essays in response to specific guiding questions, reviewed standard ‘calibration’ essays, and provided anonymous quantitative and qualitative peer reviews. An automated grading system calculated the final scores based on a student’s essay quality (as determined by the average of three peer reviews) and his or her accuracy in evaluating 1) three standard calibration essays, 2) three anonymous peer reviews, and 3) his or her self review. Thus, students were assessed not only on their skill at constructing logical, evidence-based arguments, but also on their ability to accurately evaluate their peers’ writing. According to both student self-reports and instructor observation, students’ writing and peer review skills improved over the course of the semester. Student evaluation of the CPR program was mixed; while some students felt like the peer review process enhanced their understanding of the material and improved their writing, others felt as though the process was biased and required too much time. Despite student critiques of the program, I still recommend the CPR program as an excellent and free resource for incorporating more writing, peer review, and critical thinking into an undergraduate neuroscience curriculum. PMID:23493247

Evaluation of a 2 to 1 peer placement supervision model by physiotherapy students and their educators.

PubMed

Alpine, Lucy M; Caldas, Francieli Tanji; Barrett, Emer M

2018-04-02

The objective of the study was to investigate student and practice educator evaluations of practice placements using a structured 2 to 1 supervision and implementation model. Cross-sectional pilot study set in clinical sites providing placements for physiotherapy students in Ireland. Students and practice educators completing a 2.1 peer placement between 2013 and 2015 participated. A self-reported questionnaire which measured indicators linked to quality assured placements was used. Three open-ended questions captured comments on the benefits and challenges associated with the 2 to 1 model. Ten students (10/20; 50% response rate) and 10 practice educators (10/10; 100% response rate) responded to the questionnaire. Student responses included four pairs of students and one student from a further two pairs. There was generally positive agreement with the questionnaire indicating that placements using the 2 to 1 model were positively evaluated by participants. There were no significant differences between students and practice educators. The main benefits of the 2 to 1 model were shared learning experiences, a peer supported environment, and the development of peer evaluation and feedback skills by students. A key component of the model was the peer scripting process which provided time for reflection, self-evaluation, and peer review. 2 to 1 placements were positively evaluated by students and educators when supported by a structured supervision model. Clear guidance to students on the provision of peer feedback and support for educators providing feedback to two different students is recommended.

Interventional radiology peer, a newly developed peer-review scoring system designed for interventional radiology practice.

PubMed

d'Othée, Bertrand Janne; Haskal, Ziv J

2013-10-01

Existing diagnostic radiology peer-review systems do not address the specificities of interventional radiology (IR) practice. The purpose of this study was to assess the feasibility of a specifically developed interventional peer review method, IR Peer. Retrospective review of a prospectively encoded pilot database aimed at demonstrating the feasibility of IR Peer in a multiphysician practice was performed. This scoring system used morning peer review of selected IR cases from the previous day in the form of a five-item questionnaire and an ordinal answer scale that grades reviewers' agreement with imaging findings, procedural/technical management, early outcomes, and follow-up plan. Patient lists from IR Peer and morbidity and mortality (M&M) conferences were compared to evaluate the amount of overlap and capability of IR Peer to help detect adverse events (AEs). A total of 417 consecutive reviews of IR attending physician cases by peers were performed in 163 consecutive patients over 18 months, and 94% of cases were reviewed by two or three IR attending physicians. Each question was answered 99%-100% of the time. Answers showed disagreement in 10% of cases (2% by a single reviewer, 8% by several), most related to procedural technique. Overall AE incidence was 1.8%. IR Peer contributed 10.7% of cases to the M&M list. IR Peer is feasible, relevant, and easy to implement in a multiphysician IR practice. When used along with other quality-assurance processes, it might help in the detection of AEs for M&M; the latter will require further confirmatory research. © SIR, 2013.

The evolution of peer review as a basis for scientific publication: directional selection towards a robust discipline?

PubMed

Ferreira, Catarina; Bastille-Rousseau, Guillaume; Bennett, Amanda M; Ellington, E Hance; Terwissen, Christine; Austin, Cayla; Borlestean, Adrian; Boudreau, Melanie R; Chan, Kevin; Forsythe, Adrian; Hossie, Thomas J; Landolt, Kristen; Longhi, Jessica; Otis, Josée-Anne; Peers, Michael J L; Rae, Jason; Seguin, Jacob; Watt, Cristen; Wehtje, Morgan; Murray, Dennis L

2016-08-01

Peer review is pivotal to science and academia, as it represents a widely accepted strategy for ensuring quality control in scientific research. Yet, the peer-review system is poorly adapted to recent changes in the discipline and current societal needs. We provide historical context for the cultural lag that governs peer review that has eventually led to the system's current structural weaknesses (voluntary review, unstandardized review criteria, decentralized process). We argue that some current attempts to upgrade or otherwise modify the peer-review system are merely sticking-plaster solutions to these fundamental flaws, and therefore are unlikely to resolve them in the long term. We claim that for peer review to be relevant, effective, and contemporary with today's publishing demands across scientific disciplines, its main components need to be redesigned. We propose directional changes that are likely to improve the quality, rigour, and timeliness of peer review, and thereby ensure that this critical process serves the community it was created for. © 2015 Cambridge Philosophical Society.

Implementing Head and Neck Contouring Peer Review without Pathway Delay: The On-demand Approach.

PubMed

Fong, C; Sanghera, P; Good, J; Nightingale, P; Hartley, A

2017-12-01

Peer review of contour volume is a priority in the radiotherapy treatment quality assurance process for head and neck cancer. It is essential that incorporation of peer review activity does not introduce additional delays. An on-demand peer review process was piloted to assess the feasibility and efficiency of this approach, as compared with a historic scheduled weekly approach. Between November 2016 and April 2017 four head and neck clinicians in one centre took part in an on-demand peer review process. Cases were of radical or adjuvant intent of any histology and submitted on a voluntary basis. The outcome of contour peer review would be one of unchanged (UC), unchanged with variation or discretion noted (UV), minor change (M) or significant change (S). The time difference between the completion of the on-demand peer review was compared with the time difference to a hypothetical next Monday or Tuesday weekly peer review meeting. The time taken to review each case was also documented in the latter period of the pilot project. In total, 62 cases underwent peer review. Peer review on-demand provided dosimetrists with an average of an extra two working days available per case to meet treatment start dates. The proportion of cases with outcomes UC, UV, M and S were 45%, 16%, 26% and 13%, respectively. The mean peer review time spent per case was 17 min (12 cases). The main reason for S was discrepancy in imaging interpretation (4/8 cases). A lower proportion of oropharyngeal cases were submitted and had S outcomes. A higher proportion of complex cases, e.g. sinonasal/nasopharynx location or previous downstaging chemotherapy had S outcomes. The distribution of S outcomes appears to be similar regardless of clinician experience. The level of peer review activity among individuals differed by workload and job timetable. On-demand peer review of the head and neck contour volume is feasible, reduces delay to the start of dosimetry planning and bypasses the logistical barriers of weekly meetings. An audit of participation will be required to ensure successful implementation. Copyright © 2017 The Royal College of Radiologists. Published by Elsevier Ltd. All rights reserved.

Ancient texts to PubMed: a brief history of the peer-review process.

PubMed

Farrell, P R; Magida Farrell, L; Farrell, M K

2017-01-01

The formal evaluation of scientific literature by invited referees (peer reviewers) is a relatively recent phenomenon and now is considered a cornerstone of modern science. However, its roots can be traced back to antiquity. As the speed and complexity of scientific information and publishing increases in the digital age, peer review must continue to evolve. To understand the future direction of peer review, we must understand its past. Here, we briefly explore the history of scientific peer review. This may help us predict and design appropriate peer review for the new era. This work was originally presented at the Pediatric Academic Societies Annual Meeting in Baltimore, Maryland in the Spring of 2016.

Peer review in forensic science.

PubMed

Ballantyne, Kaye N; Edmond, Gary; Found, Bryan

2017-08-01

Peer review features prominently in the forensic sciences. Drawing on recent research and studies, this article examines different types of peer review, specifically: editorial peer review; peer review by the scientific community; technical and administrative review; and verification (and replication). The article reviews the different meanings of these quite disparate activities and their utility in relation to enhancing performance and reducing error. It explains how forensic practitioners should approach and use peer review, as well as how it should be described in expert reports and oral testimony. While peer review has considerable potential, and is a key component of modern quality management systems, its actual value in most forensic science settings has yet to be determined. In consequence, forensic practitioners should reflect on why they use specific review procedures and endeavour to make their actual practices and their potential value transparent to consumers; whether investigators, lawyers, jurors or judges. Claims that review increases the validity of a scientific technique or accuracy of opinions within a particular case should be avoided until empirical evidence is available to support such assertions. Copyright © 2017 Elsevier B.V. All rights reserved.

Final Report from the External Peer Review of the IRIS ...

EPA Pesticide Factsheets

This document is the final report for the 2004 external peer review for the EPA IRIS Reassessment of the Inhalation Carcinogenicity of Naphthalene, prepared by the Office of Research and Development's National Center for Environmental Assessment (NCEA), for the Integrated Risk Information System (IRIS) Database. A panel of external peer reviewers met to discuss the IRIS report and their responses to the charge questions on July 30, 2004. This document contains the final written comments of the external peer reviewers. This document is the final report for the 2004 external peer review for the IRIS Reassessment of the Inhalation Carcinogenicity of Naphthalene, prepared by the U.S. Environmental Protection Agency (EPA), National Center for Environmental Assessment (NCEA), for the Integrated Risk Information System (IRIS). A panel of external peer reviewers met to discuss their responses to the charge questions on July 30, 2004. This document contains the final written comments of the external peer reviewers.

Technology-Enhanced Peer Review: Benefits and Implications of Providing Multiple Reviews

ERIC Educational Resources Information Center

Papadopoulos, Pantelis M.; Lagkas, Thomas D.; Demetriadis, Stavros N.

2017-01-01

This study analyses the impact of self and peer feedback in technology-enhanced peer review settings. The impact of receiving peer comments ("receiver" perspective) is compared to that of reaching own insights by reviewing others' work ("giver" perspective). In this study, 38 sophomore students were randomly assigned in two…

Undergraduate Essay Writing: Online and Face-to-Face Peer Reviews

ERIC Educational Resources Information Center

Chong, Mike R.; Goff, Lori; Dej, Kimberly

2012-01-01

We implemented two different approaches of using peer review to support undergraduate essay assignments for students taking large second-year courses in life sciences and biology: a web-based online peer review (OPR) approach and a more traditional face-to-face peer review (FPR) approach that was conducted in tutorial settings. The essays…

7 CFR 3401.12 - Establishment and operation of peer review groups.

Code of Federal Regulations, 2010 CFR

2010-01-01

... 7 Agriculture 15 2010-01-01 2010-01-01 false Establishment and operation of peer review groups... GRANTS PROGRAM Scientific Peer Review of Research Applications for Funding § 3401.12 Establishment and operation of peer review groups. Subject to § 3401.7, the Administrator will adopt procedures for the...

The Importance of Peer Review: Thoughts on Knudson, Morrow, and Thomas (2014)

ERIC Educational Resources Information Center

Fischman, Mark G.

2014-01-01

Knudson, Morrow, and Thomas (2014) recently summarized a number of important issues related to the quality of peer review and current peer-review practice in kinesiology. This writer endorses their six recommendations for improving peer review in kinesiology journals. The purpose of this commentary is to further highlight the importance of…

Focusing on Content: Discourse in L2 Peer Review Groups

ERIC Educational Resources Information Center

Vorobel, Oksana; Kim, Deoksoon

2014-01-01

Recent studies on peer review groups in second language classes have focused on various topics, including collaboration (Carr, 2008) and the effect of peer review versus teacher feedback on students' writing (Zhang, 1995). One area that has received little attention is the content of students' speech during peer review. This longitudinal case…

Peer Reviewers Learn from Giving Comments

ERIC Educational Resources Information Center

Cho, Young Hoan; Cho, Kwangsu

2011-01-01

Research on peer reviewing has revealed that comments received from peer reviewers are helpful when it comes to making revisions in an individual's writing, but the role of providing comments to peer writers has been little explored despite the potential value of such research. In this study, we explored how student reviewers learn by reviewing…

Analysis of Peer Review Comments: QM Recommendations and Feedback Intervention Theory

ERIC Educational Resources Information Center

Schwegler, Andria F.; Altman, Barbara W.

2015-01-01

Because feedback is a critical component of the continuous improvement cycle of the Quality Matters (QM) peer review process, the present research analyzed the feedback that peer reviewers provided to course developers after a voluntary, nonofficial QM peer review of online courses. Previous research reveals that the effects of feedback on…

Pre-University Chemistry Students in a Mimicked Scholarly Peer Review

ERIC Educational Resources Information Center

van Rens, Lisette; Hermarij, Philip; Pilot, Albert; Beishuizen, Jos; Hofman, Herman; Wal, Marjolein

2014-01-01

Peer review is a significant component in scientific research. Introducing peer review into inquiry processes may be regarded as an aim to develop student understanding regarding quality in inquiries. This study examines student understanding in inquiry peer reviews among pre-university chemistry students, aged 16-17, when they enact a design of a…

Assessing RN-to-RN peer review on clinical units.

PubMed

Pfeiffer, Judith A; Wickline, Mary A; Deetz, Jill; Berry, Elise S

2012-04-01

The primary purpose of this study was to measure informal registered nurse (RN)-to-RN peer review (defined as collegial communication about the quality of nursing care) at the work-unit level. Survey design with cluster sampling of 28 hospital or ambulatory care units (n = 541 respondents). Results were compared with existing patient safety and satisfaction data. A chi-squared test was used to compare responses against nurse characteristics. Nurses agreed that RN-to-RN peer review takes place on their units, but no correlation with patient safety and satisfaction data was found. Misunderstandings about the meaning of peer review were evident. Open-ended comments revealed barriers to peer review: fear of retribution, language barriers and lack of professionalism. Nurses need clarification of peer review. Issues with common language in a professional environment need to be addressed and nurses can learn collaboration from each other's cultures. Managers should support RN-to-RN peer review on clinical units. Methods used here may be useful to assess current departmental nurse peer review. © 2011 Blackwell Publishing Ltd.

Peer Review in Radiology: A Resident and Fellow Perspective.

PubMed

Grenville, Jeffrey; Doucette-Preville, David; Vlachou, Paraskevi A; Mnatzakanian, Gevork N; Raikhlin, Antony; Colak, Errol

2016-02-01

The purpose of this study was to explore Canadian radiology residents' and fellows' understanding, attitudes, opinions, and preferences toward peer review. An Internet-based anonymous questionnaire designed to understand one's familiarity, attitudes, opinions, and preferences toward peer review was distributed to radiology residents and fellows across Canada. Data were analyzed using descriptive statistics, and answers were stratified by level of training. A total of 136 trainees responded to the survey with 92 completed survey responses available for descriptive statistics. Approximately half of respondents are familiar with peer review (49%), and 39% of trainees are involved in peer review. Most respondents (92%) expressed an interest in learning more about peer review; believe that it should be incorporated into the residency training curriculum (86%), be mandatory (72%), and that current participation will increase odds of future participation (91%). Most trainees (80%) are comfortable advising one another about errors, but less comfortable advising staff (21%). Residents and fellows welcome the opportunity to learn more about peer review and believe it should be incorporated into the residency training curriculum. Understanding the attitudes and perceptions held by trainees regarding peer review is important, as a means to optimize education and maximize current and future participation in peer review. Copyright © 2016 American College of Radiology. Published by Elsevier Inc. All rights reserved.

Implementation and Outcomes of a Faculty-Based, Peer Review Manuscript Writing Workshop.

PubMed

Kulage, Kristine M; Larson, Elaine L

2016-01-01

The publication of scholarly work and research findings is an important expectation for nursing faculty; however, academic writing is often neglected, leaving dissemination through manuscript writing an area of concern for the nursing profession. Writing initiatives have been utilized to promote scholarly dissemination in schools of nursing, but those described in the literature have been primarily non-United States based and student focused. This article describes a faculty-based manuscript writing workshop, assesses participants' impressions, and describes its impact on scholarly output. The workshop is a collaborative learning process utilizing peer review to improve manuscript quality and model behaviors for improving writing and peer-reviewing skills. Seventeen workshop participants including three predoctoral students, 6 postdoctoral fellows, and 8 faculty members completed an anonymous workshop survey (81% response rate). All but 1 of 17 manuscripts reviewed in the workshop are published, accepted, or in the review process. All participants indicated that the workshop was a valuable use of time and would recommend it to colleagues. The greatest reported workshop benefit was its function as an impetus to complete and submit manuscripts. We recommend the manuscript writing workshop model for other schools of nursing seeking ways to expand their scholarly output and create accountability for dissemination through manuscript writing. Copyright © 2016 Elsevier Inc. All rights reserved.

Peer Portal: Quality Enhancement in Thesis Writing Using Self-Managed Peer Review on a Mass Scale

ERIC Educational Resources Information Center

Aghaee, Naghmeh; Hansson, Henrik

2013-01-01

This paper describes a specially developed online peer-review system, the Peer Portal, and the first results of its use for quality enhancement of bachelor's and master's thesis manuscripts. The peer-review system is completely student driven and therefore saves time for supervisors and creates a direct interaction between students without…

Medical students-as-teachers: a systematic review of peer-assisted teaching during medical school

PubMed Central

Yu, Tzu-Chieh; Wilson, Nichola C; Singh, Primal P; Lemanu, Daniel P; Hawken, Susan J; Hill, Andrew G

2011-01-01

Introduction International interest in peer-teaching and peer-assisted learning (PAL) during undergraduate medical programs has grown in recent years, reflected both in literature and in practice. There, remains however, a distinct lack of objective clarity and consensus on the true effectiveness of peer-teaching and its short- and long-term impacts on learning outcomes and clinical practice. Objective To summarize and critically appraise evidence presented on peer-teaching effectiveness and its impact on objective learning outcomes of medical students. Method A literature search was conducted in four electronic databases. Titles and abstracts were screened and selection was based on strict eligibility criteria after examining full-texts. Two reviewers used a standard review and analysis framework to independently extract data from each study. Discrepancies in opinions were resolved by discussion in consultation with other reviewers. Adapted models of “Kirkpatrick’s Levels of Learning” were used to grade the impact size of study outcomes. Results From 127 potential titles, 41 were obtained as full-texts, and 19 selected after close examination and group deliberation. Fifteen studies focused on student-learner outcomes and four on student-teacher learning outcomes. Ten studies utilized randomized allocation and the majority of study participants were self-selected volunteers. Written examinations and observed clinical evaluations were common study outcome assessments. Eleven studies provided student-teachers with formal teacher training. Overall, results suggest that peer-teaching, in highly selective contexts, achieves short-term learner outcomes that are comparable with those produced by faculty-based teaching. Furthermore, peer-teaching has beneficial effects on student-teacher learning outcomes. Conclusions Peer-teaching in undergraduate medical programs is comparable to conventional teaching when utilized in selected contexts. There is evidence to suggest that participating student-teachers benefit academically and professionally. Long-term effects of peer-teaching during medical school remain poorly understood and future research should aim to address this. PMID:23745087

Gender bias in scholarly peer review.

PubMed

Helmer, Markus; Schottdorf, Manuel; Neef, Andreas; Battaglia, Demian

2017-03-21

Peer review is the cornerstone of scholarly publishing and it is essential that peer reviewers are appointed on the basis of their expertise alone. However, it is difficult to check for any bias in the peer-review process because the identity of peer reviewers generally remains confidential. Here, using public information about the identities of 9000 editors and 43000 reviewers from the Frontiers series of journals, we show that women are underrepresented in the peer-review process, that editors of both genders operate with substantial same-gender preference (homophily), and that the mechanisms of this homophily are gender-dependent. We also show that homophily will persist even if numerical parity between genders is reached, highlighting the need for increased efforts to combat subtler forms of gender bias in scholarly publishing.

Meaningful Peer Review in Radiology: A Review of Current Practices and Potential Future Directions.

PubMed

Moriarity, Andrew K; Hawkins, C Matthew; Geis, J Raymond; Dreyer, Keith J; Kamer, Aaron P; Khandheria, Paras; Morey, Jose; Whitfill, James; Wiggins, Richard H; Itri, Jason N

2016-12-01

The current practice of peer review within radiology is well developed and widely implemented compared with other medical specialties. However, there are many factors that limit current peer review practices from reducing diagnostic errors and improving patient care. The development of "meaningful peer review" requires a transition away from compliance toward quality improvement, whereby the information and insights gained facilitate education and drive systematic improvements that reduce the frequency and impact of diagnostic error. The next generation of peer review requires significant improvements in IT functionality and integration, enabling features such as anonymization, adjudication by multiple specialists, categorization and analysis of errors, tracking, feedback, and easy export into teaching files and other media that require strong partnerships with vendors. In this article, the authors assess various peer review practices, with focused discussion on current limitations and future needs for meaningful peer review in radiology. Copyright © 2016 American College of Radiology. Published by Elsevier Inc. All rights reserved.

Redefining the Practice of Peer Review Through Intelligent Automation-Part 3: Automated Report Analysis and Data Reconciliation.

PubMed

Reiner, Bruce I

2018-02-01

One method for addressing existing peer review limitations is the assignment of peer review cases on a completely blinded basis, in which the peer reviewer would create an independent report which can then be cross-referenced with the primary reader report of record. By leveraging existing computerized data mining techniques, one could in theory automate and objectify the process of report data extraction, classification, and analysis, while reducing time and resource requirements intrinsic to manual peer review report analysis. Once inter-report analysis has been performed, resulting inter-report discrepancies can be presented to the radiologist of record for review, along with the option to directly communicate with the peer reviewer through an electronic data reconciliation tool aimed at collaboratively resolving inter-report discrepancies and improving report accuracy. All associated report and reconciled data could in turn be recorded in a referenceable peer review database, which provides opportunity for context and user-specific education and decision support.

On the Nature and Role of Peer Review in Mathematics.

PubMed

Andersen, Line Edslev

2017-01-01

For the past three decades, peer review practices have received much attention in the literature. But although this literature covers many research fields, only one previous systematic study has been devoted to the practice of peer review in mathematics, namely a study by Geist, Löwe, and Van Kerkhove from 2010. This lack of attention may be due to a view that peer review in mathematics is more reliable, and therefore less interesting as an object of study, than peer review in other fields. In fact, Geist, Löwe, and Van Kerkhove argue that peer review in mathematics is relatively reliable. At the same time, peer review in mathematics differs from peer review in most, if not all, other fields in that papers submitted to mathematical journals are usually only reviewed by a single referee. Furthermore, recent empirical studies indicate that the referees do not check the papers line by line. I argue that, in spite of this, mathematical practice in general and refereeing practices in particular are such that the common practice of mathematical journals of using just one referee is justified from the point of view of proof validity assessment. The argument is based on interviews I conducted with seven mathematicians.

Cooperation between referees and authors increases peer review accuracy.

PubMed

Leek, Jeffrey T; Taub, Margaret A; Pineda, Fernando J

2011-01-01

Peer review is fundamentally a cooperative process between scientists in a community who agree to review each other's work in an unbiased fashion. Peer review is the foundation for decisions concerning publication in journals, awarding of grants, and academic promotion. Here we perform a laboratory study of open and closed peer review based on an online game. We show that when reviewer behavior was made public under open review, reviewers were rewarded for refereeing and formed significantly more cooperative interactions (13% increase in cooperation, P = 0.018). We also show that referees and authors who participated in cooperative interactions had an 11% higher reviewing accuracy rate (P = 0.016). Our results suggest that increasing cooperation in the peer review process can lead to a decreased risk of reviewing errors.

Peer support for families of children with complex needs: Development and dissemination of a best practice toolkit.

PubMed

Schippke, J; Provvidenza, C; Kingsnorth, S

2017-11-01

Benefits of peer support interventions for families of children with disabilities and complex medical needs have been described in the literature. An opportunity to create an evidence-informed resource to synthesize best practices in peer support for program providers was identified. The objective of this paper is to describe the key activities used to develop and disseminate the Peer Support Best Practice Toolkit. This project was led by a team of knowledge translation experts at a large pediatric rehabilitation hospital using a knowledge exchange framework. An integrated knowledge translation approach was used to engage stakeholders in the development process through focus groups and a working group. To capture best practices in peer support, a rapid evidence review and review of related resources were completed. Case studies were also included to showcase practice-based evidence. The toolkit is freely available online for download and is structured into four sections: (a) background and models of peer support, (b) case studies of programs, (c) resources, and (d) rapid evidence review. A communications plan was developed to disseminate the resource and generate awareness through presentations, social media, and champion engagement. Eight months postlaunch, the peer support website received more than 2,400 webpage hits. Early indicators suggest high relevance of this resource among stakeholders. The toolkit format was valuable to synthesize and share best practices in peer support. Strengths of the work include the integrated approach used to develop the toolkit and the inclusion of both the published research literature and experiential evidence. © 2017 John Wiley & Sons Ltd.

How Does Student Peer Review Influence Perceptions, Engagement and Academic Outcomes? A Case Study

ERIC Educational Resources Information Center

Mulder, Raoul; Baik, Chi; Naylor, Ryan; Pearce, Jon

2014-01-01

Involving students in peer review has many pedagogical benefits, but few studies have explicitly investigated relationships between the content of peer reviews, student perceptions and assessment outcomes. We conducted a case study of peer review within a third-year undergraduate subject at a research-intensive Australian university, in which we…

Do Peer Reviews Help Improve Student Writing Abilities in an EFL High School Classroom?

ERIC Educational Resources Information Center

Kurihara, Noriko

2017-01-01

Several studies have reported the benefits of peer reviews in English as a second language (ESL) and English as a foreign language (EFL) writing classrooms. However, there has been little empirical research on whether such peer reviews improve students' writing abilities. The current study investigated the effects of peer review on the development…

Predicting Academics' Willingness to Participate in Peer Review of Teaching: A Quantitative Investigation

ERIC Educational Resources Information Center

White, Kiri; Boehm, Emilia; Chester, Andrea

2014-01-01

Peer review of teaching is a collegial process designed to help academics reflect on and improve their teaching practice. Considerable research supports the value of peer review of teaching. However, uptake of voluntary programs is typically low. Few studies have examined the predictors of engagement in voluntary peer review. This study surveyed…

Building Scholarly Writers: Student Perspectives on Peer Review in a Doctoral Writing Seminar

ERIC Educational Resources Information Center

Adamek, Margaret Ellen

2015-01-01

Peer review was used as a primary pedagogical tool in a scholarly writing course for social work doctoral students. To gauge student response to peer review and learning as a result of peer review, the instructor used narrative analysis to organize student comments into themes. Themes identified included initial trepidation, "no pain, no…

34 CFR 359.30 - How is peer review conducted under this program?

Code of Federal Regulations, 2010 CFR

2010-07-01

... 34 Education 2 2010-07-01 2010-07-01 false How is peer review conducted under this program? 359.30 Section 359.30 Education Regulations of the Offices of the Department of Education (Continued) OFFICE OF...? § 359.30 How is peer review conducted under this program? Peer review is conducted under this program in...

Don't Tell It Like It Is: Preserving Collegiality in the Summative Peer Review of Teaching

ERIC Educational Resources Information Center

Iqbal, Isabeau A.

2014-01-01

While much literature has considered feedback and professional growth in formative peer reviews of teaching, there has been little empirical research conducted on these issues in the context of summative peer reviews. This article explores faculty members' perceptions of feedback practices in the summative peer review of teaching and reports on…

75 FR 24568 - Notice of Intent To Seek OMB Approval To Collect Information: Revision of a Form Pertaining to...

Federal Register 2010, 2011, 2012, 2013, 2014

2010-05-05

... Peer Review of ARS Research Projects AGENCY: Agricultural Research Service (ARS), USDA. ACTION: Notice... scientific peer reviews of all research activities conducted by the USDA. The Office manages the ARS peer review system by centrally planning peer panel reviews for ARS research projects on a five-year cycle...

Students' Collaborative Peer Reviewing in an Online Writing Environment

ERIC Educational Resources Information Center

Bradley, Linda; Thouësny, Sylvie

2017-01-01

Peer review is applied as a powerful tool to enhance student collaboration online writing. The purpose of this paper is to analyse learners' mechanisms of peer reviewing in the nature of student interventions and interactions in written online peer reviewing and how categorization of student comments can be used as a means for analysing student…

Adapting Peer Review to an Online Course: An Exploratory Case Study

ERIC Educational Resources Information Center

Knight, Linda V.; Steinbach, Theresa A.

2011-01-01

With demonstrated benefits to higher level learning, peer review in the classroom has been well researched and popular since at least the 1990s. However, little or no prior studies exist into the peer review process for online courses. Further, we found no prior research specifically addressing the operational aspects of online peer review. This…

External Peer Review Report on the Defense Contract Management Agency Office of Independent Assessment Internal Review Team

DTIC Science & Technology

2015-11-02

External Peer Review Report on the Defense Contract Management Agency Office of Independent Assessment Internal Review Team N O V E M B E R 2 , 2 0 1 5... MANAGEMENT AGENCY SUBJECT: External Peer Review Report on the Defense Contract Management Agency Office of Independent Assessment Internal Review Team...Report No. DODIG-2016-007) Attached is the External Peer Review Report on the Defense Contract Management Agency Office of Independent Assessment

Peer Models in Mental Health for Caregivers and Families.

PubMed

Acri, Mary; Hooley, Cole D; Richardson, Nicole; Moaba, Lily B

2017-02-01

Peer-delivered mental health models may hold important benefits for family members, yet their prevalence, components, and outcomes are unknown. We conducted a review of peer-delivered services for families of children and adults with mental health problems. Randomized studies of interventions published between 1990 and 2014 were included if the intervention contained a component for family members and examined familial outcomes. Of 77 studies that were assessed for their eligibility, six met criteria. Familial components included coping and parenting skills, knowledge about mental health, and emotional support. Outcomes were uneven, although significant improvements in family functioning, knowledge about mental illness, parental concerns about their child, and parenting skills were associated with the intervention. Peer-delivered services for family members may have important benefits to family members and individuals with mental health problems; however, the research base remains thin. A research agenda to develop and examine these models is discussed.

Peer Feedback in Anonymous Peer Review in an EFL Writing Class in Spain

ERIC Educational Resources Information Center

Coté, Robert A.

2014-01-01

The present study reports the results of a process of peer feedback through anonymous peer review in an EFL writing class. Numerous studies have reported on the benefits of peer review (PR) in the ESL/EFL writing classroom. However, the literature also identifies social issues that can negatively affect the outcome of face-to-face PR. In this…

Peer-Mediated Theatrical Engagement for Improving Reciprocal Social Interaction in Autism Spectrum Disorder

PubMed Central

Corbett, Blythe A.; Qualls, Lydia R.; Valencia, Blythe; Fecteau, Stéphanie-M.; Swain, Deanna M.

2014-01-01

The hallmark characteristic of autism spectrum disorder (ASD) is poor reciprocal social communication. Interventions designed to improve this core deficit are critically needed. Social skills interventions such as direct training, peer mediation, and video modeling have contributed to improvements in various social skills in children with ASD. This paper reviews existing social competence interventions available for children with ASD while highlighting hypothesized critical components for advancing, maintaining, and generalizing skills, which include (1) peer mediation, (2) active learning, and (3) implementation in supportive, natural contexts. As a framework for these approaches, this conceptual paper describes SENSE Theatre, a novel intervention that combines trained peers that facilitate the performance-based theatrical treatment delivered in a supportive, community-based environment. A review of previous research shows early feasibility, setting the stage for more rigorous studies to aid in developing a standardized intervention package. PMID:25346926

Online Radiology Reporting with Peer Review as a Learning and Feedback Tool in Radiology; Implementation, Validity, and Student Impressions.

PubMed

McEvoy, Fintan J; Shen, Nicholas W; Nielsen, Dorte H; Buelund, Lene E; Holm, Peter

2017-02-01

Communicating radiological reports to peers has pedagogical value. Students may be uneasy with the process due to a lack of communication and peer review skills or to their failure to see value in the process. We describe a communication exercise with peer review in an undergraduate veterinary radiology course. The computer code used to manage the course and deliver images online is reported, and we provide links to the executable files. We tested to see if undergraduate peer review of radiological reports has validity and describe student impressions of the learning process. Peer review scores for student-generated radiological reports were compared to scores obtained in the summative multiple choice (MCQ) examination for the course. Student satisfaction was measured using a bespoke questionnaire. There was a weak positive correlation (Pearson correlation coefficient = 0.32, p < 0.01) between peer review scores students received and the student scores obtained in the MCQ examination. The difference in peer review scores received by students grouped according to their level of course performance (high vs. low) was statistically significant (p < 0.05). No correlation was found between peer review scores awarded by the students and the scores they obtained in the MCQ examination (Pearson correlation coefficient = 0.17, p = 0.14). In conclusion, we have created a realistic radiology imaging exercise with readily available software. The peer review scores are valid in that to a limited degree they reflect student future performance in an examination. Students valued the process of learning to communicate radiological findings but do not fully appreciated the value of peer review.

7 CFR 3400.14 - Proposal review.

Code of Federal Regulations, 2010 CFR

2010-01-01

... SERVICE, DEPARTMENT OF AGRICULTURE SPECIAL RESEARCH GRANTS PROGRAM Scientific Peer Review of Research... employees of the Department, the respective peer review group, and ad hoc reviewers, as required. Written...-depth discussions will be provided by peer review group members prior to recommending applications for...

How peer-review constrains cognition: on the frontline in the knowledge sector.

PubMed

Cowley, Stephen J

2015-01-01

Peer-review is neither reliable, fair, nor a valid basis for predicting 'impact': as quality control, peer-review is not fit for purpose. Endorsing the consensus, I offer a reframing: while a normative social process, peer-review also shapes the writing of a scientific paper. In so far as 'cognition' describes enabling conditions for flexible behavior, the practices of peer-review thus constrain knowledge-making. To pursue cognitive functions of peer-review, however, manuscripts must be seen as 'symbolizations', replicable patterns that use technologically enabled activity. On this bio-cognitive view, peer-review constrains knowledge-making by writers, editors, reviewers. Authors are prompted to recursively re-aggregate symbolizations to present what are deemed acceptable knowledge claims. How, then, can recursive re-embodiment be explored? In illustration, I sketch how the paper's own content came to be re-aggregated: agonistic review drove reformatting of argument structure, changes in rhetorical ploys and careful choice of wordings. For this reason, the paper's knowledge-claims can be traced to human activity that occurs in distributed cognitive systems. Peer-review is on the frontline in the knowledge sector in that it delimits what can count as knowing. Its systemic nature is therefore crucial to not only discipline-centered 'real' science but also its 'post-academic' counterparts.

Real-Time Peer Review: An Innovative Feature to an Evidence-Based Practice Conference

PubMed Central

Eldredge, Jonathan D.; Phillips, Holly E.; Kroth, Philip J.

2013-01-01

Many health sciences librarians as well as other professionals attend conferences on a regular basis. This study sought to link an innovative peer review process of presented research papers to long-term conference outcomes in the peer-reviewed professional journal literature. An evidence-based conference included a proof-of-concept study to gauge the long-term outcomes from research papers presented during the program. Real-time peer review recommendations from the conference were linked to final versions of articles published in the peer-reviewed literature. The real-time peer review feedback served as the basis for further mentoring to guide prospective authors toward publishing their research results. These efforts resulted in the publication of two of the four research papers in the peer-viewed literature. A third presented paper appeared in a blog because the authors wanted to disseminate their findings more quickly than through the journal literature. The presenters of the fourth paper never published their study. Real-time peer review from this study can be adapted to other professional conferences that include presented research papers. PMID:24180649

Navigating manuscript assessment: The new practitioner's guide to primary literature peer review.

PubMed

Smith, Devlin V; Stokes, Laura B; Marx, Kayleigh; Aitken, Samuel L

2018-01-01

For pharmacists, the first years after graduation are spent developing their knowledge base, advancing as a practitioner, and honing their abilities as healthcare providers and drug information experts. New practitioners encounter many challenges during this time, which for many include publishing original research or reviewing manuscripts for colleagues and medical journals. Inexperience navigating the publication process, from submission to receipt of (and response to) peer review commentary, is often cited as a major barrier to timely publication of resident and new practitioner research. Serving as a peer reviewer in turn provides the new practitioner with insight on this process and can be an enlightening experience used to garner confidence in subsequently submitting their own formal manuscripts. A number of publications describing steps for peer review are available, however, many of these articles address more experienced reviewers or critique the peer review process itself. No definitive resource exists for new pharmacy practitioners interested in developing their peer review skills. The information presented in this summative guide should be used in conjunction with practice opportunities to help new practitioners develop proficiency at peer review.

Medicare: Better Controls Needed for Peer Review Organizations’ Evaluations.

DTIC Science & Technology

1987-10-01

reflected significant uncertainties (percent of cases reviewed and cost per case). The national funding model utilized to develop the Goverrnent estimates...differences. As GAO stated, HCFA’s funding model was based on data from HCFA’s actuary, the Departnent of Labor, professional medical associations and... funding model extremely valuable in negotiating PRO contracts. The conclusion reached by GAO that the overall average cost contracted per review was less

The effect of peer review on mortality rates.

PubMed

Krahwinkel, W; Schuler, E; Liebetrau, M; Meier-Hellmann, A; Zacher, J; Kuhlen, R

2016-10-01

Lowering of mortality rates in hospitals with mortality rates higher than accepted reference values for acute myocardial infarction (AMI), congestive heart failure (CHF), pneumonia, stroke, mechanical ventilation (MV) and colorectal surgery by using an external peer review process that identifies areas requiring rectification and implements protocols directed at improving these areas. Retrospective, observational, quality management study using administrative data to compare in-hospital mortality rates (pre and post an external peer review process that included adoption of improvement protocols) with reference values. German general hospitals of a large, private group. Hospitals with mortality rates higher than reference values. Peer review of medical records by experienced, outside physicians triggered by in-hospital mortality rates higher than expected. Inadequacies were identified, improvement protocols enforced and mortality rates subsequently re-examined. Mortality rates 1 year before and 1 year after peer review and protocol use. For AMI, CHF, pneumonia, stroke, MV and colorectal surgery, the mortality rates 1 year post-peer review were significantly decreased as compared to pre-peer review mortality rates. The standardized mortality ratio for all of the above diagnoses was 1.45, 1 year before peer review, and 0.97, 1 year after peer review. The absolute risk reduction of 7.3% translates into 710 deaths in this population which could have been prevented. Peer review triggered and conducted in the manner described here is associated with a significant lowering of in-hospital mortality rates in hospitals that previously had higher than expected mortality rates. © The Author 2016. Published by Oxford University Press in association with the International Society for Quality in Health Care.

Examining the Predictive Validity of NIH Peer Review Scores

PubMed Central

Lindner, Mark D.; Nakamura, Richard K.

2015-01-01

The predictive validity of peer review at the National Institutes of Health (NIH) has not yet been demonstrated empirically. It might be assumed that the most efficient and expedient test of the predictive validity of NIH peer review would be an examination of the correlation between percentile scores from peer review and bibliometric indices of the publications produced from funded projects. The present study used a large dataset to examine the rationale for such a study, to determine if it would satisfy the requirements for a test of predictive validity. The results show significant restriction of range in the applications selected for funding. Furthermore, those few applications that are funded with slightly worse peer review scores are not selected at random or representative of other applications in the same range. The funding institutes also negotiate with applicants to address issues identified during peer review. Therefore, the peer review scores assigned to the submitted applications, especially for those few funded applications with slightly worse peer review scores, do not reflect the changed and improved projects that are eventually funded. In addition, citation metrics by themselves are not valid or appropriate measures of scientific impact. The use of bibliometric indices on their own to measure scientific impact would likely increase the inefficiencies and problems with replicability already largely attributed to the current over-emphasis on bibliometric indices. Therefore, retrospective analyses of the correlation between percentile scores from peer review and bibliometric indices of the publications resulting from funded grant applications are not valid tests of the predictive validity of peer review at the NIH. PMID:26039440

77 FR 19126 - Defense Federal Acquisition Regulation Supplement: New Threshold for Peer Reviews of...

Federal Register 2010, 2011, 2012, 2013, 2014

2012-03-30

... Federal Acquisition Regulation Supplement: New Threshold for Peer Reviews of Noncompetitive Contracts... Regulation Supplement (DFARS) to modify the threshold for noncompetitive contract peer reviews. DATES...-6088. SUPPLEMENTARY INFORMATION: I. Background This final rule reduces the threshold for DoD peer...

Cleanroom Software Engineering Reference Model. Version 1.0.

DTIC Science & Technology

1996-11-01

teams. It also serves as a baseline for continued evolution of Cleanroom practice. The scope of the CRM is software management , specification...addition to project staff, participants include management , peer organization representatives, and customer representatives as appropriate for...2 Review the status of the process with management , the project team, peer groups, and the customer . These verification activities include

Cost model validation: a technical and cultural approach

NASA Technical Reports Server (NTRS)

Hihn, J.; Rosenberg, L.; Roust, K.; Warfield, K.

2001-01-01

This paper summarizes how JPL's parametric mission cost model (PMCM) has been validated using both formal statistical methods and a variety of peer and management reviews in order to establish organizational acceptance of the cost model estimates.

Gender bias in scholarly peer review

PubMed Central

Helmer, Markus; Schottdorf, Manuel; Neef, Andreas; Battaglia, Demian

2017-01-01

Peer review is the cornerstone of scholarly publishing and it is essential that peer reviewers are appointed on the basis of their expertise alone. However, it is difficult to check for any bias in the peer-review process because the identity of peer reviewers generally remains confidential. Here, using public information about the identities of 9000 editors and 43000 reviewers from the Frontiers series of journals, we show that women are underrepresented in the peer-review process, that editors of both genders operate with substantial same-gender preference (homophily), and that the mechanisms of this homophily are gender-dependent. We also show that homophily will persist even if numerical parity between genders is reached, highlighting the need for increased efforts to combat subtler forms of gender bias in scholarly publishing. DOI: http://dx.doi.org/10.7554/eLife.21718.001 PMID:28322725

Quality assurance in radiology: peer review and peer feedback.

PubMed

Strickland, N H

2015-11-01

Peer review in radiology means an assessment of the accuracy of a report issued by another radiologist. Inevitably, this involves a judgement opinion from the reviewing radiologist. Peer feedback is the means by which any form of peer review is communicated back to the original author of the report. This article defines terms, discusses the current status, identifies problems, and provides some recommendations as to the way forward, concentrating upon the software requirements for efficient peer review and peer feedback of reported imaging studies. Radiologists undertake routine peer review in their everyday clinical practice, particularly when reporting and preparing for multidisciplinary team meetings. More formal peer review of reported imaging studies has been advocated as a quality assurance measure to promote good clinical practice. It is also a way of assessing the competency of reporting radiologists referred for investigation to bodies such as the General Medical Council (GMC). The literature shows, firstly, that there is a very wide reported range of discrepancy rates in many studies, which have used a variety of non-comparable methodologies; and secondly, that applying scoring systems in formal peer review is often meaningless, unhelpful, and can even be detrimental. There is currently a lack of electronic peer feedback system software on the market to inform radiologists of any review of their work that has occurred or to provide them with clinical outcome information on cases they have previously reported. Learning opportunities are therefore missed. Radiologists should actively engage with the medical informatics industry to design optimal peer review and feedback software with features to meet their needs. Such a system should be easy to use, be fully integrated with the radiological information and picture archiving systems used clinically, and contain a free-text comment box, without a numerical scoring system. It should form a temporary record that cannot be permanently archived. It must provide automated feedback to the original author. Peer feedback, as part of everyday reporting, should enhance daily learning for radiologists. Software requirements for everyday peer feedback differ from those needed for a formal peer review process, which might only be necessary in the setting of a formal GMC enquiry into a particular radiologist's reporting competence, for example. Copyright © 2015 The Royal College of Radiologists. Published by Elsevier Ltd. All rights reserved.

Doing Peer Review: Reflections from an International Group of Postdoctoral Fellows

ERIC Educational Resources Information Center

Merry, Lisa; Jarvis, Kimberly; Kupoluyi, Joseph; Lual, Jomama One Jomama

2017-01-01

There is very little written regarding developing the skills of doing peer reviews. In this piece we use our own experience as postdoctoral fellows to offer our reflections on how to get the most out of doing peer reviews as a trainee researcher. We touch upon the variety and complexity of peer reviews, the debates concerning the nature and…

A proposal for an 'equal peer-review' statement.

PubMed

Moustafa, Khaled

2015-08-01

To make the peer-review process as objective as possible, I suggest the introduction of an 'equal peer-review' statement that preserves author anonymity across the board, thus removing any potential bias related to nominal or institutional 'prestige'; this would guarantee an equal peer-review process for all authors and grant applicants. Copyright © 2015 Elsevier Ltd. All rights reserved.

Peer Review in Class: Metrics and Variations in a Senior Course

ERIC Educational Resources Information Center

Yankulov, Krassimir; Couto, Richard

2012-01-01

Peer reviews are the generally accepted mode of quality assessment in scholarly communities; however, they are rarely used for evaluation at college levels. Over a period of 5 years, we have performed a peer review simulation at a senior level course in molecular genetics at the University of Guelph and have accumulated 393 student peer reviews.…

Love Canal Emergency Declaration Area habitability study. Volume 5. Peer review summary: TRC (Technical Review Committee) responses. Final report

DOE Office of Scientific and Technical Information (OSTI.GOV)

Not Available

Environmental studies were conducted to provide data that could be used by the Commissioner of Health for the State of New York in determining whether the Emergency Declaration Area surrounding the Love Canal hazardous-waste site is habitable. These volumes (II through IV) were reviewed by a peer-review panel of expert scientists. The scientists concluded that each of the three environmental studies was well planned and well executed. Volume V summarizes the peer review and gives additional information or clarifications as requested during the peer review. Volume V also provides additional supplemental statistical analyses requested by the peer reviewer panel.

Inspection of the Math Model Tools for On-Orbit Assessment of Impact Damage Report. Version 1.0

NASA Technical Reports Server (NTRS)

Harris, Charles E.; Raju, Ivatury S.; Piascik, Robert S.; Kramer White, Julie; Labbe, Steve G.; Rotter, Hank A.

2005-01-01

In Spring of 2005, the NASA Engineering Safety Center (NESC) was engaged by the Space Shuttle Program (SSP) to peer review the suite of analytical tools being developed to support the determination of impact and damage tolerance of the Orbiter Thermal Protection Systems (TPS). The NESC formed an independent review team with the core disciplines of materials, flight sciences, structures, mechanical analysis and thermal analysis. The Math Model Tools reviewed included damage prediction and stress analysis, aeroheating analysis, and thermal analysis tools. Some tools are physics-based and other tools are empirically-derived. Each tool was created for a specific use and timeframe, including certification, real-time pre-launch assessments, and real-time on-orbit assessments. The tools are used together in an integrated strategy for assessing the ramifications of impact damage to tile and RCC. The NESC teams conducted a peer review of the engineering data package for each Math Model Tool. This report contains the summary of the team observations and recommendations from these reviews.

A randomised trial of peer review: the UK National Chronic Obstructive Pulmonary Disease Resources and Outcomes Project.

PubMed

Roberts, C M; Stone, R A; Buckingham, R J; Pursey, N A; Harrison, B D W; Lowe, D; Potter, J M

2010-06-01

Peer review has been widely employed within the NHS to facilitate health quality improvement but has not been rigorously evaluated. This article reports the largest randomised trial of peer review ever conducted in the UK. The peer review intervention was a reciprocal supportive exercise that included clinicians, hospital management, commissioners and patients which focused on the quality of the provision of four specific evidence-based aspects of chronic obstructive pulmonary disease care. Follow up at 12 months demonstrated few quantitative differences in the number or quality of services offered in the two groups. Qualitative data in contrast suggested many benefits of peer review in most but not all intervention units and some control teams. Findings suggest peer review in this format is a positive experience for most participants but is ineffective in some situations. Its longer term benefits and cost effectiveness require further study. The generic findings of this study have potential implications for the application of peer review throughout the NHS.

A survey of quality assurance practices in biomedical open source software projects.

PubMed

Koru, Günes; El Emam, Khaled; Neisa, Angelica; Umarji, Medha

2007-05-07

Open source (OS) software is continuously gaining recognition and use in the biomedical domain, for example, in health informatics and bioinformatics. Given the mission critical nature of applications in this domain and their potential impact on patient safety, it is important to understand to what degree and how effectively biomedical OS developers perform standard quality assurance (QA) activities such as peer reviews and testing. This would allow the users of biomedical OS software to better understand the quality risks, if any, and the developers to identify process improvement opportunities to produce higher quality software. A survey of developers working on biomedical OS projects was conducted to examine the QA activities that are performed. We took a descriptive approach to summarize the implementation of QA activities and then examined some of the factors that may be related to the implementation of such practices. Our descriptive results show that 63% (95% CI, 54-72) of projects did not include peer reviews in their development process, while 82% (95% CI, 75-89) did include testing. Approximately 74% (95% CI, 67-81) of developers did not have a background in computing, 80% (95% CI, 74-87) were paid for their contributions to the project, and 52% (95% CI, 43-60) had PhDs. A multivariate logistic regression model to predict the implementation of peer reviews was not significant (likelihood ratio test = 16.86, 9 df, P = .051) and neither was a model to predict the implementation of testing (likelihood ratio test = 3.34, 9 df, P = .95). Less attention is paid to peer review than testing. However, the former is a complementary, and necessary, QA practice rather than an alternative. Therefore, one can argue that there are quality risks, at least at this point in time, in transitioning biomedical OS software into any critical settings that may have operational, financial, or safety implications. Developers of biomedical OS applications should invest more effort in implementing systemic peer review practices throughout the development and maintenance processes.

Improving the peer review skills of young rheumatologists and researchers in rheumatology: the EMEUNET Peer Review Mentoring Program.

PubMed

Rodríguez-Carrio, Javier; Putrik, Polina; Sepriano, Alexandre; Moltó, Anna; Nikiphorou, Elena; Gossec, Laure; Kvien, Tore K; Ramiro, Sofia

2018-01-01

Although peer review plays a central role in the maintenance of high standards in scientific research, training of reviewing skills is not included in the common education programmes. The Emerging EULAR (European League Against Rheumatism) Network (EMEUNET) developed a programme to address this unmet need. The EMEUNET Peer Review Mentoring Program for Rheumatology Journals promotes a systematic training of reviewing skills by engaging mentees in a 'real world' peer review experience supervised by experienced mentors with support from rheumatology journals. This viewpoint provides an overview of this initiative and its outcomes, and discusses its potential limitations. Over 4 years, 18 mentors and 86 mentees have participated. Among the 33 participants who have completed the programme, 13 (39.3%) have become independent reviewers for Annals of the Rheumatic Diseases after the training. This programme has been recently evaluated by a survey and qualitative interviews, revealing a high interest in this initiative. The main strengths (involvement of a top journal and learning opportunities) and weaknesses of the programme (limited number of places and insufficient dissemination) were identified. Overall, this programme represents an innovative and successful approach to peer review training. Continuous evaluation and improvement are key to its functioning. The EMEUNET Peer Review Mentoring Program may be used as a reference for peer review training in areas outside rheumatology.

How to run a successful Journal

PubMed Central

Jawaid, Shaukat Ali; Jawaid, Masood

2017-01-01

Publishing and successfully running a good quality peer reviewed biomedical scientific journal is not an easy task. Some of the pre-requisites include a competent experienced editor supported by a team. Long term sustainability of a journal will depend on good quality manuscripts, active editorial board, good quality of reviewers, workable business model to ensure financial support, increased visibility which will ensure increased submissions, indexation in various important databases, online availability and easy to use website. This manuscript outlines the logistics and technical issues which need to be resolved before starting a new journal and ensuring sustainability of a good quality peer reviewed journal. PMID:29492089

The effects of an editor serving as one of the reviewers during the peer-review process.

PubMed

Giordan, Marco; Csikasz-Nagy, Attila; Collings, Andrew M; Vaggi, Federico

2016-01-01

Background Publishing in scientific journals is one of the most important ways in which scientists disseminate research to their peers and to the wider public. Pre-publication peer review underpins this process, but peer review is subject to various criticisms and is under pressure from growth in the number of scientific publications. Methods Here we examine an element of the editorial process at eLife , in which the Reviewing Editor usually serves as one of the referees, to see what effect this has on decision times, decision type, and the number of citations. We analysed a dataset of 8,905 research submissions to eLife since June 2012, of which 2,747 were sent for peer review. This subset of 2747 papers was then analysed in detail.   Results The Reviewing Editor serving as one of the peer reviewers results in faster decision times on average, with the time to final decision ten days faster for accepted submissions (n=1,405) and five days faster for papers that were rejected after peer review (n=1,099). Moreover, editors acting as reviewers had no effect on whether submissions were accepted or rejected, and a very small (but significant) effect on citation rates. Conclusions An important aspect of eLife 's peer-review process is shown to be effective, given that decision times are faster when the Reviewing Editor serves as a reviewer. Other journals hoping to improve decision times could consider adopting a similar approach.

45 CFR 1388.9 - Peer review.

Code of Federal Regulations, 2014 CFR

2014-10-01

... PROGRAM THE UNIVERSITY AFFILIATED PROGRAMS § 1388.9 Peer review. (a) The purpose of the peer review..., including on-site visits or inspections as necessary. (b) Applications for funding opportunities under part...

45 CFR 1388.9 - Peer review.

Code of Federal Regulations, 2013 CFR

2013-10-01

... PROGRAM THE UNIVERSITY AFFILIATED PROGRAMS § 1388.9 Peer review. (a) The purpose of the peer review..., including on-site visits or inspections as necessary. (b) Applications for funding opportunities under part...

45 CFR 1388.9 - Peer review.

Code of Federal Regulations, 2011 CFR

2011-10-01

... PROGRAM THE UNIVERSITY AFFILIATED PROGRAMS § 1388.9 Peer review. (a) The purpose of the peer review..., including on-site visits or inspections as necessary. (b) Applications for funding opportunities under part...

45 CFR 1388.9 - Peer review.

Code of Federal Regulations, 2012 CFR

2012-10-01

... PROGRAM THE UNIVERSITY AFFILIATED PROGRAMS § 1388.9 Peer review. (a) The purpose of the peer review..., including on-site visits or inspections as necessary. (b) Applications for funding opportunities under part...

A peer review process as part of the implementation of clinical pathways in radiation oncology: Does it improve compliance?

PubMed

Gebhardt, Brian J; Heron, Dwight E; Beriwal, Sushil

Clinical pathways are patient management plans that standardize evidence-based practices to ensure high-quality and cost-effective medical care. Implementation of a pathway is a collaborative process in our network, requiring the active involvement of physicians. This approach promotes acceptance of pathway recommendations, although a peer review process is necessary to ensure compliance and to capture and approve off-pathway selections. We investigated the peer review process and factors associated with time to completion of peer review. Our cancer center implemented radiation oncology pathways for every disease site throughout a large, integrated network. Recommendations are written based upon national guidelines, published literature, and institutional experience with evidence evaluated hierarchically in order of efficacy, toxicity, and then cost. Physicians enter decisions into an online, menu-driven decision support tool that integrates with medical records. Data were collected from the support tool and included the rate of on- and off-pathway selections, peer review decisions performed by disease site directors, and time to complete peer review. A total of 6965 treatment decisions were entered in 2015, and 605 (8.7%) were made off-pathway and were subject to peer review. The median time to peer review decision was 2 days (interquartile range, 0.2-6.8). Factors associated with time to peer review decision >48 hours on univariate analysis include disease site (P < .0001) with a trend toward significance (P = .066) for radiation therapy modality. There was no difference between recurrent and non-recurrent disease (P = .267). Multivariable analysis revealed disease site was associated with time to peer review (P < .001), with lymphoma and skin/sarcoma most strongly influencing decision time >48 hours. Clinical pathways are an integral tool for standardizing evidence-based care throughout our large, integrated network, with 91.3% of all treatment decisions being made as per pathway. The peer review process was feasible, with <1% selections ultimately rejected, suggesting that awareness of peer review of treatment decisions encourages compliance with clinical pathway recommendations. Copyright © 2017 American Society for Radiation Oncology. Published by Elsevier Inc. All rights reserved.

Online and offline peer led models against bullying and cyberbullying.

PubMed

Palladino, Benedetta Emanuela; Nocentini, Annalaura; Menesini, Ersilia

2012-11-01

The aim of the present study is to describe and evaluate an ongoing peer-led model against bullying and cyberbullying carried out with Italian adolescents. The evaluation of the project was made through an experimental design consisting of a pre-test and a post-test. Participants in the study were 375 adolescents (20.3% males), enrolled in 9th to 13th grades. The experimental group involved 231 students with 42 peer educators, and the control group involved 144 students. Results showed a significant decrease in the experimental group as compared to the control group for all the variables except for cyberbullying. Besides, in the experimental group we found a significant increase in adaptive coping strategies like problem solving and a significant decrease in maladaptive coping strategies like avoidance: these changes mediate the changes in the behavioural variables. In particular, the decrease in avoidance predicts the decrease in victimization and cybervictimization for peer educators and for the other students in the experimental classes whereas the increase in problem solving predicts the decrease in cyberbullying only in the peer educators group. Results are discussed following recent reviews on evidence based efficacy of peer led models.

Signature Pedagogy: A Literature Review of Social Studies and Technology Research

ERIC Educational Resources Information Center

Beck, Dennis; Eno, Jenni

2012-01-01

A literature review of 121 peer-reviewed articles, books, and conference proceedings was conducted to determine the signature pedagogies of social studies education and technology integration. The authors found that the signature social studies pedagogy is based on two primary instructional models: direct-instruction and inquiry-based,…

How peer-review constrains cognition: on the frontline in the knowledge sector

PubMed Central

Cowley, Stephen J.

2015-01-01

Peer-review is neither reliable, fair, nor a valid basis for predicting ‘impact’: as quality control, peer-review is not fit for purpose. Endorsing the consensus, I offer a reframing: while a normative social process, peer-review also shapes the writing of a scientific paper. In so far as ‘cognition’ describes enabling conditions for flexible behavior, the practices of peer-review thus constrain knowledge-making. To pursue cognitive functions of peer-review, however, manuscripts must be seen as ‘symbolizations’, replicable patterns that use technologically enabled activity. On this bio-cognitive view, peer-review constrains knowledge-making by writers, editors, reviewers. Authors are prompted to recursively re-aggregate symbolizations to present what are deemed acceptable knowledge claims. How, then, can recursive re-embodiment be explored? In illustration, I sketch how the paper’s own content came to be re-aggregated: agonistic review drove reformatting of argument structure, changes in rhetorical ploys and careful choice of wordings. For this reason, the paper’s knowledge-claims can be traced to human activity that occurs in distributed cognitive systems. Peer-review is on the frontline in the knowledge sector in that it delimits what can count as knowing. Its systemic nature is therefore crucial to not only discipline-centered ‘real’ science but also its ‘post-academic’ counterparts. PMID:26579064

Development of a peer-review framework for cancer multidisciplinary meetings.

PubMed

Johnson, Claire E; Slavova-Azmanova, Neli; Saunders, Christobel

2017-05-01

There is no mechanism in place for monitoring or quality improvement of cancer multidisciplinary meetings (MDM) in Australia. To develop a peer-review process for quality improvement of MDM. This project involved three phases: (i) development of a draft peer-review framework, supporting documents and peer-review process; (ii) consultation with key stakeholders; (iii) refinement of the framework, documents and processes following a pilot study with three MDM. Feedback indicated that specific standards included in the framework needed to allow the peer reviewers to be flexible relative to the circumstances of the individual MDM. Conversely, feedback identified the need for clear, evidence-based clinical practice guidelines for the conduct of MDM, with accepted standards and objective measures of performance. MDM members were divided about the need to employ peer reviewers from the tumour stream of the MDM under review but agreed that closer involvement of the team under review to support the implementation of recommendations is warranted. We developed an adaptable peer-review framework and process using the current available evidence and guidance. While further research is needed to establish what constitutes best practice in MDM and which processes contribute to improved patient outcomes, the structured peer-review process we describe, when modified using the disease-relevant evidence, could be utilised more broadly as a quality improvement tool. © 2017 Royal Australasian College of Physicians.

Journal peer review: a bar or bridge? An analysis of a paper's revision history and turnaround time, and the effect on citation.

PubMed

Rigby, J; Cox, D; Julian, K

2018-01-01

Journal peer review lies at the heart of academic quality control. This article explores the journal peer review process and seeks to examine how the reviewing process might itself contribute to papers, leading them to be more highly cited and to achieve greater recognition. Our work builds on previous observations and views expressed in the literature about (a) the role of actors involved in the research and publication process that suggest that peer review is inherent in the research process and (b) on the contribution reviewers themselves might make to the content and increased citation of papers. Using data from the journal peer review process of a single journal in the Social Sciences field (Business, Management and Accounting), we examine the effects of peer review on papers submitted to that journal including the effect upon citation, a novel step in the study of the outcome of peer review. Our detailed analysis suggests, contrary to initial assumptions, that it is not the time taken to revise papers but the actual number of revisions that leads to greater recognition for papers in terms of citation impact. Our study provides evidence, albeit limited to the case of a single journal, that the peer review process may constitute a form of knowledge production and is not the simple correction of errors contained in submitted papers.

Transformation of Adolescent Peer Relations in the Social Media Context: Part 1-A Theoretical Framework and Application to Dyadic Peer Relationships.

PubMed

Nesi, Jacqueline; Choukas-Bradley, Sophia; Prinstein, Mitchell J

2018-04-07

Investigators have long recognized that adolescents' peer experiences provide a crucial context for the acquisition of developmental competencies, as well as potential risks for a range of adjustment difficulties. However, recent years have seen an exponential increase in adolescents' adoption of social media tools, fundamentally reshaping the landscape of adolescent peer interactions. Although research has begun to examine social media use among adolescents, researchers have lacked a unifying framework for understanding the impact of social media on adolescents' peer experiences. This paper represents Part 1 of a two-part theoretical review, in which we offer a transformation framework to integrate interdisciplinary social media scholarship and guide future work on social media use and peer relations from a theory-driven perspective. We draw on prior conceptualizations of social media as a distinct interpersonal context and apply this understanding to adolescents' peer experiences, outlining features of social media with particular relevance to adolescent peer relations. We argue that social media transforms adolescent peer relationships in five key ways: by changing the frequency or immediacy of experiences, amplifying experiences and demands, altering the qualitative nature of interactions, facilitating new opportunities for compensatory behaviors, and creating entirely novel behaviors. We offer an illustration of the transformation framework applied to adolescents' dyadic friendship processes (i.e., experiences typically occurring between two individuals), reviewing existing evidence and offering theoretical implications. Overall, the transformation framework represents a departure from the prevailing approaches of prior peer relations work and a new model for understanding peer relations in the social media context.

Peer Review: Promoting Efficient School District Operations

ERIC Educational Resources Information Center

Hale, Jason S.

2010-01-01

Many professions recognize the benefits of peer reviews to assess processes and operations because peers can more easily identify one another's inefficiencies and provide some kind of intervention. Generally, the goal of the peer review process is to verify whether the work satisfies the standards set by the industry. A number of states have begun…

Using Calibrated Peer Review to Teach Basic Research Skills

ERIC Educational Resources Information Center

Bracke, Marianne S.; Graveel, John G.

2014-01-01

Calibrated Peer Review (CPR) is an online tool being used in the class Introduction to Agriculture and Purdue University (AGR 10100) to integrate a writing and research component (http://cpr.molsci.ucla.edu/Home.aspx). Calibrated Peer Review combines the ability to create writing intensive assignments with an introduction to the peer-review…

Acknowledging Students' Collaborations through Peer Review: A Footnoting Practice

ERIC Educational Resources Information Center

Poe, Shelli M.; Gravett, Emily O.

2016-01-01

Student-to-student peer review or peer feedback is commonly used in student-centered or active-learning classrooms. In this article, we describe a footnoting exercise that we implemented in two of our undergraduate courses as one way to encourage students to acknowledge collaborations and contributions made during peer-review processes. This…

A Method for Improving the Integrity of Peer Review.

PubMed

Dadkhah, Mehdi; Kahani, Mohsen; Borchardt, Glenn

2017-08-15

Peer review is the most important aspect of reputable journals. Without it, we would be unsure about whether the material published was as valid and reliable as is possible. However, with the advent of the Internet, scientific literature has now become subject to a relatively new phenomenon: fake peer reviews. Some dishonest researchers have been manipulating the peer review process to publish what are often inferior papers. There are even papers that explain how to do it. This paper discusses one of those methods and how editors can defeat it by using a special review ID. This method is easy to understand and can be added to current peer review systems easily.

Measuring the effectiveness of scientific gatekeeping.

PubMed

Siler, Kyle; Lee, Kirby; Bero, Lisa

2015-01-13

Peer review is the main institution responsible for the evaluation and gestation of scientific research. Although peer review is widely seen as vital to scientific evaluation, anecdotal evidence abounds of gatekeeping mistakes in leading journals, such as rejecting seminal contributions or accepting mediocre submissions. Systematic evidence regarding the effectiveness--or lack thereof--of scientific gatekeeping is scant, largely because access to rejected manuscripts from journals is rarely available. Using a dataset of 1,008 manuscripts submitted to three elite medical journals, we show differences in citation outcomes for articles that received different appraisals from editors and peer reviewers. Among rejected articles, desk-rejected manuscripts, deemed as unworthy of peer review by editors, received fewer citations than those sent for peer review. Among both rejected and accepted articles, manuscripts with lower scores from peer reviewers received relatively fewer citations when they were eventually published. However, hindsight reveals numerous questionable gatekeeping decisions. Of the 808 eventually published articles in our dataset, our three focal journals rejected many highly cited manuscripts, including the 14 most popular; roughly the top 2 percent. Of those 14 articles, 12 were desk-rejected. This finding raises concerns regarding whether peer review is ill--suited to recognize and gestate the most impactful ideas and research. Despite this finding, results show that in our case studies, on the whole, there was value added in peer review. Editors and peer reviewers generally--but not always-made good decisions regarding the identification and promotion of quality in scientific manuscripts.

Context-Aware Reviewer Assignment for Trust Enhanced Peer Review

PubMed Central

Li, Lei; Wang, Yan; Liu, Guanfeng; Wang, Meng; Wu, Xindong

2015-01-01

Reviewer assignment is critical to peer review systems, such as peer-reviewed research conferences or peer-reviewed funding applications, and its effectiveness is a deep concern of all academics. However, there are some problems in existing peer review systems during reviewer assignment. For example, some of the reviewers are much more stringent than others, leading to an unfair final decision, i.e., some submissions (i.e., papers or applications) with better quality are rejected. In this paper, we propose a context-aware reviewer assignment for trust enhanced peer review. More specifically, in our approach, we first consider the research area specific expertise of reviewers, and the institution relevance and co-authorship between reviewers and authors, so that reviewers with the right expertise are assigned to the corresponding submissions without potential conflict of interest. In addition, we propose a novel cross-assignment paradigm, and reviewers are cross-assigned in order to avoid assigning a group of stringent reviewers or a group of lenient reviewers to the same submission. More importantly, on top of them, we propose an academic CONtext-aware expertise relevanCe oriEnted Reviewer cross-assignmenT approach (CONCERT), which aims to effectively estimate the “true” ratings of submissions based on the ratings from all reviewers, even though no prior knowledge exists about the distribution of stringent reviewers and lenient reviewers. The experiments illustrate that compared with existing approaches, our proposed CONCERT approach can less likely assign more than one stringent reviewers or lenient reviewers to a submission simultaneously and significantly reduce the influence of ratings from stringent reviewers and lenient reviewers, leading to trust enhanced peer review and selection, no matter what kind of distributions of stringent reviewers and lenient reviewers are. PMID:26090849

International Conference in Computational Cell Biology: From the Past to the Future

DTIC Science & Technology

2016-09-12

24061 -0001 ABSTRACT Number of Papers published in peer -reviewed journals: Number of Papers published in non peer -reviewed journals: Final Report...present their latest research and discussed challenges in computational cell biology research and education. (a) Papers published in peer -reviewed...List the papers, including journal references, in the following categories: (b) Papers published in non- peer -reviewed journals (N/A for none) (c

A Generalized Thurstonian Paired Comparison Multicriteria Heuristic Model for Peer Evaluation of Individual Performance on IS Team Projects

ERIC Educational Resources Information Center

Scher, Julian M.

2010-01-01

Information Systems instructors are generally encouraged to introduce team projects into their pedagogy, with a consequential issue of objectively evaluating the performance of each individual team member. The concept of "freeloading" is well-known for team projects, and for this, and other reasons, a peer review process of team members,…

Evidence-based Peer Review for Radiation Therapy - Updated Review of the Literature with a Focus on Tumour Subsite and Treatment Modality.

PubMed

Huo, M; Gorayski, P; Poulsen, M; Thompson, K; Pinkham, M B

2017-10-01

Technological advances in radiation therapy permit steep dose gradients from the target to spare normal tissue, but increase the risk of geographic miss. Suboptimal target delineation adversely affects clinical outcomes. Prospective peer review is a method for quality assurance of oncologists' radiotherapy plans. Published surveys suggest it is widely implemented. However, it may not be feasible to review every case before commencement of radiation therapy in all departments. The rate of plan changes following peer review of cases without a specific subsite or modality is typically around 10%. Stereotactic body radiation therapy, head and neck, gynaecological, gastrointestinal, haematological and lung cases are associated with higher rates of change of around 25%. These cases could thus be prioritised for peer review. Other factors may limit peer review efficacy including organisational culture, time constraints and the physical environment in which sessions are held. Recommendations for peer review endorsed by the American Society for Radiation Oncology were made available in 2013, but a number of relevant studies have been published since. Here we review and update the literature, and provide an updated suggestion for the implementation of peer review to serve as an adjunct to published guidelines. This may help practitioners evaluate their current processes and maximise the utility and effectiveness of peer review sessions. Copyright © 2017 The Royal College of Radiologists. Published by Elsevier Ltd. All rights reserved.

Coached Peer Review: Developing the Next Generation of Authors.

PubMed

Sidalak, Daniel; Purdy, Eve; Luckett-Gatopoulos, S; Murray, Heather; Thoma, Brent; Chan, Teresa M

2017-02-01

Publishing in academic journals is challenging for learners. Those who pass the initial stages of internal review by an editor often find the anonymous peer review process harsh. Academic blogs offer alternate avenues for publishing medical education material. Many blogs, however, lack a peer review process, which some consumers argue compromises the quality of materials published. CanadiEM (formerly BoringEM) is an academic educational emergency medicine blog dedicated to publishing high-quality materials produced by learners (i.e., residents and medical students). The editorial team has designed and implemented a collaborative "coached peer review" process that comprises an open exchange among the learner-author, editors, and reviewers. The goal of this process is to facilitate the publication of high-quality academic materials by learner-authors while providing focused feedback to help them develop academic writing skills. The authors of this Innovation Report surveyed (February-June 2015) their blog's learner-authors and external expert "staff" reviewers who had participated in coached peer review for their reactions to the process. The survey results revealed that participants viewed the process positively compared with both traditional journal peer review and academic blog publication processes. Participants found the process friendly, easy, efficient, and transparent. Learner-authors also reported increased confidence in their published material. These outcomes met the goals of coached peer review. CanadiEM aims to inspire continued participation in, exposure to, and high-quality production of academic writing by promoting the adoption of coached peer review for online educational resources produced by learners.

Rate and factors influencing the conversion of abstracts presented at the argentinian congress of hypertension meetings to indexed full peer-reviewed publications.

PubMed

Barochiner, J; Martínez, R; Choi, M; Espeche, W; Micali, R G; Tomat, A

2018-03-01

Publication rates vary significantly among different scientific meetings, with many abstracts never being published as peer-reviewed articles. This issue has never been investigated in the Hypertension field in Argentina. Our purpose was to determine the proportion of abstracts presented at the Argentinian Congress of Hypertension meetings that were published as full articles in peer-reviewed indexed journals, the time lag to publication and the factors associated with successful publication. we conducted a PubMed search to identify peer-reviewed publications of abstracts presented at the Argentinian Congress of Hypertension meetings between 2006 and 2015, assessing publication rate along with the time lag to publication. We also extracted information about several abstract characteristics and, for those that got published, we recorded the date of publication and journal name with its impact factor and H index. Predictors of publication were analyzed using a multivariable model. a total of 619 abstracts were presented between 2006 and 2015. The rate of conversion to full-text peer-reviewed articles by June 2017 was 28.1% (95%CI 24.7-31.8%), with a median time to publication of 15.7 months (IQR 8-30.9). On multivariable analysis, the independent predictors of publication were basic science category (OR 5 [95%CI 2.3-10.8], p<0.001), oral presentation (OR 2.8 [95%CI 1.6-4.9], p<0.001) and being an award winner for the presentation (OR 3 [95%CI 1.3-6.8], p=0.01). conversion rate to full peer-reviewed articles of abstracts presented at the Argentinian Congress of Hypertension meetings is far from ideal, with potential areas where efforts should be concentrated to improve dissemination of knowledge. Copyright © 2018 SEH-LELHA. Publicado por Elsevier España, S.L.U. All rights reserved.

Improving your journal article using feedback from peer review.

PubMed

Price, Bob

2014-09-30

While preparation of a journal article for submission may often include informal review by colleagues, an article is not accepted for publication until it has been formally peer reviewed. Peer review is the process whereby journal editors ask expert reviewers to examine the work submitted and prepare a report on its suitability for publication. Two or more revisions of the article may be required following peer review, with the author reworking the article in the light of feedback received on each occasion. This can be challenging for some authors, but used well, it offers a chance to improve the work to the required standard of the journal, and help the author present a more precise and coherent account of the arguments. The extent to which the author responds to the critical commentary of peer reviewers is important, because this may determine whether or not the article is published. This article explores the aims of peer reviewers and recommends ways in which authors can respond to the feedback provided.

Peer Collaboration: Improving Teaching through Comprehensive Peer Review

ERIC Educational Resources Information Center

Smith, Shelley L.

2014-01-01

This article includes a brief rationale and review of the literature on peer review of teaching (PRT). Based on that literature review, it offers a proposal for an optimal formative review process that results in a teaching portfolio that would reflect a faculty member's efforts and successes in a critically reflective PRT process, and contributes…

42 CFR 52h.9 - What matters must be reviewed for unsolicited contract proposals?

Code of Federal Regulations, 2010 CFR

2010-10-01

... SERVICES GRANTS SCIENTIFIC PEER REVIEW OF RESEARCH GRANT APPLICATIONS AND RESEARCH AND DEVELOPMENT CONTRACT... covered by this part unless the proposal has been reviewed by a peer review group in accordance with the... proposal. (b) Except to the extent otherwise provided by law, peer review group recommendations are...

Peer review.

PubMed

Twaij, H; Oussedik, S; Hoffmeyer, P

2014-04-01

The maintenance of quality and integrity in clinical and basic science research depends upon peer review. This process has stood the test of time and has evolved to meet increasing work loads, and ways of detecting fraud in the scientific community. However, in the 21st century, the emphasis on evidence-based medicine and good science has placed pressure on the ways in which the peer review system is used by most journals. This paper reviews the peer review system and the problems it faces in the digital age, and proposes possible solutions.

7 CFR 3400.10 - Establishment and operation of peer review groups.

Code of Federal Regulations, 2011 CFR

2011-01-01

... INSTITUTE OF FOOD AND AGRICULTURE SPECIAL RESEARCH GRANTS PROGRAM Scientific Peer Review of Research Grant Applications § 3400.10 Establishment and operation of peer review groups. Subject to § 3400.5, the...

28 CFR 34.104 - Use of peer review.

Code of Federal Regulations, 2013 CFR

2013-07-01

... the peer review process. (c) Ratings will be in the form of numerical scores assigned by individual... results of peer review for a noncompetitive new or continuation project will be in the form of numerical...

28 CFR 34.104 - Use of peer review.

Code of Federal Regulations, 2014 CFR

2014-07-01

... the peer review process. (c) Ratings will be in the form of numerical scores assigned by individual... results of peer review for a noncompetitive new or continuation project will be in the form of numerical...

28 CFR 34.104 - Use of peer review.

Code of Federal Regulations, 2011 CFR

2011-07-01

... the peer review process. (c) Ratings will be in the form of numerical scores assigned by individual... results of peer review for a noncompetitive new or continuation project will be in the form of numerical...

28 CFR 34.104 - Use of peer review.

Code of Federal Regulations, 2012 CFR

2012-07-01

... the peer review process. (c) Ratings will be in the form of numerical scores assigned by individual... results of peer review for a noncompetitive new or continuation project will be in the form of numerical...

Eyes wide open: reader and author responsibility in understanding the limits of peer review.

PubMed

Benson, P J

2015-10-01

'Medical science can only flourish in a free society and dies under totalitarian repression.' (1) Peer review post-publication is relatively easy to define: when the world decides the importance of publication. Peer review pre-publication is what the scientific community frequently means when using the term 'peer review'. But what it is it? Few will agree on an exact definition; generally speaking, it refers to an independent, third party scrutiny of a manuscript by scientific experts (called peers) who advise on its suitability for publication. Peer review is expensive; although reviewers are unpaid, the cost in time is enormous and it is slow. There is often little agreement among reviewers about whether an article should be published and peer review can be a lottery. Often referred to as a quality assurance process, there are many examples of when peer review failed. Many will be aware of Woo-Suk Hwang's shocking stem cell research misconduct at Seoul National University. (2) Science famously published two breakthrough articles that were found subsequently to be completely fabricated and this happened in spite of peer review. Science is not unique in making this error. However, love it or hate it, peer review, for the present time at least, is here to stay. In this article, Philippa Benson, Managing Editor of Science Advances (the first open access journal of the American Association for the Advancement of Science), discusses the merits of peer review. Dr Benson has extensive experience in the publishing world and was Executive Director of PJB Consulting, a not-for-profit organisation supporting clients on issues related to converting to full electronic publishing workflows as well as challenges working with international authors and publishers. Her clients included the Public Library of Science journals, the American Society for Nutrition and the de Beaumont Foundation. She recently co-authored a book, What Editors Want: An Author's Guide to Scientific Journal Publishing (University of Chicago Press), which helps readers understand and navigate the publishing process in high impact science and technical journals. Her master's and doctorate degrees are from Carnegie Mellon University. JYOTI SHAH Commissioning Editor References 1. Eaton KK . Editorial: when is a peer review journal not a peer review journal? J Nutr Environ Med 1997 ; 7 : 139 - 144 . 2. van der Heyden MA , van de Ven T , Opthof T . Fraud and misconduct in science: the stem cell seduction . Neth Heart J 2009 ; 17 : 25 - 29 .

Peer review of health research funding proposals: A systematic map and systematic review of innovations for effectiveness and efficiency.

PubMed

Shepherd, Jonathan; Frampton, Geoff K; Pickett, Karen; Wyatt, Jeremy C

2018-01-01

To investigate methods and processes for timely, efficient and good quality peer review of research funding proposals in health. A two-stage evidence synthesis: (1) a systematic map to describe the key characteristics of the evidence base, followed by (2) a systematic review of the studies stakeholders prioritised as relevant from the map on the effectiveness and efficiency of peer review 'innovations'. Standard processes included literature searching, duplicate inclusion criteria screening, study keyword coding, data extraction, critical appraisal and study synthesis. A total of 83 studies from 15 countries were included in the systematic map. The evidence base is diverse, investigating many aspects of the systems for, and processes of, peer review. The systematic review included eight studies from Australia, Canada, and the USA, evaluating a broad range of peer review innovations. These studies showed that simplifying the process by shortening proposal forms, using smaller reviewer panels, or expediting processes can speed up the review process and reduce costs, but this might come at the expense of peer review quality, a key aspect that has not been assessed. Virtual peer review using videoconferencing or teleconferencing appears promising for reducing costs by avoiding the need for reviewers to travel, but again any consequences for quality have not been adequately assessed. There is increasing international research activity into the peer review of health research funding. The studies reviewed had methodological limitations and variable generalisability to research funders. Given these limitations it is not currently possible to recommend immediate implementation of these innovations. However, many appear promising based on existing evidence, and could be adapted as necessary by funders and evaluated. Where feasible, experimental evaluation, including randomised controlled trials, should be conducted, evaluating impact on effectiveness, efficiency and quality.

The Effectiveness of Peer Review of Teaching When Performed between Early-Career Academics

ERIC Educational Resources Information Center

Woodman, Richard J.; Parappilly, Maria B.

2015-01-01

The success of peer review of teaching (PRT) in shaping teaching practice during an academic's formative years may depend on the peers' teaching experience and the frequency of evaluation. Two Australian early-career University lecturers with no previous experience of peer review performed a single PRT on one another following a one week academic…

Postdoctoral Clinical-Research Training in Psychiatry

PubMed Central

Reynolds, Charles F.; Martin, Christopher; Brent, David; Ryan, Neal; Dahl, Ronald E.; Pilkonis, Paul; Marcus, Marsha D.; Kupfer, David J.

2009-01-01

The authors describe a model for teaching grant writing and other research survival skills to postdoctoral clinical-research fellows in psychiatry and for improving research mentoring. Over the past 4 years, the authors have developed a course on writing grant applications for postdoctoral clinical-research fellows, using peer-review processes modeled after a National Institutes of Health study section. At the same time, the authors have clarified expectations of mentors in ways designed to help fellows prepare “K” (Research Career Development) applications and to receive mentored practice in skills being taught in the course. Sixteen of 30 fellows have succeeded in receiving their first extramural support by the end of their two-year fellowship tenure or during the succeeding year. The authors conclude that by teaching grant-writing skills in a supportive peer environment, providing peer review of proposals, and sharpening expectations of mentors, it may be possible to reduce the time between the end of fellowship and the receipt of the first extramural grant. PMID:19617924

Multi-Stage Open Peer Review: Scientific Evaluation Integrating the Strengths of Traditional Peer Review with the Virtues of Transparency and Self-Regulation

PubMed Central

Pöschl, Ulrich

2012-01-01

The traditional forms of scientific publishing and peer review do not live up to all demands of efficient communication and quality assurance in today’s highly diverse and rapidly evolving world of science. They need to be advanced and complemented by interactive and transparent forms of review, publication, and discussion that are open to the scientific community and to the public. The advantages of open access, public peer review, and interactive discussion can be efficiently and flexibly combined with the strengths of traditional scientific peer review. Since 2001 the benefits and viability of this approach are clearly demonstrated by the highly successful interactive open access journal Atmospheric Chemistry and Physics (ACP, www.atmos-chem-phys.net) and a growing number of sister journals launched and operated by the European Geosciences Union (EGU, www.egu.eu) and the open access publisher Copernicus (www.copernicus.org). The interactive open access journals are practicing an integrative multi-stage process of publication and peer review combined with interactive public discussion, which effectively resolves the dilemma between rapid scientific exchange and thorough quality assurance. Key features and achievements of this approach are: top quality and impact, efficient self-regulation and low rejection rates, high attractivity and rapid growth, low costs, and financial sustainability. In fact, ACP and the EGU interactive open access sister journals are by most if not all standards more successful than comparable scientific journals with traditional or alternative forms of peer review (editorial statistics, publication statistics, citation statistics, economic costs, and sustainability). The high efficiency and predictive validity of multi-stage open peer review have been confirmed in a series of dedicated studies by evaluation experts from the social sciences, and the same or similar concepts have recently also been adopted in other disciplines, including the life sciences and economics. Multi-stage open peer review can be flexibly adjusted to the needs and peculiarities of different scientific communities. Due to the flexibility and compatibility with traditional structures of scientific publishing and peer review, the multi-stage open peer review concept enables efficient evolution in scientific communication and quality assurance. It has the potential for swift replacement of hidden peer review as the standard of scientific quality assurance, and it provides a basis for open evaluation in science. PMID:22783183

Content and communication: How can peer review provide helpful feedback about the writing?

PubMed Central

Shashok, Karen

2008-01-01

Background Peer review is assumed to improve the quality of research reports as tools for scientific communication, yet strong evidence that this outcome is obtained consistently has been elusive. Failure to distinguish between aspects of discipline-specific content and aspects of the writing or use of language may account for some deficiencies in current peer review processes. Discussion The process and outcomes of peer review may be analyzed along two dimensions: 1) identifying scientific or technical content that is useful to other researchers (i.e., its "screening" function), and 2) improving research articles as tools for communication (i.e., its "improving" function). However, editors and reviewers do not always distinguish clearly between content criteria and writing criteria. When peer reviewers confuse content and writing, their feedback can be misunderstood by authors, who may modify texts in ways that do not make the readers' job easier. When researchers in peer review confuse the two dimensions, this can lead to content validity problems that foil attempts to define informative variables and outcome measures, and thus prevent clear trends from emerging. Research on writing, revising and editing suggests some reasons why peer review is not always as effective as it might be in improving what is written. Summary Peer review could be improved if stakeholders were more aware of variations in gatekeepers' (reviewers' and editors') ability to provide feedback about the content or the writing. Gatekeepers, academic literacy researchers, and wordface professionals (author's editors, medical writers and translators) could work together to discover the types of feedback authors find most useful. I offer suggestions to help editologists design better studies of peer review which could make the process an even stronger tool for manuscript improvement than it is now. PMID:18237378

Content and communication: how can peer review provide helpful feedback about the writing?

PubMed

Shashok, Karen

2008-01-31

Peer review is assumed to improve the quality of research reports as tools for scientific communication, yet strong evidence that this outcome is obtained consistently has been elusive. Failure to distinguish between aspects of discipline-specific content and aspects of the writing or use of language may account for some deficiencies in current peer review processes. The process and outcomes of peer review may be analyzed along two dimensions: 1) identifying scientific or technical content that is useful to other researchers (i.e., its "screening" function), and 2) improving research articles as tools for communication (i.e., its "improving" function). However, editors and reviewers do not always distinguish clearly between content criteria and writing criteria. When peer reviewers confuse content and writing, their feedback can be misunderstood by authors, who may modify texts in ways that do not make the readers' job easier. When researchers in peer review confuse the two dimensions, this can lead to content validity problems that foil attempts to define informative variables and outcome measures, and thus prevent clear trends from emerging. Research on writing, revising and editing suggests some reasons why peer review is not always as effective as it might be in improving what is written. Peer review could be improved if stakeholders were more aware of variations in gatekeepers' (reviewers' and editors') ability to provide feedback about the content or the writing. Gatekeepers, academic literacy researchers, and wordface professionals (author's editors, medical writers and translators) could work together to discover the types of feedback authors find most useful. I offer suggestions to help editologists design better studies of peer review which could make the process an even stronger tool for manuscript improvement than it is now.

Applications of the Schur Basis to Quantum Algorithms

DTIC Science & Technology

2011-01-10

superpolynomial speedups based on quantum circuits. (a) Papers published in peer -reviewed journals (N/A for none) 1. D.A.Bacon, I.L. Chuang, A.W...reporting period. List the papers, including journal references, in the following categories: (b) Papers published in non- peer -reviewed journals or in...MIT, Department of EECS, 2008 7.00Number of Papers published in peer -reviewed journals: Number of Papers published in non peer -reviewed journals: (c

VICTORIA: A mechanistic model for radionuclide behavior in the reactor coolant system

DOE Office of Scientific and Technical Information (OSTI.GOV)

Schaperow, J.H.; Bixler, N.E.

1996-12-31

VICTORIA is the U.S. Nuclear Regulatory Commission`s (NRC`s) mechanistic, best-estimate code for analysis of fission product release from the core and subsequent transport in the reactor vessel and reactor coolant system. VICTORIA requires thermal-hydraulic data (i.e., temperatures, pressures, and velocities) as input. In the past, these data have been taken from the results of calculations from thermal-hydraulic codes such as SCDAP/RELAP5, MELCOR, and MAAP. Validation and assessment of VICTORIA 1.0 have been completed. An independent peer review of VICTORIA, directed by Brookhaven National Laboratory and supported by experts in the areas of fuel release, fission product chemistry, and aerosol physics,more » has been undertaken. This peer review, which will independently assess the code`s capabilities, is nearing completion with the peer review committee`s final report expected in Dec 1996. A limited amount of additional development is expected as a result of the peer review. Following this additional development, the NRC plans to release VICTORIA 1.1 and an updated and improved code manual. Future plans mainly involve use of the code for plant calculations to investigate specific safety issues as they arise. Also, the code will continue to be used in support of the Phebus experiments.« less

Learning effects of thematic peer-review: a qualitative analysis of reflective journals on spiritual care.

PubMed

van Leeuwen, René; Tiesinga, Lucas J; Jochemsen, Henk; Post, Doeke

2009-05-01

This study describes the learning effects of thematic peer-review discussion groups (Hendriksen, 2000. Begeleid intervisie model, Collegiale advisering en probleemoplossing, Nelissen, Baarn.) on developing nursing students' competence in providing spiritual care. It also discusses the factors that might influence the learning process. The method of peer-review is a form of reflective learning based on the theory of experiential learning (Kolb, 1984. Experiential learning, Experience as the source of learning development. Englewoods Cliffs, New Jersey, Prentice Hill). It was part of an educational programme on spiritual care in nursing for third-year undergraduate nursing students from two nursing schools in the Netherlands. Reflective journals (n=203) kept by students throughout the peer-review process were analysed qualitatively The analysis shows that students reflect on spirituality in the context of personal experiences in nursing practice. In addition, they discuss the nursing process and organizational aspects of spiritual care. The results show that the first two phases in the experiential learning cycle appear prominently; these are 'inclusion of actual experience' and 'reflecting on this experience'. The phases of 'abstraction of experience' and 'experimenting with new behaviour' are less evident. We will discuss possible explanations for these findings according to factors related to education, the students and the tutors and make recommendations for follow-up research.

Radiologist Peer Review by Group Consensus.

PubMed

Harvey, H Benjamin; Alkasab, Tarik K; Prabhakar, Anand M; Halpern, Elkan F; Rosenthal, Daniel I; Pandharipande, Pari V; Gazelle, G Scott

2016-06-01

The objective of this study was to evaluate the feasibility of the consensus-oriented group review (COGR) method of radiologist peer review within a large subspecialty imaging department. This study was institutional review board approved and HIPAA compliant. Radiologist interpretations of CT, MRI, and ultrasound examinations at a large academic radiology department were subject to peer review using the COGR method from October 2011 through September 2013. Discordance rates and sources of discordance were evaluated on the basis of modality and division, with group differences compared using a χ(2) test. Potential associations between peer review outcomes and the time after the initiation of peer review or the number of radiologists participating in peer review were tested by linear regression analysis and the t test, respectively. A total of 11,222 studies reported by 83 radiologists were peer reviewed using COGR during the two-year study period. The average radiologist participated in 112 peer review conferences and had 3.3% of his or her available CT, MRI and ultrasound studies peer reviewed. The rate of discordance was 2.7% (95% confidence interval [CI], 2.4%-3.0%), with significant differences in discordance rates on the basis of division and modality. Discordance rates were highest for MR (3.4%; 95% CI, 2.8%-4.1%), followed by ultrasound (2.7%; 95% CI, 2.0%-3.4%) and CT (2.4%; 95% CI, 2.0%-2.8%). Missed findings were the most common overall cause for discordance (43.8%; 95% CI, 38.2%-49.4%), followed by interpretive errors (23.5%; 95% CI, 18.8%-28.3%), dictation errors (19.0%; 95% CI, 14.6%-23.4%), and recommendation (10.8%; 95% CI, 7.3%-14.3%). Discordant cases, compared with concordant cases, were associated with a significantly greater number of radiologists participating in the peer review process (5.9 vs 4.7 participating radiologists, P < .001) and were significantly more likely to lead to an addendum (62.9% vs 2.7%, P < .0001). COGR permits departments to collect highly contextualized peer review data to better elucidate sources of error in diagnostic imaging reports, while reviewing a sufficient case volume to comply with external standards for ongoing performance review. Copyright © 2016 American College of Radiology. Published by Elsevier Inc. All rights reserved.

The mechanisms underpinning peer support: a literature review.

PubMed

Watson, Emma

2017-12-20

The employment of Peer Support Workers, who themselves have experience of significant emotional distress, can promote recovery at an individual and organisational level. While research examining the benefits of peer support within mental health services continues to grow, an understanding of how, and through what processes, these benefits are reached remains under-developed. To review the published research literature relating to the process of peer support and its underpinning mechanisms to better understand how and why it works. A scoping review of published literature identified studies relating to peer support mechanisms, processes and relationships. Studies were summarised and findings analysed. Five mechanisms were found to underpin peer support relationships (lived experience, love labour, the liminal position of the peer worker, strengths-focussed social and practical support, and the helper role). The identified mechanisms can underpin both the success and difficulties associated with peer support relationships. Further research should review a broader range of literature and clarify how these mechanisms contribute to peer support in different contexts.

An examination of gender differences in the American Fisheries Society peer-review process

USGS Publications Warehouse

Handley, Grace; Frantz, Cynthia M; Kocovsky, Patrick; DeVries, Dennis R.; Cooke, Steven J.; Claussen, Julie

2015-01-01

This study investigated the possibility of gender differences in outcomes throughout the peer review process of American Fisheries Society (AFS) journals. For each manuscript submitted to four AFS journals between January 2003 and December 2010, we collated information regarding the gender and nationality of authors, gender of associate editor, gender of reviewers, reviewer recommendations, associate editor's decision, and publication status of the manuscript. We used hierarchical linear modeling to test for differences in manuscript decision outcomes associated with author, reviewer, and associate editor gender. Gender differences were present at some but not every stage of the review process and were not equal among the four journals. Although there was a small gender difference in decision outcomes, we found no evidence of bias in editors’ and reviewers’ recommendations. Our results support the conclusion that the current single-blind review system does not result in bias against female authors within AFS journals.

Effectiveness of Guided Peer Review of Student Essays in a Large Undergraduate Biology Course

ERIC Educational Resources Information Center

Kelly, Lauren

2015-01-01

Instructors and researchers often consider peer review an integral part of the writing process, providing myriad benefits for both writers and reviewers. Few empirical studies, however, directly address the relationship between specific methodological changes and peer review effectiveness, especially outside the composition classroom. To…

42 CFR 52h.6 - Availability of information.

Code of Federal Regulations, 2010 CFR

2010-10-01

... a peer review group will be available for public inspection and copying to the extent provided by... regulations (45 CFR parts 5, 5b). (b) Meetings of peer review groups reviewing grant applications or contract... by peer review groups that contain trade secrets or commercial or financial information obtained from...

Methodologies of Peer and Editorial Review: Changing Practices

ERIC Educational Resources Information Center

Selfe, Cynthia; Hawisher, Gail

2012-01-01

The authors--drawing on their varied experiences as authors and publishers of a journal and several book series--provide a historical review and consideration of peer review in publishing. They find that scholarly peer review, from the question of signed reviews to the practices of digital publications, is in the midst of change, but that at the…

42 CFR 52h.7 - What matters must be reviewed for grants?

Code of Federal Regulations, 2010 CFR

2010-10-01

... SCIENTIFIC PEER REVIEW OF RESEARCH GRANT APPLICATIONS AND RESEARCH AND DEVELOPMENT CONTRACT PROJECTS § 52h.7... reviewed by a peer review group in accordance with the provisions of this part and the group has made... appropriate peer review group, in accordance with the provisions of this part, and the group has made...

Comparing Peer Review and Self-Review as Ways to Improve College Students' Writing

ERIC Educational Resources Information Center

Covill, Amy E.

2010-01-01

The effect of three approaches to revision instruction on 61 college students' revision behavior and writing quality was investigated for this article. Students wrote three 5-page papers and received one of three instructional approaches: Formal Peer Review (n = 19), Formal Self-Review (n = 20), or No Formal Review (n = 22). Formal Peer Review…

Biomass Program 2007 Program Peer Review - Full Report

DOE Office of Scientific and Technical Information (OSTI.GOV)

none,

This document summarizes the comments provided by the peer reviewers at the U.S. Department of Energy (DOE) Biomass Program’s Peer Review meeting, held on November 14-15, 2007 in Baltimore, MD and Platform Reviews conducted over the summer of 2007. The Platform Reviews provide evaluations of the Program’s projects in applied research, development, and demonstration.

78 FR 71707 - MAP-21 Comprehensive Truck Size and Weight Limits Study Public Meeting and Outreach Sessions

Federal Register 2010, 2011, 2012, 2013, 2014

2013-11-29

.... The second peer review will be on the extent to which the technical analysis and findings address the... Reports based on their thoroughness in reviewing the existing literature, analysis of existing models and...

Views on the peer review system of biomedical journals: an online survey of academics from high-ranking universities

PubMed Central

2013-01-01

Background Peer review is the major method used by biomedical journals for making the decision of publishing an article. This cross-sectional survey assesses views concerning the review system of biomedical journals among academics globally. Methods A total of 28,009 biomedical academics from high-ranking universities listed by the 2009 Times Higher Education Quacquarelli Symonds (THE-QS) World University Rankings were contacted by email between March 2010 and August 2010. 1,340 completed an online survey which focused on their academic background, negative experiences and views on biomedical journal peer review and the results were compared among basic scientists, clinicians and clinician scientists. Results Fewer than half of the respondents agreed that the peer review systems of biomedical journals were fair (48.4%), scientific (47.5%), or transparent (25.1%). Nevertheless, 58.2% of the respondents agreed that authors should remain anonymous and 64.4% agreed that reviewers should not be disclosed. Most, (67.7%) agreed to the establishment of an appeal system. The proportion of native English-speaking respondents who agreed that the “peer review system is fair” was significantly higher than for non-native respondents (p = 0.02). Similarly, the proportion of clinicians stating that the “peer review system is fair” was significantly higher than that for basic scientists and clinician-scientists (p = 0.004). For females, (β = −0.1, p = 0.03), the frequency of encountering personal attacks in reviewers’ comments (β = −0.1, p = 0.002) and the frequency of imposition of unnecessary references by reviewers (β = −0.06, p = 0.04) were independently and inversely associated with agreement that “the peer review system is fair”. Conclusion Academics are divided on the issue of whether the biomedical journal peer review system is fair, scientific and transparent. A majority of academics agreed with the double-blind peer review and to the establishment of an appeal system. Female academics, experience of personal attacks and imposition of unnecessary references by reviewers were related to disagreement about fairness of the peer review system of biomedical journals. PMID:23758823

Four peer reviews in support of the Tier 3 rulemaking ...

EPA Pesticide Factsheets

Peer review of ERG's KenCaryl (CO) estimated summer hot-soak distributions report in support of the Tier 3 rulemaking To peer review ERG's KenCaryl (CO) estimated summer hot-soak distributions report (for Tier 3 rulemaking)

Clinical perspective: creating an effective practice peer review process-a primer.

PubMed

Gandhi, Manisha; Louis, Frances S; Wilson, Shae H; Clark, Steven L

2017-03-01

Peer review serves as an important adjunct to other hospital quality and safety programs. Despite its importance, the available literature contains virtually no guidance regarding the structure and function of effective peer review committees. This Clinical Perspective provides a summary of the purposes, structure, and functioning of effective peer review committees. We also discuss important legal considerations that are a necessary component of such processes. This discussion includes useful templates for case selection and review. Proper committee structure, membership, work flow, and leadership as well as close cooperation with the hospital medical executive committee and legal representatives are essential to any effective peer review process. A thoughtful, fair, systematic, and organized approach to creating a peer review process will lead to confidence in the committee by providers, hospital leadership, and patients. If properly constructed, such committees may also assist in monitoring and enforcing compliance with departmental protocols, thus reducing harm and promoting high-quality practice. Copyright © 2016 Elsevier Inc. All rights reserved.

Why Are Chemists and Other Scientists Afraid of the Peer Review of Teaching?

NASA Astrophysics Data System (ADS)

Atwood, Charles H.; Taylor, James W.; Hutchings, Pat A.

2000-02-01

This paper presents a series of arguments that teaching should be subjected to the similar review standards that chemical research employs. Through peer review, the hope is to elevate the status of teaching in academe. The paper also describes a national effort through the American Association for Higher Education and the Carnegie Foundation for the Advancement of Teaching to establish a peer-review process appropriate for teaching. Finally, an examination of some of the perceived barriers to peer review, including fear, is detailed.

Effects of hydropower operations on spawning habitat, rearing habitat, and standing/entrapment mortality of fall Chinook salmon in the Hanford Reach of the Columbia River

USGS Publications Warehouse

Anglin, Donald R.; Haeseker, Steven L.; Skalicky, Joseph J.; Schaller, Howard; Tiffan, Kenneth F.; Hatten, James R.; Hoffarth, Paul; Nugent, John; Benner, David; Yoshinaka, Marv

2006-01-01

This report describes research conducted primarily in 2003 and 2004 to evaluate the effects of upstream dam operations on spawning and rearing conditions for fall Chinook salmon, Oncorhynchus tshawytscha, in the Hanford Reach of the Columbia River. Results from habitat modeling tasks which continued in 2005 and 2006 are also included in this report. This study is focused on the effects of streamflows and streamflow fluctuations on 1) entrapment and entrapment mortality of juveniles, 2) adult spawning habitat, and 3) juvenile rearing habitat. An independent peer review was conducted on the draft version of this report utilizing three reviewers, each with different areas of expertise and different levels of knowledge regarding hydrodynamic modeling, fall Chinook biology, life history, and habitat requirements, and fishery issues relating to hydropower development and operations. Peer review comments have been incorporated into this final version.

EPA Peer Consultation Workshop Report on the Review of the Draft IRIS Toxicological Review of Dibutyl Phthalate (DBP)

EPA Science Inventory

The U.S. EPA finalized comments gathered from a public peer review of the scientific basis supporting the human health hazard and dose-response assessment of dibutyl phthalate (DBP) that will appear on the Integrated Risk Information System (IRIS) database. The peer review has en...

Giving Feedback: Preparing Students for Peer Review and Self-Evaluation

ERIC Educational Resources Information Center

Philippakos, Zoi A.

2017-01-01

Revision is an important aspect of the writing process but is often challenging for students. Peer review can be helpful, but training is needed for it to work effectively. This article suggests an approach to preparing students for peer review by teaching specific evaluation criteria and leading collaborative practice in reviewing papers written…

Writing Quality Peer Reviews of Research Manuscripts

ERIC Educational Resources Information Center

Ward, Phillip; Graber, Kim C.; van der Mars, Hans

2015-01-01

Peer review is an important mechanism for advancing knowledge in a manner deemed as acceptable by the research community. It can also serve the function of providing guidance to an author(s) to improve the likelihood that manuscripts will be accepted in peer reviewed journals. There is, however, little assistance for new or existing reviewers of…

IRIS Toxicological Review and Summary Documents for 1,4-Dichlorobenzene (External Peer Review)

EPA Science Inventory

The U.S. EPA has conducted a peer review of the scientific basis supporting the human health hazard and dose-response assessment of 1,4-dichlorobenzene that will appear on the Integrated Risk Information System (IRIS) database. Peer review is meant to ensure that science is used ...

Biomass Program 2007 Program Peer Review - Feedstock Platform Summary

DOE Office of Scientific and Technical Information (OSTI.GOV)

none,

This document discloses the comments provided by a review panel at the U.S. Department of Energy Office of the Biomass Program Peer Review held on November 15-16, 2007 in Baltimore, MD and the Feedstock Platform Portfolio Peer Review held on August 21st through 23rd in Washington D.C.

Conflict of Interest and Disclosure Policies in Psychiatry and Medicine: A Comparative Study of Peer-Reviewed Journals

ERIC Educational Resources Information Center

Khurana, Gauri; Henderson, Schuyler; Walter, Garry; Martin, Andres

2012-01-01

Objective: The authors reviewed and characterized conflict of interest (COI) and disclosure policies published in peer-reviewed psychiatric and nonpsychiatric journals. Methods: The authors examined peer-reviewed publications in the psychiatric (N=20) and nonpsychiatric (N=20) literature. Using qualitative and quantitative approaches, they…

The Problem of Humiliation in Peer Review

ERIC Educational Resources Information Center

Comer, Debra R.; Schwartz, Michael

2014-01-01

This paper examines the problem of vituperative feedback from peer reviewers. We argue that such feedback is morally unacceptable, insofar as it humiliates authors and damages their dignity. We draw from social-psychological research to explore those aspects of the peer-review process in general and the anonymity of blind reviewing in particular…

Online Peer Review: Encouraging Student Response and Development

ERIC Educational Resources Information Center

Lansiquot, Reneta; Rosalia, Christine

2015-01-01

This study explored the use of a tailored online peer review program for first-year undergraduate students at an urban college of technology. The program facilitated group peer review in meaningful and technologically elegant ways. Students in a composition class were divided into two groups. One group acted as first reviewers, and the other group…

Thank you to our 2016 peer reviewers

NASA Astrophysics Data System (ADS)

Hauck, Steven A.; Baratoux, David; Stanley, Sabine

2017-02-01

Peer review is one of most fundamental aspects of the modern practice of science. As scientists we hold our own work up to scrutiny by experts among our peers in order to encourage the best practices in scientific conduct and communication. Thorough consideration and review by professional colleagues of scientific papers are critical aspects of ensuring that the manuscripts published by JGR-Planets are accurate, valuable, and clearly communicated. Peer review is an essential element of the process of refining understanding and sharing science, and the effort and expertise shared by each reviewer are crucial to the advancement of planetary science. In 2016, JGR Planets benefited from more than 451 reviews provided by 337 of our peers for papers submitted to the journal. Thank you all for your dedication to advancing planetary science.

A scoping review protocol on the roles and tasks of peer reviewers in the manuscript review process in biomedical journals.

PubMed

Glonti, Ketevan; Cauchi, Daniel; Cobo, Erik; Boutron, Isabelle; Moher, David; Hren, Darko

2017-10-22

The primary functions of peer reviewers are poorly defined. Thus far no body of literature has systematically identified the roles and tasks of peer reviewers of biomedical journals. A clear establishment of these can lead to improvements in the peer review process. The purpose of this scoping review is to determine what is known on the roles and tasks of peer reviewers. We will use the methodological framework first proposed by Arksey and O'Malley and subsequently adapted by Levac et al and the Joanna Briggs Institute. The scoping review will include all study designs, as well as editorials, commentaries and grey literature. The following eight electronic databases will be searched (from inception to May 2017): Cochrane Library, Cumulative Index to Nursing and Allied Health Literature, Educational Resources Information Center, EMBASE, MEDLINE, PsycINFO, Scopus and Web of Science. Two reviewers will use inclusion and exclusion criteria based on the 'Population-Concept-Context' framework to independently screen titles and abstracts of articles considered for inclusion. Full-text screening of relevant eligible articles will also be carried out by two reviewers. The search strategy for grey literature will include searching in websites of existing networks, biomedical journal publishers and organisations that offer resources for peer reviewers. In addition we will review journal guidelines to peer reviewers on how to perform the manuscript review. Journals will be selected using the 2016 journal impact factor. We will identify and assess the top five, middle five and lowest-ranking five journals across all medical specialties. This scoping review will undertake a secondary analysis of data already collected and does not require ethical approval. The results will be disseminated through journals and conferences targeting stakeholders involved in peer review in biomedical research. © Article author(s) (or their employer(s) unless otherwise stated in the text of the article) 2017. All rights reserved. No commercial use is permitted unless otherwise expressly granted.

Bridging the Otolaryngology Peer Review Knowledge Gap: A Call for a Residency Development Program.

PubMed

Schmalbach, Cecelia E

2016-07-01

Current otolaryngology literature and future scientific direction rely heavily on a rigorous peer review process. Just as manuscripts warrant thoughtful review with constructive feedback to the authors, the same can be said for critiques written by novice peer reviewers. Formal scientific peer review training programs are lacking. Recognizing this knowledge gap, Otolaryngology-Head and Neck Surgery is excited to offer its new Resident Reviewer Development Program. All otolaryngology residents who are postgraduate year 2 and above and in excellent academic standing are eligible to participate in this mentored program, during which they will conduct 6 manuscript reviews under the direction of a seasoned reviewer in his or her subspecialty area of interest. By completing reviews alongside a mentor, participants gain the required skills to master the peer review process-a first step that often leads to journal editorial board and associate editor invitations. © American Academy of Otolaryngology—Head and Neck Surgery Foundation 2016.

U.S. EPA. 2000. Science Policy Council Handbook: Peer Review

EPA Pesticide Factsheets

The goal of the Peer Review Policy and this Handbook is to enhance the quality and credibility of Agency decisions by ensuring that the scientific and technical work products underlying these decisions receive appropriate levels of peer review by independe

A systematic review of the effectiveness and cost-effectiveness of peer education and peer support in prisons.

PubMed

Bagnall, Anne-Marie; South, Jane; Hulme, Claire; Woodall, James; Vinall-Collier, Karen; Raine, Gary; Kinsella, Karina; Dixey, Rachael; Harris, Linda; Wright, Nat M J

2015-03-25

Prisoners experience significantly worse health than the general population. This review examines the effectiveness and cost-effectiveness of peer interventions in prison settings. A mixed methods systematic review of effectiveness and cost-effectiveness studies, including qualitative and quantitative synthesis was conducted. In addition to grey literature identified and searches of websites, nineteen electronic databases were searched from 1985 to 2012. Study selection criteria were: Prisoners resident in adult prisons and children resident in Young Offender Institutions (YOIs). Peer-based interventions. Review questions 3 and 4 compared peer and professionally led approaches. Prisoner health or determinants of health; organisational/process outcomes; views of prison populations. Quantitative, qualitative and mixed method evaluations. Fifty-seven studies were included in the effectiveness review and one study in the cost-effectiveness review; most were of poor methodological quality. Evidence suggested that peer education interventions are effective at reducing risky behaviours, and that peer support services are acceptable within the prison environment and have a positive effect on recipients, practically or emotionally. Consistent evidence from many, predominantly qualitative, studies, suggested that being a peer deliverer was associated with positive effects. There was little evidence on cost-effectiveness of peer-based interventions. There is consistent evidence from a large number of studies that being a peer worker is associated with positive health; peer support services are also an acceptable source of help within the prison environment and can have a positive effect on recipients. Research into cost-effectiveness is sparse. PROSPERO ref: CRD42012002349.

Assessment of a model for achieving competency in administration and scoring of the WAIS-IV in post-graduate psychology students.

PubMed

Roberts, Rachel M; Davis, Melissa C

2015-01-01

There is a need for an evidence-based approach to training professional psychologists in the administration and scoring of standardized tests such as the Wechsler Adult Intelligence Scale (WAIS) due to substantial evidence that these tasks are associated with numerous errors that have the potential to significantly impact clients' lives. Twenty three post-graduate psychology students underwent training in using the WAIS-IV according to a best-practice teaching model that involved didactic teaching, independent study of the test manual, and in-class practice with teacher supervision and feedback. Video recordings and test protocols from a role-played test administration were analyzed for errors according to a comprehensive checklist with self, peer, and faculty member reviews. 91.3% of students were rated as having demonstrated competency in administration and scoring. All students were found to make errors, with substantially more errors being detected by the faculty member than by self or peers. Across all subtests, the most frequent errors related to failure to deliver standardized instructions verbatim from the manual. The failure of peer and self-reviews to detect the majority of the errors suggests that novice feedback (self or peers) may be ineffective to eliminate errors and the use of more senior peers may be preferable. It is suggested that involving senior trainees, recent graduates and/or experienced practitioners in the training of post-graduate students may have benefits for both parties, promoting a peer-learning and continuous professional development approach to the development and maintenance of skills in psychological assessment.

Letting the daylight in: Reviewing the reviewers and other ways to maximize transparency in science

PubMed Central

Wicherts, Jelte M.; Kievit, Rogier A.; Bakker, Marjan; Borsboom, Denny

2012-01-01

With the emergence of online publishing, opportunities to maximize transparency of scientific research have grown considerably. However, these possibilities are still only marginally used. We argue for the implementation of (1) peer-reviewed peer review, (2) transparent editorial hierarchies, and (3) online data publication. First, peer-reviewed peer review entails a community-wide review system in which reviews are published online and rated by peers. This ensures accountability of reviewers, thereby increasing academic quality of reviews. Second, reviewers who write many highly regarded reviews may move to higher editorial positions. Third, online publication of data ensures the possibility of independent verification of inferential claims in published papers. This counters statistical errors and overly positive reporting of statistical results. We illustrate the benefits of these strategies by discussing an example in which the classical publication system has gone awry, namely controversial IQ research. We argue that this case would have likely been avoided using more transparent publication practices. We argue that the proposed system leads to better reviews, meritocratic editorial hierarchies, and a higher degree of replicability of statistical analyses. PMID:22536180

Expanding capacity and promoting inclusion in introductory computer science: a focus on near-peer mentor preparation and code review

NASA Astrophysics Data System (ADS)

Pon-Barry, Heather; Packard, Becky Wai-Ling; St. John, Audrey

2017-01-01

A dilemma within computer science departments is developing sustainable ways to expand capacity within introductory computer science courses while remaining committed to inclusive practices. Training near-peer mentors for peer code review is one solution. This paper describes the preparation of near-peer mentors for their role, with a focus on regular, consistent feedback via peer code review and inclusive pedagogy. Introductory computer science students provided consistently high ratings of the peer mentors' knowledge, approachability, and flexibility, and credited peer mentor meetings for their strengthened self-efficacy and understanding. Peer mentors noted the value of videotaped simulations with reflection, discussions of inclusion, and the cohort's weekly practicum for improving practice. Adaptations of peer mentoring for different types of institutions are discussed. Computer science educators, with hopes of improving the recruitment and retention of underrepresented groups, can benefit from expanding their peer support infrastructure and improving the quality of peer mentor preparation.

A comprehensive physiologically based pharmacokinetic knowledgebase and web-based interface for rapid model ranking and querying

EPA Science Inventory

Published physiologically based pharmacokinetic (PBPK) models from peer-reviewed articles are often well-parameterized, thoroughly-vetted, and can be utilized as excellent resources for the construction of models pertaining to related chemicals. Specifically, chemical-specific pa...

Implementation and Validation of PACS Integrated Peer Review for Discrepancy Recording of Radiology Reporting.

PubMed

Olthof, A W; van Ooijen, P M A

2016-09-01

The purpose of this work is to demonstrate the possibility of implementation of a PACS-integrated peer review system based on RADPEER™ classification providing a step-wise implementation plan utilizing features already present in the standard PACS implementation and without the requirement of additional software development. Furthermore, we show the usage and effects of the system during the first 30 months of usage. To allow fast and easy implementation into the daily workflow the key-word feature of the PACS was used. This feature allows to add a key-word to an imaging examination for easy searching in the PACS database (e.g. by entering keywords for different kinds of pathology). For peer review we implemented a keyword structure including a code for each of the existing RADPEER™ scoring language terms and a keyword with the phrase "second reading" followed by the name of the individual radiologist. The use of the short-keys to enter the codes in relation to the peer review was a simple to use solution. During the study 599 reports were peer reviewed. The active participation in this study of the radiologists varies and ranges from 3 to 327 reviews per radiologist. The number of peer review is highest in CT and CR. There are no significant technical obstacles to implement a PACS-integrated RADPEER™ -system based on key-words allowing easy integration of peer review into the daily routine without the requirement of additional software. Peer review implemented in a non-random setting based on relevant priors could already help in increasing the quality of radiological reporting and serve as continuing education among peers. Decisiveness, tact and trust are needed to promote use of the system and collaborative discussion of the results by radiologist.

PSH Transient Simulation Modeling

DOE Office of Scientific and Technical Information (OSTI.GOV)

Muljadi, Eduard

PSH Transient Simulation Modeling presentation from the WPTO FY14 - FY16 Peer Review. Transient effects are an important consideration when designing a PSH system, yet numerical techniques for hydraulic transient analysis still need improvements for adjustable-speed (AS) reversible pump-turbine applications.

Perspective from the Department of Defense Breast Cancer Research Program.

PubMed

Rich, I M; Andejeski, Y; Alciati, M H; Crawford Bisceglio, I; Breslau, E S; McCall, L; Valadez, A

1998-12-01

The Department of Defense (DOD), Breast Cancer Research Program (BCRP) was established in 1993. Since its inception, Congress has appropriated more than 878 million dollars for the BCRP, a unique public-private partnership between the DOD, consumer advocacy, and scientific communities which has funded approximately 1,800 breast cancer research grants. Through this partnership, the BCRP designed a model program for consumer involvement in scientific peer review. This paper describes the BCRP's approach to the processes of recruitment, selection, and preparation of consumers for this expanded role. Further, factors critical to program implementation, such as effective program management, ongoing process improvement, strong program leadership, and allocation of resources, that led to the BCRP's success in developing the previously undefined role of breast cancer survivors as members of scientific peer review panels are discussed. The BCRP demonstrates the feasibility and unique contributions of consumers in scientific peer review and provides a critical foundation for future efforts to ensure consumer involvement in scientific research programs.

Online Peer-to-Peer Support for Young People With Mental Health Problems: A Systematic Review.

PubMed

Ali, Kathina; Farrer, Louise; Gulliver, Amelia; Griffiths, Kathleen M

2015-01-01

Adolescence and early adulthood are critical periods for the development of mental disorders. Online peer-to-peer communication is popular among young people and may improve mental health by providing social support. Previous systematic reviews have targeted Internet support groups for adults with mental health problems, including depression. However, there have been no systematic reviews examining the effectiveness of online peer-to-peer support in improving the mental health of adolescents and young adults. The aim of this review was to systematically identify available evidence for the effectiveness of online peer-to peer support for young people with mental health problems. The PubMed, PsycInfo, and Cochrane databases were searched using keywords and Medical Subject Headings (MeSH) terms. Retrieved abstracts (n=3934) were double screened and coded. Studies were included if they (1) investigated an online peer-to-peer interaction, (2) the interaction discussed topics related to mental health, (3) the age range of the sample was between 12 to 25 years, and (4) the study evaluated the effectiveness of the peer-to-peer interaction. Six studies satisfied the inclusion criteria for the current review. The studies targeted a range of mental health problems including depression and anxiety (n=2), general psychological problems (n=1), eating disorders (n=1), and substance use (tobacco) (n=2). The majority of studies investigated Internet support groups (n=4), and the remaining studies focused on virtual reality chat sessions (n=2). In almost all studies (n=5), the peer support intervention was moderated by health professionals, researchers or consumers. Studies employed a range of study designs including randomized controlled trials (n=3), pre-post studies (n=2) and one randomized trial. Overall, two of the randomized controlled trials were associated with a significant positive outcome in comparison to the control group at post-intervention. In the remaining four studies, peer-to-peer support was not found to be effective. This systematic review identified an overall lack of high-quality studies examining online peer-to-peer support for young people. Given that peer support is frequently used as an adjunct to Internet interventions for a variety of mental health conditions, there is an urgent need to determine the effectiveness of peer support alone as an active intervention.

28 CFR 34.101 - Exceptions to applicability.

Code of Federal Regulations, 2010 CFR

2010-07-01

... Section 34.101 Judicial Administration DEPARTMENT OF JUSTICE OJJDP COMPETITION AND PEER REVIEW PROCEDURES Peer Review § 34.101 Exceptions to applicability. The assistance and procurement contract situations... outside the scope of the section 262(d) peer review requirement as set forth in this subpart. ...

The "peer" in "peer review"

USGS Publications Warehouse

Perry, Gad; Bertoluci, Jaime; Bury, R. Bruce; Hansen, Robert W.; Jehle, Robert; Measey, John; Moon, Brad R.; Muths, Erin L.; Zuffi, Marco A.L.

2011-01-01

Peer review is the best available mechanism for assessing and improving the quality of scientific work. As herpetology broadens its disciplinary and geographic boundaries, high-quality external review is ever more essential. We are writing this editorial jointly because the review process has become increasingly difficult. The resulting delays slow publication times, negatively affect performance reviews, tenure, promotions, and grant proposal success. It harms authors, agencies, and institutions (Ware 2011).

Peer Review and Surgical Innovation: Robotic Surgery and Its Hurdles.

PubMed

Vyas, Dinesh; Cronin, Sean

2015-12-01

The peer review processes as outlined in the Health Care Quality Improvement Act (HCQIA) is meant ensure quality standard of care through a self-policing mechanism by the medical community. This process grants immunity for people filing a peer review, which is meant to protect whistleblowers. However, it also creates a loophole that can be used maliciously to hinder competition. This is accentuated when surgeons are integrating new technologies, such as robotic surgery, into their practice. With more than 2000 da Vinci robots in use and more than 300 new units being shipped each year, robotic surgery has become a mainstay in the surgical field. The applications for robots continue to expand as surgeons discover their expanding capability. We need a better peer review process. That ensures the peer review is void of competitive bias. Peer reviewers need to be familiar with the procedure and the technology. The current process could stymie innovation in the name of competition.

A realist review of one-to-one breastfeeding peer support experiments conducted in developed country settings.

PubMed

Trickey, Heather; Thomson, Gill; Grant, Aimee; Sanders, Julia; Mann, Mala; Murphy, Simon; Paranjothy, Shantini

2018-01-01

The World Health Organisation guidance recommends breastfeeding peer support (BFPS) as part of a strategy to improve breastfeeding rates. In the UK, BFPS is supported by National Institute for Health and Care Excellence guidance and a variety of models are in use. The experimental evidence for BFPS in developed countries is mixed and traditional methods of systematic review are ill-equipped to explore heterogeneity, complexity, and context influences on effectiveness. This review aimed to enhance learning from the experimental evidence base for one-to-one BFPS intervention. Principles of realist review were applied to intervention case studies associated with published experimental studies. The review aimed (a) to explore heterogeneity in theoretical underpinnings and intervention design for one-to-one BFPS intervention; (b) inform design decisions by identifying transferable lessons developed from cross-case comparison of context-mechanism-outcome relationships; and (c) inform evaluation design by identifying context-mechanism-outcome relationships associated with experimental conditions. Findings highlighted poor attention to intervention theory and considerable heterogeneity in BFPS intervention design. Transferable mid-range theories to inform design emerged, which could be grouped into seven categories: (a) congruence with local infant feeding norms, (b) integration with the existing system of health care, (c) overcoming practical and emotional barriers to access, (d) ensuring friendly, competent, and proactive peers, (e) facilitating authentic peer-mother interactions, (f) motivating peers to ensure positive within-intervention amplification, and (g) ensuring positive legacy and maintenance of gains. There is a need to integrate realist principles into evaluation design to improve our understanding of what forms of BFPS work, for whom and under what circumstances. © 2017 John Wiley & Sons Ltd.

Quality Control and Peer Review of Data Sets: Mapping Data Archiving Processes to Data Publication Requirements

NASA Astrophysics Data System (ADS)

Mayernik, M. S.; Daniels, M.; Eaker, C.; Strand, G.; Williams, S. F.; Worley, S. J.

2012-12-01

Data sets exist within scientific research and knowledge networks as both technical and non-technical entities. Establishing the quality of data sets is a multi-faceted task that encompasses many automated and manual processes. Data sets have always been essential for science research, but now need to be more visible as first-class scholarly objects at national, international, and local levels. Many initiatives are establishing procedures to publish and curate data sets, as well as to promote professional rewards for researchers that collect, create, manage, and preserve data sets. Traditionally, research quality has been assessed by peer review of textual publications, e.g. journal articles, conference proceedings, and books. Citation indices then provide standard measures of productivity used to reward individuals for their peer-reviewed work. Whether a similar peer review process is appropriate for assessing and ensuring the quality of data sets remains as an open question. How does the traditional process of peer review apply to data sets? This presentation will describe current work being done at the National Center for Atmospheric Research (NCAR) in the context of the Peer REview for Publication & Accreditation of Research Data in the Earth sciences (PREPARDE) project. PREPARDE is assessing practices and processes for data peer review, with the goal of developing recommendations. NCAR data management teams perform various kinds of quality assessment and review of data sets prior to making them publicly available. The poster will investigate how notions of peer review relate to the types of data review already in place at NCAR. We highlight the data set characteristics and management/archiving processes that challenge the traditional peer review processes by using a number of questions as probes, including: Who is qualified to review data sets? What formal and informal documentation is necessary to allow someone outside of a research team to review a data set? What data set review can be done pre-publication, and what must be done post-publication? What components of the data sets review processes can be automated, and what components will always require human expertise and evaluation?

Tardive Dyskinesia

MedlinePlus

... Supplements Peer Review Process Review Committees Application Support Library Clinical Research Next Steps Pre-Funding: After Review Terms of ... Supplements Peer Review Process Review Committees Application Support Library Clinical Research Next Steps Pre-Funding: After Review Terms of ...

Hemicrania Continua

MedlinePlus

... Supplements Peer Review Process Review Committees Application Support Library Clinical Research Next Steps Pre-Funding: After Review Terms of ... Supplements Peer Review Process Review Committees Application Support Library Clinical Research Next Steps Pre-Funding: After Review Terms of ...

Benign Essential Blepharospasm

MedlinePlus

... Supplements Peer Review Process Review Committees Application Support Library Clinical Research Next Steps Pre-Funding: After Review Terms of ... Supplements Peer Review Process Review Committees Application Support Library Clinical Research Next Steps Pre-Funding: After Review Terms of ...

Doing a Good Deed or Confounding the Problem? Peer Review and Sociology Textbooks.

ERIC Educational Resources Information Center

Kendall, Diana

1999-01-01

Examines how the peer review process influences the writing and publication of sociology textbooks and the teaching of sociology. States that the peer review process may influence the final textbook in five ways: (1) degree of innovation; (2) length; (3) reading level; (4) cloning ancillaries and accessories; and (5) using reviewers as marketing…

Applying Peer Reviews in Software Engineering Education: An Experiment and Lessons Learned

ERIC Educational Resources Information Center

Garousi, V.

2010-01-01

Based on the demonstrated value of peer reviews in the engineering industry, numerous industry experts have listed it at the top of the list of desirable development practices. Experience has shown that problems (defects) are eliminated earlier if a development process incorporates peer reviews and that these reviews are as effective as or even…

Who benefits from peer review? An analysis of the outcome of 100 requests for review by Plastic and Reconstructive Surgery.

PubMed

Loonen, Martijn P J; Hage, J Joris; Kon, Moshe

2005-10-01

Little is known of what is done with the comments on submitted manuscripts provided by peer reviewers or to what extent these comments benefit the editor in deciding to accept or reject the manuscript, the author(s) in revising their manuscript, or the readership at large. Furthermore, nothing is known of any possible benefits of the process to the peer reviewer. Finally, the peer-review process may even be maleficent because of its implicit delay of publication and a possible bias against manuscripts originating from non-Anglo-American countries. The authors evaluated the benefits of the peer-review process to authors, editor, readers, and reviewers by a bibliometric analysis of the outcome of 100 requests for review made by the editor of Plastic and Reconstructive Surgery from 1992 through 2003. The publication delay and potential geographical bias were evaluated as potential disadvantages. The authors' reviewer advised acceptance of 56 percent of the manuscripts, and the editor mostly agreed with his advice. This suggests that the editor benefited from the review. The authors addressed 48 to 81 percent of the reviewer's constructive suggestions, and this suggests that they and the readers benefited also. Readers of Plastic and Reconstructive Surgery may further benefit because manuscripts rejected by Plastic and Reconstructive Surgery end up in less prestigious journals. The implicit delay of publication is limited, and the authors found no bias against non-Anglo-American submissions. The cost-effectiveness of the process for the peer reviewer remains unclear. The peer-review system of Plastic and Reconstructive Surgery, in general, is beneficial.

Peer review of health research funding proposals: A systematic map and systematic review of innovations for effectiveness and efficiency

PubMed Central

Frampton, Geoff K.; Pickett, Karen; Wyatt, Jeremy C.

2018-01-01

Objective To investigate methods and processes for timely, efficient and good quality peer review of research funding proposals in health. Methods A two-stage evidence synthesis: (1) a systematic map to describe the key characteristics of the evidence base, followed by (2) a systematic review of the studies stakeholders prioritised as relevant from the map on the effectiveness and efficiency of peer review ‘innovations’. Standard processes included literature searching, duplicate inclusion criteria screening, study keyword coding, data extraction, critical appraisal and study synthesis. Results A total of 83 studies from 15 countries were included in the systematic map. The evidence base is diverse, investigating many aspects of the systems for, and processes of, peer review. The systematic review included eight studies from Australia, Canada, and the USA, evaluating a broad range of peer review innovations. These studies showed that simplifying the process by shortening proposal forms, using smaller reviewer panels, or expediting processes can speed up the review process and reduce costs, but this might come at the expense of peer review quality, a key aspect that has not been assessed. Virtual peer review using videoconferencing or teleconferencing appears promising for reducing costs by avoiding the need for reviewers to travel, but again any consequences for quality have not been adequately assessed. Conclusions There is increasing international research activity into the peer review of health research funding. The studies reviewed had methodological limitations and variable generalisability to research funders. Given these limitations it is not currently possible to recommend immediate implementation of these innovations. However, many appear promising based on existing evidence, and could be adapted as necessary by funders and evaluated. Where feasible, experimental evaluation, including randomised controlled trials, should be conducted, evaluating impact on effectiveness, efficiency and quality. PMID:29750807

Organised Governmental Learning: Vocational Education and Training Practices between Peer Review and Peer Learning

ERIC Educational Resources Information Center

Speer, Sandra

2011-01-01

Peer learning has already existed for a long time, as an informal as well as a formal practice between people from the same professional area. However, peer learning systems on the macro level are relatively newer concepts. Policy learning can be fostered by various types of organised activities, ranging from peer review frameworks, which often…

Peering into peer-review at GigaScience.

PubMed

Edmunds, Scott C

2013-01-24

Fostering and promoting more open and transparent science is one of the goals of GigaScience. One of the ways we have been doing this is by throwing light on the peer-review process and carrying out open peer-review as standard. In this editorial, we provide our rationale for undertaking this policy, give examples of our positive experiences to date, and encourage others to open up the normally opaque publication process.

Two decades of external peer review of cancer care in general hospitals; the Dutch experience.

PubMed

Kilsdonk, Melvin J; Siesling, Sabine; Otter, Rene; van Harten, Wim H

2016-03-01

External peer review was introduced in general hospitals in the Netherlands in 1994 to assess and improve the multidisciplinary team approach in cancer care. This paper aims to explore the value, perceived impact, and (future) role of external peer review in cancer care. Semistructured interviews were held with clinicians, oncology nurses, and managers from fifteen general hospitals that participated in three rounds of peer review over a period of 16 years. Interviewees reflected on the goals and expectations, experiences, perceived impact, and future role of external peer review. Transcriptions of the interviews were coded to discover recurrent themes. Improving clinical care and organization were the main motives for participation. Positive impact was perceived on multiple aspects of care such as shared responsibilities, internal prioritization of cancer care, improved communication, and a clear structure and position of cancer care within general hospitals. Establishing a direct relationship between the external peer review and organizational or clinical impact proved to be difficult. Criticism was raised on the content of the program being too theoretical and organization-focussed after three rounds. According to most stakeholders, external peer review can improve multidisciplinary team work in cancer care; however, the acceptance is threatened by a perceived disbalance between effort and visible clinical impact. Leaner and more clinically focused programs are needed to keep repeated peer reviews challenging and worthwhile. © 2015 The Authors. Cancer Medicine published by John Wiley & Sons Ltd.

Information Quality in Regulatory Decision Making: Peer Review versus Good Laboratory Practice.

PubMed

McCarty, Lynn S; Borgert, Christopher J; Mihaich, Ellen M

2012-07-01

There is an ongoing discussion on the provenance of toxicity testing data regarding how best to ensure its validity and credibility. A central argument is whether journal peer-review procedures are superior to Good Laboratory Practice (GLP) standards employed for compliance with regulatory mandates. We sought to evaluate the rationale for regulatory decision making based on peer-review procedures versus GLP standards. We examined pertinent published literature regarding how scientific data quality and validity are evaluated for peer review, GLP compliance, and development of regulations. Some contend that peer review is a coherent, consistent evaluative procedure providing quality control for experimental data generation, analysis, and reporting sufficient to reliably establish relative merit, whereas GLP is seen as merely a tracking process designed to thwart investigator corruption. This view is not supported by published analyses pointing to subjectivity and variability in peer-review processes. Although GLP is not designed to establish relative merit, it is an internationally accepted quality assurance, quality control method for documenting experimental conduct and data. Neither process is completely sufficient for establishing relative scientific soundness. However, changes occurring both in peer-review processes and in regulatory guidance resulting in clearer, more transparent communication of scientific information point to an emerging convergence in ensuring information quality. The solution to determining relative merit lies in developing a well-documented, generally accepted weight-of-evidence scheme to evaluate both peer-reviewed and GLP information used in regulatory decision making where both merit and specific relevance inform the process.

Appendix G: Peer review nondisclosure agreement

DOE Office of Scientific and Technical Information (OSTI.GOV)

None, None

This peer review nondisclosure agreement should be signed by each reviewer prior to the program sending review materials if sensitive or proprietary information will be provided reviewers or discussed during the review, and to everyone attending a review.

A Review of Peer Social Development in Early Childhood.

ERIC Educational Resources Information Center

Goin, Robin P.

1998-01-01

Reviews the literature on young children's peer social development. Addresses implications of social learning theory and empirical research. Discusses recurring themes, including child/peer versus child/adult interactions, incorporation of toys and games, influence of mothers, and gender peer preferences. Considers areas lacking empirical support…

Do peers matter? A review of peer and/or friends' influence on physical activity among American adolescents.

PubMed

Fitzgerald, Amanda; Fitzgerald, Noelle; Aherne, Cian

2012-08-01

This systematic review investigated the relationship between peer and/or friend variables and physical activity among adolescents by synthesising cross-sectional, longitudinal, and experimental research conducted in the US. Seven electronic databases were searched to identify related articles published within the last 10 years and the articles reviewed included adolescents between 10 and 18 years. Studies reporting a measure of physical activity for adolescents and at least one potential peer and/or friend variable were included. Research demonstrated that peers and friends have an important role to play in the physical activity behavior of adolescents. Six processes were identified through which peers and/or friends may have an influence on physical activity including: peer and/or friend support, presence of peers and friends, peer norms, friendship quality and acceptance, peer crowds, and peer victimization. The theoretical significance of these results is assessed and the development of peer-related physical activity programs for adolescents is discussed. Copyright © 2012 The Foundation for Professionals in Services for Adolescents. Published by Elsevier Ltd. All rights reserved.

[Improving patient safety through voluntary peer review].

PubMed

Kluge, S; Bause, H

2015-01-01

The intensive care unit (ICU) is one area of the hospital in which processes and communication are of primary importance. Errors in intensive care units can lead to serious adverse events with significant consequences for patients. Therefore quality and risk-management are important measures when treating critically ill patients. A pragmatic approach to support quality and safety in intensive care is peer review. This approach has gained significant acceptance over the past years. It consists of mutual visits by colleagues who conduct standardised peer reviews. These reviews focus on the systematic evaluation of the quality of an ICU's structure, its processes and outcome. Together with different associations, the State Chambers of Physicians and the German Medical Association have developed peer review as a standardized tool for quality improvement. The common goal of all stakeholders is the continuous and sustainable improvement in intensive care with peer reviews significantly increasing and improving communication between professions and disciplines. Peer reviews secure the sustainability of planned change processes and consequently lead the way to an improved culture of quality and safety.

7 CFR 3411.10 - Establishment and operation of peer review groups.

Code of Federal Regulations, 2010 CFR

2010-01-01

...) COOPERATIVE STATE RESEARCH, EDUCATION, AND EXTENSION SERVICE, DEPARTMENT OF AGRICULTURE NATIONAL RESEARCH INITIATIVE COMPETITIVE GRANTS PROGRAM Scientific Peer Review of Research Grant Applications § 3411.10 Establishment and operation of peer review groups. Subject to § 3411.5, the Administrator shall adopt procedures...

7 CFR 3400.10 - Establishment and operation of peer review groups.

Code of Federal Regulations, 2010 CFR

2010-01-01

...) COOPERATIVE STATE RESEARCH, EDUCATION, AND EXTENSION SERVICE, DEPARTMENT OF AGRICULTURE SPECIAL RESEARCH GRANTS PROGRAM Scientific Peer Review of Research Grant Applications § 3400.10 Establishment and operation of peer review groups. Subject to § 3400.5, the Administrator will adopt procedures for the...

42 CFR 52h.5 - Conflict of interest.

Code of Federal Regulations, 2014 CFR

2014-10-01

... Health PUBLIC HEALTH SERVICE, DEPARTMENT OF HEALTH AND HUMAN SERVICES GRANTS SCIENTIFIC PEER REVIEW OF...) This section applies only to conflicts of interest involving members of peer review groups. This... Executive Order 11222, as amended. For those federal employees serving on peer review groups, in accordance...

42 CFR 52h.5 - Conflict of interest.

Code of Federal Regulations, 2013 CFR

2013-10-01

... Health PUBLIC HEALTH SERVICE, DEPARTMENT OF HEALTH AND HUMAN SERVICES GRANTS SCIENTIFIC PEER REVIEW OF...) This section applies only to conflicts of interest involving members of peer review groups. This... Executive Order 11222, as amended. For those federal employees serving on peer review groups, in accordance...

42 CFR 52h.5 - Conflict of interest.

Code of Federal Regulations, 2012 CFR

2012-10-01

... Health PUBLIC HEALTH SERVICE, DEPARTMENT OF HEALTH AND HUMAN SERVICES GRANTS SCIENTIFIC PEER REVIEW OF...) This section applies only to conflicts of interest involving members of peer review groups. This... Executive Order 11222, as amended. For those federal employees serving on peer review groups, in accordance...

External Tank Liquid Hydrogen (LH2) Prepress Regression Analysis Independent Review Technical Consultation Report

NASA Technical Reports Server (NTRS)

Parsons, Vickie s.

2009-01-01

The request to conduct an independent review of regression models, developed for determining the expected Launch Commit Criteria (LCC) External Tank (ET)-04 cycle count for the Space Shuttle ET tanking process, was submitted to the NASA Engineering and Safety Center NESC on September 20, 2005. The NESC team performed an independent review of regression models documented in Prepress Regression Analysis, Tom Clark and Angela Krenn, 10/27/05. This consultation consisted of a peer review by statistical experts of the proposed regression models provided in the Prepress Regression Analysis. This document is the consultation's final report.

Concept Validation and Optimization for a Vent-Based Mine-Blast Mitigation System

DTIC Science & Technology

2015-01-17

the proposed concept has a relatively limited (but respectable) ability to reduce the detonation-induced total momentum transferred to, and the...concept, Multidiscipline Modeling in Materials and Structures, (04 2013): 218. doi: 10.1108/MMMS-04-2013-0029 TOTAL : 9 Number of Papers published in peer...for none) (c) Presentations Number of Presentations: Non Peer-Reviewed Conference Proceeding publications (other than abstracts): Received Paper TOTAL

Model Validation and Site Characterization for Early Deployment MHK Sites and Establishment of Wave Classification Scheme

DOE Office of Scientific and Technical Information (OSTI.GOV)

Kilcher, Levi F

Model Validation and Site Characterization for Early Deployment Marine and Hydrokinetic Energy Sites and Establishment of Wave Classification Scheme presentation from from Water Power Technologies Office Peer Review, FY14-FY16.

Proposed standards for peer-reviewed publication of computer code

USDA-ARS?s Scientific Manuscript database

Computer simulation models are mathematical abstractions of physical systems. In the area of natural resources and agriculture, these physical systems encompass selected interacting processes in plants, soils, animals, or watersheds. These models are scientific products and have become important i...

A systematic review of peer mentoring interventions for people with traumatic brain injury.

PubMed

Morris, Richard Pg; Fletcher-Smith, Joanna C; Radford, Kathryn A

2017-08-01

This systematic review sought evidence concerning the effectiveness of peer mentoring for people with traumatic brain injury. Fourteen electronic databases were searched, including PsycINFO, MEDLINE, CINAHL, EMBASE and the Cochrane Library, from inception to September 21 2016. Ten grey literature databases, PROSPERO, two trials registers, reference lists and author citations were also searched. Studies which employed a model of one-to-one peer mentoring between traumatic brain injury survivors were included. Two reviewers independently screened all titles and abstracts before screening full texts of shortlisted studies. A third reviewer resolved disagreements. Two reviewers independently extracted data and assessed studies for quality and risk of bias. The search returned 753 records, including one identified through hand searching. 495 records remained after removal of duplicates and 459 were excluded after screening. Full texts were assessed for the remaining 36 studies and six met the inclusion criteria. All were conducted in the United States between 1996 and 2012 and employed a variety of designs including two randomised controlled trials. A total of 288 people with traumatic brain injury participated in the studies. No significant improvements in social activity level or social network size were found, but significant improvements were shown in areas including behavioural control, mood, coping and quality of life. There is limited evidence for the effectiveness of peer mentoring after traumatic brain injury. The available evidence comes from small-scale studies, of variable quality, without detailed information on the content of sessions or the 'active ingredient' of the interventions.

Voluntary peer review as innovative tool for quality improvement in the intensive care unit – a retrospective descriptive cohort study in German intensive care units

PubMed Central

Kumpf, Oliver; Bloos, Frank; Bause, Hanswerner; Brinkmann, Alexander; Deja, Maria; Marx, Gernot; Kaltwasser, Arnold; Dubb, Rolf; Muhl, Elke; Greim, Clemens-A.; Weiler, Norbert; Chop, Ines; Jonitz, Günther; Schaefer, Henning; Felsenstein, Matthias; Liebeskind, Ursula; Leffmann, Carsten; Jungbluth, Annemarie; Waydhas, Christian; Pronovost, Peter; Spies, Claudia; Braun, Jan-Peter

2014-01-01

Introduction: Quality improvement and safety in intensive care are rapidly evolving topics. However, there is no gold standard for assessing quality improvement in intensive care medicine yet. In 2007 a pilot project in German intensive care units (ICUs) started using voluntary peer reviews as an innovative tool for quality assessment and improvement. We describe the method of voluntary peer review and assessed its feasibility by evaluating anonymized peer review reports and analysed the thematic clusters highlighted in these reports. Methods: Retrospective data analysis from 22 anonymous reports of peer reviews. All ICUs – representing over 300 patient beds – had undergone voluntary peer review. Data were retrieved from reports of peers of the review teams and representatives of visited ICUs. Data were analysed with regard to number of topics addressed and results of assessment questionnaires. Reports of strengths, weaknesses, opportunities and threats (SWOT reports) of these ICUs are presented. Results: External assessment of structure, process and outcome indicators revealed high percentages of adherence to predefined quality goals. In the SWOT reports 11 main thematic clusters were identified representative for common ICUs. 58.1% of mentioned topics covered personnel issues, team and communication issues as well as organisation and treatment standards. The most mentioned weaknesses were observed in the issues documentation/reporting, hygiene and ethics. We identified several unique patterns regarding quality in the ICU of which long-term personnel problems und lack of good reporting methods were most interesting Conclusion: Voluntary peer review could be established as a feasible and valuable tool for quality improvement. Peer reports addressed common areas of interest in intensive care medicine in more detail compared to other methods like measurement of quality indicators. PMID:25587245

Voluntary peer review as innovative tool for quality improvement in the intensive care unit--a retrospective descriptive cohort study in German intensive care units.

PubMed

Kumpf, Oliver; Bloos, Frank; Bause, Hanswerner; Brinkmann, Alexander; Deja, Maria; Marx, Gernot; Kaltwasser, Arnold; Dubb, Rolf; Muhl, Elke; Greim, Clemens-A; Weiler, Norbert; Chop, Ines; Jonitz, Günther; Schaefer, Henning; Felsenstein, Matthias; Liebeskind, Ursula; Leffmann, Carsten; Jungbluth, Annemarie; Waydhas, Christian; Pronovost, Peter; Spies, Claudia; Braun, Jan-Peter

2014-01-01

Quality improvement and safety in intensive care are rapidly evolving topics. However, there is no gold standard for assessing quality improvement in intensive care medicine yet. In 2007 a pilot project in German intensive care units (ICUs) started using voluntary peer reviews as an innovative tool for quality assessment and improvement. We describe the method of voluntary peer review and assessed its feasibility by evaluating anonymized peer review reports and analysed the thematic clusters highlighted in these reports. Retrospective data analysis from 22 anonymous reports of peer reviews. All ICUs - representing over 300 patient beds - had undergone voluntary peer review. Data were retrieved from reports of peers of the review teams and representatives of visited ICUs. Data were analysed with regard to number of topics addressed and results of assessment questionnaires. Reports of strengths, weaknesses, opportunities and threats (SWOT reports) of these ICUs are presented. External assessment of structure, process and outcome indicators revealed high percentages of adherence to predefined quality goals. In the SWOT reports 11 main thematic clusters were identified representative for common ICUs. 58.1% of mentioned topics covered personnel issues, team and communication issues as well as organisation and treatment standards. The most mentioned weaknesses were observed in the issues documentation/reporting, hygiene and ethics. We identified several unique patterns regarding quality in the ICU of which long-term personnel problems und lack of good reporting methods were most interesting Conclusion: Voluntary peer review could be established as a feasible and valuable tool for quality improvement. Peer reports addressed common areas of interest in intensive care medicine in more detail compared to other methods like measurement of quality indicators.

Three decades of disasters: a review of disaster-specific literature from 1977-2009.

PubMed

Smith, Erin; Wasiak, Jason; Sen, Ayan; Archer, Frank; Burkle, Frederick M

2009-01-01

The potential for disasters exists in all communities. To mitigate the potential catastrophes that confront humanity in the new millennium, an evidence-based approach to disaster management is required urgently. This study moves toward such an evidence-based approach by identifying peer-reviewed publications following a range of disasters and events over the past three decades. Peer-reviewed, event-specific literature was identified using a comprehensive search of the electronically indexed database, MEDLINE (1956-January 2009). An extended comprehensive search was conducted for one event to compare the event-specific literature indexed in MEDLINE to other electronic databases (EMBASE, CINAHL, AMED, CENTRAL, Psych Info, Maternity and Infant Care, EBM Reviews). Following 25 individual disasters or overwhelming crises, a total of 2,098 peer-reviewed, event-specific publications were published in 789 journals (652 publications following disasters/events caused by natural hazards, 966 following human-made/technological disasters/events, and 480 following conflict/complex humanitarian events).The event with the greatest number of peer-reviewed, event-specific publications was the 11 September 2001 terrorist attacks (686 publications). Prehospital and Disaster Medicine published the greatest number of peer-reviewed, event-specific publications (54), followed by Journal of Traumatic Stress (42), Military Medicine (40), and Psychiatric Services (40). The primary topics of event-specific publications were mental health, medical health, and response. When an extended, comprehensive search was conducted for one event, 75% of all peer-reviewed, event-specific publications were indexed in MEDLINE. A broad range of multi-disciplinary journals publish peer reviewed, event-specific publications. While the majority of peer-reviewed, event-specific literature is indexed in MEDLINE, comprehensive search strategies should include EMBASE to increase yield.

Reflections of a CHAMPUS-APA peer reviewer.

PubMed

Parlour, R R

1986-02-01

Peer review is a major professional response to the problems of health insurance coverage for psychiatric services. Standard insurance programs reimburse only services that are conventional and cost-effective. The system assumes that services are skillfully documented by providers. Experience as a peer reviewer helps clinicians acquire skill in documentation.

Marketing Academics' Perceptions of the Peer Review Process

ERIC Educational Resources Information Center

Bailey, Charles D.; Hair, Joe F.; Hermanson, Dana R.; Crittenden, Victoria L.

2012-01-01

Publication in refereed journals is critical to career success for most marketing faculty members, and the peer review process is the gatekeeper for a refereed journal. The study reported here examines marketing academics' perceptions of this peer review process. Based on responses from 653 marketing academics, we find favorable overall…

The Neuroscience Peer Review Consortium

PubMed Central

Saper, Clifford B; Maunsell, John HR

2009-01-01

As the Neuroscience Peer Review Consortium (NPRC) ends its first year, it is worth looking back to see how the experiment has worked. In order to encourage dissemination of the details outlined in this Editorial, it will also be published in other journals in the Neuroscience Peer Review Consortium. PMID:19284614

42 CFR 24.5 - Peer review.

Code of Federal Regulations, 2014 CFR

2014-10-01

... 42 Public Health 1 2014-10-01 2014-10-01 false Peer review. 24.5 Section 24.5 Public Health PUBLIC HEALTH SERVICE, DEPARTMENT OF HEALTH AND HUMAN SERVICES PERSONNEL SENIOR BIOMEDICAL RESEARCH SERVICE § 24.5 Peer review. An individual may not be considered for appointment into the SBRS unless his/her...

42 CFR 24.5 - Peer review.

Code of Federal Regulations, 2012 CFR

2012-10-01

... 42 Public Health 1 2012-10-01 2012-10-01 false Peer review. 24.5 Section 24.5 Public Health PUBLIC HEALTH SERVICE, DEPARTMENT OF HEALTH AND HUMAN SERVICES PERSONNEL SENIOR BIOMEDICAL RESEARCH SERVICE § 24.5 Peer review. An individual may not be considered for appointment into the SBRS unless his/her...

42 CFR 24.5 - Peer review.

Code of Federal Regulations, 2013 CFR

2013-10-01

... 42 Public Health 1 2013-10-01 2013-10-01 false Peer review. 24.5 Section 24.5 Public Health PUBLIC HEALTH SERVICE, DEPARTMENT OF HEALTH AND HUMAN SERVICES PERSONNEL SENIOR BIOMEDICAL RESEARCH SERVICE § 24.5 Peer review. An individual may not be considered for appointment into the SBRS unless his/her...

42 CFR 24.5 - Peer review.

Code of Federal Regulations, 2011 CFR

2011-10-01

... 42 Public Health 1 2011-10-01 2011-10-01 false Peer review. 24.5 Section 24.5 Public Health PUBLIC HEALTH SERVICE, DEPARTMENT OF HEALTH AND HUMAN SERVICES PERSONNEL SENIOR BIOMEDICAL RESEARCH SERVICE § 24.5 Peer review. An individual may not be considered for appointment into the SBRS unless his/her...

78 FR 63795 - Endangered and Threatened Wildlife and Plants; Determination of Endangered Status for Chromolaena...

Federal Register 2010, 2011, 2012, 2013, 2014

2013-10-24

... responses. The peer reviewers generally concurred with our methods and conclusions, and they provided... corallicola, and Harrisia aboriginum. The peer reviewers generally concurred with our methods and conclusions... discussion, below. (6) Comment: One peer reviewer provided research findings on the seed longevity and...

Peer Review Undergoing Revitalization

ERIC Educational Resources Information Center

Sawchuk, Stephen

2009-01-01

Established in the 142,000-student Montgomery County, Maryland, district in 1999, peer assistance and review (PAR)--or "peer review," as it is occasionally called--is actually an old idea. In 1981, the then-president of the Toledo Federation of Teachers, Dal Lawrence, helped create the first PAR program. Almost 30 years later, only a…

Identifying and Remediating Student Misconceptions in Introductory Biology via Writing-to-Learn Assignments and Peer Review.

PubMed

Halim, Audrey S; Finkenstaedt-Quinn, Solaire A; Olsen, Laura J; Gere, Anne Ruggles; Shultz, Ginger V

2018-06-01

Student misconceptions are an obstacle in science, technology, engineering, and mathematics courses and unless remediated may continue causing difficulties in learning as students advance in their studies. Writing-to-learn assignments (WTL) are characterized by their ability to promote in-depth conceptual learning by allowing students to explore their understanding of a topic. This study sought to determine whether and what types of misconceptions are elicited by WTL assignments and how the process of peer review and revision leads to remediation or propagation of misconceptions. We examined four WTL assignments in an introductory biology course in which students first wrote about content by applying it to a realistic scenario, then participated in a peer-review process before revising their work. Misconceptions were identified in all four assignments, with the greatest number pertaining to protein structure and function. Additionally, in certain contexts, students used scientific terminology incorrectly. Analysis of the drafts and peer-review comments generated six profiles by which misconceptions were addressed through the peer-review process. The prevalent mode of remediation arose through directed peer-review comments followed by correction during revision. It was also observed that additional misconceptions were elicited as students revised their writing in response to general peer-review suggestions.

About ICLUS

EPA Pesticide Factsheets

ICLUS is a project for developing scenarios broadly consistent with global-scale, peer-reviewed storylines of population growth and economic development, which are used by climate change modelers to develop projections of future climate.

Peering into peer-review at GigaScience

PubMed Central

2013-01-01

Fostering and promoting more open and transparent science is one of the goals of GigaScience. One of the ways we have been doing this is by throwing light on the peer-review process and carrying out open peer-review as standard. In this editorial, we provide our rationale for undertaking this policy, give examples of our positive experiences to date, and encourage others to open up the normally opaque publication process. PMID:23587291

Watershed Modeling to Assess the Sensitivity of Streamflow, Nutrient, and Sediment Loads to Potential Climate Change and Urban Development in 20 U.S. Watersheds (External Review Draft)

EPA Science Inventory

EPA has released for independent external peer review and public comment a draft report titled, Watershed Modeling to Assess the Sensitivity of Streamflow, Nutrient, and Sediment Loads to Potential Climate Change and Urban Development in 20 U.S. Watersheds. This is a draft...

Peer-review for selection of oral presentations for conferences: Are we reliable?

PubMed

Deveugele, Myriam; Silverman, Jonathan

2017-11-01

Although peer-review for journal submission, grant-applications and conference submissions has been called 'a counter- stone of science', and even 'the gold standard for evaluating scientific merit', publications on this topic remain scares. Research that has investigated peer-review reveals several issues and criticisms concerning bias, poor quality review, unreliability and inefficiency. The most important weakness of the peer review process is the inconsistency between reviewers leading to inadequate inter-rater reliability. To report the reliability of ratings for a large international conference and to suggest possible solutions to overcome the problem. In 2016 during the International Conference on Communication in Healthcare, organized by EACH: International Association for Communication in Healthcare, a calibration exercise was proposed and feedback was reported back to the participants of the exercise. Most abstracts, as well as most peer-reviewers, receive and give scores around the median. Contrary to the general assumption that there are high and low scorers, in this group only 3 peer-reviewers could be identified with a high mean, while 7 has a low mean score. Only 2 reviewers gave only high ratings (4 and 5). Of the eight abstracts included in this exercise, only one abstract received a high mean score and one a low mean score. Nevertheless, both these abstracts received both low and high scores; all other abstracts received all possible scores. Peer-review of submissions for conferences are, in accordance with the literature, unreliable. New and creative methods will be needed to give the participants of a conference what they really deserve: a more reliable selection of the best abstracts. More raters per abstract improves the inter-rater reliability; training of reviewers could be helpful; providing feedback to reviewers can lead to less inter-rater disagreement; fostering negative peer-review (rejecting the inappropriate submissions) rather than a positive (accepting the best) could be fruitful for selecting abstracts for conferences. Copyright © 2017 Elsevier B.V. All rights reserved.

Data bank has operational impact. Proper peer review can protect hospitals from antitrust and defamation suits.

PubMed

Purtell, D L

1990-11-01

The Health Care Quality Improvement Act of 1986 can help protect medical professionals and healthcare facilities from antitrust and defamation claims and other forms of litigation arising from the peer review process. Some hospitals may need to make major changes in their peer review activity as a result of the act. The healthcare entity, not the physicians involved in peer review, has the burden of complying with the provisions of the act. Failure to comply with the act can lead to loss of immunity from damages, fines, and potential exclusion from the Medicare program. The potential for liability has sparked a need for hospitals to reexamine and possibly reorganize medical staff and update procedures and related governing documents. Healthcare entities may consider changes such as implementing a director of medical affairs function, choosing medical staff for multiple-year terms, and centralizing physician review files. In the 1980s many hospitals created quality assurance and risk management programs. Risk managers need to share data with quality assurance personnel, who must in turn share the information with medical staff involved with credentialing, peer review, and medical affairs management. Legal counsel will need to be familiar with the legalities of the act, as well as the hospital's peer review procedures and operations. General legal counsel should oversee coordination of hospital proceedings and assist in educating staff on the legalities of peer review.

The Validity of Online Patient Ratings of Physicians: Analysis of Physician Peer Reviews and Patient Ratings.

PubMed

McGrath, Robert J; Priestley, Jennifer Lewis; Zhou, Yiyun; Culligan, Patrick J

2018-04-09

Information from ratings sites are increasingly informing patient decisions related to health care and the selection of physicians. The current study sought to determine the validity of online patient ratings of physicians through comparison with physician peer review. We extracted 223,715 reviews of 41,104 physicians from 10 of the largest cities in the United States, including 1142 physicians listed as "America's Top Doctors" through physician peer review. Differences in mean online patient ratings were tested for physicians who were listed and those who were not. Overall, no differences were found between the online patient ratings based upon physician peer review status. However, statistical differences were found for four specialties (family medicine, allergists, internal medicine, and pediatrics), with online patient ratings significantly higher for those physicians listed as a peer-reviewed "Top Doctor" versus those who were not. The results of this large-scale study indicate that while online patient ratings are consistent with physician peer review for four nonsurgical, primarily in-office specializations, patient ratings were not consistent with physician peer review for specializations like anesthesiology. This result indicates that the validity of patient ratings varies by medical specialization. ©Robert J McGrath, Jennifer Lewis Priestley, Yiyun Zhou, Patrick J Culligan. Originally published in the Interactive Journal of Medical Research (http://www.i-jmr.org/), 09.04.2018.

Clinical peer review program self-evaluation for US hospitals.

PubMed

Edwards, Marc T

2010-01-01

Prior research has shown wide variation in clinical peer review program structure, process, governance, and perceived effectiveness. This study sought to validate the utility of a Peer Review Program Self-Evaluation Tool as a potential guide to physician and hospital leaders seeking greater program value. Data from 330 hospitals show that the total score from the self-evaluation tool is strongly associated with perceived quality impact. Organizational culture also plays a significant role. When controlling for these factors, there was no evidence of benefit from a multispecialty review process. Physicians do not generally use reliable methods to measure clinical performance. A high rate of change since 2007 has not produced much improvement. The Peer Review Program Self-Evaluation Tool reliably differentiates hospitals along a continuum of perceived program performance. The full potential of peer review as a process to improve the quality and safety of care has yet to be realized.

Variability of Reviewers' Comments in the Peer Review Process for Orthopaedic Research.

PubMed

Iantorno, Stephanie E; Andras, Lindsay M; Skaggs, David L

2016-07-01

Retrospective analysis of peer review comments. To assess the likelihood that comments provided by peer reviewers of one orthopaedic journal would be similar to comments of reviewers from the same journal and a second journal. The consistency of the peer review process in orthopedic research has not been objectively examined. Nine separate clinical papers related to spinal deformity were submitted for publication in major peer-reviewed journals and initially rejected. The exact same manuscripts were then submitted to different journals. All papers were returned with comments from two to three reviewers from each journal. Reviews were divided into distinct conceptual criticisms that were regarded as separate comments. Comments were compared between reviewers of the same journal and to comments from reviewers of the second journal. When comparing comments from reviewers of the same journal, an average of 11% of comments were repeated (range 0% [0/12] to 23% [3/13]). On average, 20% of comments from the first journal were repeated by a reviewer at the second journal (range 10% [1/10] to 33% [6/18]). If a comment was made by two or more reviewers from the first journal, it had a higher likelihood (43% [6/14]) of being repeated by a reviewer from the second journal. When an identical manuscript is submitted to a second journal after being rejected, 80% of peer review comments from the first journal are not repeated by reviewers from the second journal. One may question if addressing every peer review comment in a rejected manuscript prior to resubmission is an efficient use of resources. Comments that appear twice or more in the first journal review are more likely to reappear and may warrant special attention from the researcher. Level IV. Copyright © 2016 Scoliosis Research Society. Published by Elsevier Inc. All rights reserved.

The Relationship of Previous Training and Experience of Journal Peer Reviewers to Subsequent Review Quality

PubMed Central

Callaham, Michael L; Tercier, John

2007-01-01

Background Peer review is considered crucial to the selection and publication of quality science, but very little is known about the previous experiences and training that might identify high-quality peer reviewers. The reviewer selection processes of most journals, and thus the qualifications of their reviewers, are ill defined. More objective selection of peer reviewers might improve the journal peer review process and thus the quality of published science. Methods and Findings 306 experienced reviewers (71% of all those associated with a specialty journal) completed a survey of past training and experiences postulated to improve peer review skills. Reviewers performed 2,856 reviews of 1,484 separate manuscripts during a four-year study period, all prospectively rated on a standardized quality scale by editors. Multivariable analysis revealed that most variables, including academic rank, formal training in critical appraisal or statistics, or status as principal investigator of a grant, failed to predict performance of higher-quality reviews. The only significant predictors of quality were working in a university-operated hospital versus other teaching environment and relative youth (under ten years of experience after finishing training). Being on an editorial board and doing formal grant (study section) review were each predictors for only one of our two comparisons. However, the predictive power of all variables was weak. Conclusions Our study confirms that there are no easily identifiable types of formal training or experience that predict reviewer performance. Skill in scientific peer review may be as ill defined and hard to impart as is “common sense.” Without a better understanding of those skills, it seems unlikely journals and editors will be successful in systematically improving their selection of reviewers. This inability to predict performance makes it imperative that all but the smallest journals implement routine review ratings systems to routinely monitor the quality of their reviews (and thus the quality of the science they publish). PMID:17411314

Directly Improving the Quality of Radiation Treatment Through Peer Review: A Cross-sectional Analysis of Cancer Centers Across a Provincial Cancer Program.

PubMed

Rouette, Julie; Gutierrez, Eric; O'Donnell, Jennifer; Reddeman, Lindsay; Hart, Margaret; Foxcroft, Sophie; Mitera, Gunita; Warde, Padraig; Brundage, Michael D

2017-07-01

To describe the outcomes of peer review across all 14 cancer centers in Ontario. We identified all peer-reviewed, curative treatment plans delivered in Ontario within a 3-month study period from 2013 to 2014 using a provincial cancer treatment database and collected additional data on the peer-review outcomes. Considerable variation was found in the proportion of peer-reviewed plans across the centers (average 70.2%, range 40.8%-99.2%). During the study period, 5561 curative plans underwent peer review. Of those, 184 plans (3.3%) had changes recommended. Of the 184 plans, the changes were major (defined as requiring repeat planning or having a major effect on planning or clinical outcomes, or both) in 40.2% and minor in 47.8%. For the remaining 12.0%, data were missing. The proportions of recommended changes varied among disease sites (0.0%-7.0%). The disease sites with the most recommended changes to treatment plans after peer review and with the greatest potential for benefit were the esophagus (7.0%), uterus (6.7%), upper limb (6.3%), cervix and lower limb (both 6.0%), head and neck and bilateral lung (both 5.9%), right supraclavicular lymph nodes (5.7%), rectum (5.3%), and spine (5.0%). Although the heart is an organ at risk in left-sided breast treatment plans, the proportions of recommended changes did not significantly differ between the left breast treatment plans (3.0%, 95% confidence interval 2.0%-4.5%) and right breast treatment plans (2.4%, 95% confidence interval 1.5%-3.8%). The recommended changes were more frequently made when peer review occurred before radiation therapy (3.8%) than during treatment (1.4%-2.8%; P=.0048). The proportion of plans with recommended changes was not significantly associated with patient volume (P=.23), peer-review performance (P=.36), or center academic status (P=.75). Peer review of treatment plans directly affects the quality of care by identifying important clinical and planning changes. Provincial strategies are underway to optimize its conduct in radiation oncology. Copyright © 2016. Published by Elsevier Inc.

Alternatives to Peer Review: Novel Approaches for Research Evaluation

PubMed Central

Birukou, Aliaksandr; Wakeling, Joseph Rushton; Bartolini, Claudio; Casati, Fabio; Marchese, Maurizio; Mirylenka, Katsiaryna; Osman, Nardine; Ragone, Azzurra; Sierra, Carles; Wassef, Aalam

2011-01-01

In this paper we review several novel approaches for research evaluation. We start with a brief overview of the peer review, its controversies, and metrics for assessing efficiency and overall quality of the peer review. We then discuss five approaches, including reputation-based ones, that come out of the research carried out by the LiquidPub project and research groups collaborated with LiquidPub. Those approaches are alternative or complementary to traditional peer review. We discuss pros and cons of the proposed approaches and conclude with a vision for the future of the research evaluation, arguing that no single system can suit all stakeholders in various communities. PMID:22174702

The Self-Help Group Model: A Review

ERIC Educational Resources Information Center

Jaques, Marceline E.; Patterson, Kathleen M.

1974-01-01

Self-help mutual aid groups are organized by peers who share a common problem. Through group identification, mutual support, and modeling, behavior is directed toward learning a new coping life style. The self-help group model is considered here as a viable and necessary part of a total rehabilitation service system. (Author)

A Model for Scholarship in Nursing: The Case of a Private Liberal Arts College.

ERIC Educational Resources Information Center

Nelson, Margot L.

2001-01-01

Presents a scholarship model as an invitation to scholarship development in nursing. The model is useful for faculty self-evaluation and peer review, for orienting students to their own scholarly evolution, and to define criteria for graduate student projects. (Contains 21 references.) (Author/JOW)

IRIS Toxicological Review of Libby Amphibole Asbestos ...

EPA Pesticide Factsheets

On August 25, 2011, the draft Toxicological Review of Libby Amphibole Asbestos and the charge to external peer reviewers were released for external peer review and public comment. The Toxicological Review and charge were reviewed internally by EPA and by other federal agencies and White House Offices before public release. In the new IRIS process (May 2009), introduced by the EPA Administrator, all written comments on IRIS assessments submitted by other federal agencies and White House Offices will be made publicly available. Accordingly, interagency comments and the interagency science consultation draft of the IRIS Toxicological Review of Libby Amphibole Asbestos and the charge to external peer reviewers are posted on this site. The project supports OSWER and Region 8 site clean-up and related risk management initiatives at this Superfund site. As with all IRIS assessments, the draft document will undergo agency review, OMB/interagency review and independent external peer review before being included on the IRIS data base.

Successful peer review of courses: a case study.

PubMed

Horowitz, S; Van Eyck, S; Albanese, M

1998-03-01

The authors describe their school's system of peer review for courses, established in 1988 to facilitate faculty evaluation and continual course and curriculum improvement. (The system has been temporarily suspended while the school's new curriculum becomes established.) They explain how the system was created and then report how faculty reviews of courses over the five-year operation of the system compared with students' reviews of the same courses. The faculty and students' ratings were in agreement 75% of the time. When not in agreement, the students' ratings tended to upgrade courses that were not very demanding, had easy grading, and emphasized clinical details, often at the expense of basic concepts and the big picture. The authors then document how the work of the peer review system favorably influenced the transformation of the school's curriculum. They also provide guidelines for the creation and operation of a course review process that uses faculty peers. The authors maintain that the peer review system worked because it was run by a committee of experienced and respected teachers who had been selected by their peers, the other faculty. Additional reasons for its success were that the school's faculty supported and respected the committee and its work, that course directors helped evaluate their courses, and that peer reviewers took their work seriously despite having no remuneration, and the clearly positive impact of the review system on faculty interaction, faculty-student interaction, and the reform of the curriculum.

Enhancing the role of case-oriented peer review to improve quality and safety in radiation oncology: Executive summary

PubMed Central

Marks, Lawrence B.; Adams, Robert D.; Pawlicki, Todd; Blumberg, Albert L.; Hoopes, David; Brundage, Michael D.; Fraass, Benedick A.

2013-01-01

This report is part of a series of white papers commissioned for the American Society for Radiation Oncology (ASTRO) Board of Directors as part of ASTRO's Target Safely Campaign, focusing on the role of peer review as an important component of a broad safety/quality assurance (QA) program. Peer review is one of the most effective means for assuring the quality of qualitative, and potentially controversial, patient-specific decisions in radiation oncology. This report summarizes many of the areas throughout radiation therapy that may benefit from the application of peer review. Each radiation oncology facility should evaluate the issues raised and develop improved ways to apply the concept of peer review to its individual process and workflow. This might consist of a daily multidisciplinary (eg, physicians, dosimetrists, physicists, therapists) meeting to review patients being considered for, or undergoing planning for, radiation therapy (eg, intention to treat and target delineation), as well as meetings to review patients already under treatment (eg, adequacy of image guidance). This report is intended to clarify and broaden the understanding of radiation oncology professionals regarding the meaning, roles, benefits, and targets for peer review as a routine quality assurance tool. It is hoped that this work will be a catalyst for further investigation, development, and study of the efficacy of peer review techniques and how these efforts can help improve the safety and quality of our treatments. PMID:24175002

Peer Victimization among Schoolchildren: Correlations, Causes, Consequences, and Considerations in Assessment and Intervention

ERIC Educational Resources Information Center

Card, Noel A.; Hodges, Ernest V. E.

2008-01-01

Peer victimization among schoolchildren is a common problem that predicts serious maladjustment. In this article, the authors define peer victimization, provide a brief overview of the history of research on the topic, and review prevalence rates, common measurement approaches, and the correlates of peer victimization. This review leads to…

Making Teaching Community Property: A Menu for Peer Collaboration and Peer Review. AAHE Teaching Initiative.

ERIC Educational Resources Information Center

Hutchings, Pat

A collection of program descriptions and case studies in college faculty peer collaboration and peer review includes: "Setting a Scholarly Tone: Teaching Circles in the History Department at Kent State University"; "Fostering Collective Responsibility for Student Learning: Teaching Seminars in the University of North Carolina at Charlotte…

Research management peer exchange hosted by the Oregon Department of Transportation Research Group, August 20-24, 2001. Summary report.

DOT National Transportation Integrated Search

2001-05-01

The team began this peer exchange with a review of the first Oregon Peer Exchange conducted in may, 1998. The review included a summary of recommendations made and the changes made as a result of the 1998 Peer Exchange Report. : The primary focus of ...

Peering into peer review: Galileo, ESP, Dr Scott Reuben, and advancing our professional evolution.

PubMed

Biddle, Chuck

2011-10-01

The fundamental purpose of peer review is quality control that facilitates the introduction of information into our discipline; information that is essential to the care of patients who require anesthesia services. While the AANA Journal relies heavily on this process to maintain the overall quality of our scholarly literature, it may fail that objective under certain conditions. This editorial serves to inform readers of the nature and goals of the peer review process.

2017 Building Technologies Office Peer Review Report

DOE Office of Scientific and Technical Information (OSTI.GOV)

None, None

The 2017 Building Technologies Office Peer Review Report summarizes the feedback submitted by reviewers for the 109 Building Technologies Office (BTO) projects presented at the 2017 BTO Peer Review. The report presents an overview of the goals and activities under each technology program area, a summary of project scores for each program, and a brief analysis of general evaluation trends within each program area or its constituent subprograms.

Peer Review of Submissions to the Annual American Evaluation Association Conference by the Graduate Student & New Evaluators Topical Interest Group

ERIC Educational Resources Information Center

Schroter, Daniela C.; Coryn, Chris L. S.; Montrosse, Bianca E.

2008-01-01

Peer review is an umbrella term that refers to a class of selection and oversight practices, including the familiar mechanisms of the review of proposals submitted for funding, of manuscripts for scholarly publications, and of personnel qualifications and portfolios for selection and promotion. Peer review has long been a cornerstone of modern…

What do we know about grant peer review in the health sciences?

PubMed

Guthrie, Susan; Ghiga, Ioana; Wooding, Steven

2017-01-01

 Peer review decisions award >95% of academic medical research funding, so it is crucial to understand how well they work and if they could be improved.  This paper summarises evidence from 105 relevant papers identified through a literature search on the effectiveness and burden of peer review for grant funding.  There is a remarkable paucity of evidence about the overall efficiency of peer review for funding allocation, given its centrality to the modern system of science. From the available evidence, we can identify some conclusions around the effectiveness and burden of peer review. The strongest evidence around effectiveness indicates a bias against innovative research. There is also fairly clear evidence that peer review is, at best, a weak predictor of future research performance, and that ratings vary considerably between reviewers. There is some evidence of age bias and cronyism. Good evidence shows that the burden of peer review is high and that around 75% of it falls on applicants. By contrast, many of the efforts to reduce burden are focused on funders and reviewers/panel members.  We suggest funders should acknowledge, assess and analyse the uncertainty around peer review, even using reviewers' uncertainty as an input to funding decisions. Funders could consider a lottery element in some parts of their funding allocation process, to reduce both burden and bias, and allow better evaluation of decision processes. Alternatively, the distribution of scores from different reviewers could be better utilised as a possible way to identify novel, innovative research. Above all, there is a need for open, transparent experimentation and evaluation of different ways to fund research. This also requires more openness across the wider scientific community to support such investigations, acknowledging the lack of evidence about the primacy of the current system and the impossibility of achieving perfection.

Peer Review: Structured, Informal, Confidential, Helpful!

ERIC Educational Resources Information Center

Cassidy, Alice; Lee, Jack

2011-01-01

This paper describes an introductory workshop, Preparing to be a Peer Reviewer, presented at the University of British Columbia (UBC) to give hands-on practice to faculty members and others in order to provide formative peer review upon request. This workshop, which was designed at the request of a faculty member, is complemented by an Advanced…

Preparing English Learners for Effective Peer Review in the Writers' Workshop

ERIC Educational Resources Information Center

Kim, Soo Hyon

2015-01-01

English Language Learners (ELLs) often face challenges when participating in peer review activities in writers' workshops. This article identifies some of the potential difficulties that ELL writers may experience, and provides teachers with strategies to address these problems. The author describes a simple three-step peer review training model…

Using Peer Review to Improve Student Writing in Business Courses

ERIC Educational Resources Information Center

Rieber, Lloyd J.

2006-01-01

Student peer review has proven an effective technique for improving student writing in both English and business communication classes, yet the technique is not widely used in business courses other than business communication. In this article, the author discusses using student peer review in business classes to improve students' final written…

Peer Review of Teaching: Best Practices for a Non-Programmatic Approach

ERIC Educational Resources Information Center

Alabi, Jaena; Weare, William H., Jr.

2014-01-01

Many academic librarians who provide library instruction have never received formal training in educational theory and methods. To bridge this gap and improve the teaching skills of instruction librarians, some academic libraries have established peer review of teaching programs. Despite the recognized benefits of peer review, it may not be…

The Great Fossil Fiasco: Teaching about Peer Review.

ERIC Educational Resources Information Center

Gift, Nancy; Krasny, Marianne

2003-01-01

Describes a lesson that engages middle school students in learning about peer review. Uses the article "Archaeoraptor Fossil Trail," which was published in the November, 1999 issue of "National Geographic" as an example of a real life story of how peer review forces scientists to critically re-examine a fossil discovery. (SOE)

77 FR 58802 - Notice of Intent To Seek OMB Approval To Collect Information: Forms Pertaining to the Peer Review...

Federal Register 2010, 2011, 2012, 2013, 2014

2012-09-24

... Collect Information: Forms Pertaining to the Peer Review of ARS Research Projects AGENCY: Agricultural Research Service (ARS), USDA. ACTION: Notice and request for comments. SUMMARY: The proposed information... allow the ARS to efficiently manage data associated with the peer review of agricultural research. All...

Original Research and Peer Review Using Web-Based Collaborative Tools by College Students

ERIC Educational Resources Information Center

Cakir, Mustafa; Carlsen, William S.

2007-01-01

The Environmental Inquiry program supports inquiry based, student-centered science teaching on selected topics in the environmental sciences. Many teachers are unfamiliar with both the underlying science of toxicology, and the process and importance of peer review in scientific method. The protocol and peer review process was tested with college…

DOE Hydrogen Program: 2010 Annual Merit Review and Peer Evaluation Report

DOE Office of Scientific and Technical Information (OSTI.GOV)

Not Available

This document summarizes the comments provided by peer reviewers on hydrogen and fuel cell projects presented at the FY 2010 U.S. Department of Energy (DOE) Hydrogen Program and Vehicle Technologies Program Annual Merit Review and Peer Evaluation Meeting (AMR), held June 7-11, 2010 in Washington, D.C.

Peer Review: The CHAMPUS Program.

ERIC Educational Resources Information Center

Stricker, George

This paper examines the use of the peer review system in evaluating out-patient clinical services for a third-party payer seeking justification for payment of services. Peer review is defined as a process by which one professional, in an official capacity, makes a judgment about a co-professional in a matter involving professional functioning. The…

Clarifying the role of the mental health peer specialist in Massachusetts, USA: insights from peer specialists, supervisors and clients.

PubMed

Cabral, Linda; Strother, Heather; Muhr, Kathy; Sefton, Laura; Savageau, Judith

2014-01-01

Mental health peer specialists develop peer-to-peer relationships of trust with clients to improve their health and well-being, functioning in ways similar to community health workers. Although the number of peer specialists in use has been increasing, their role in care teams is less defined than that of the community health worker. This qualitative study explored how the peer specialist role is defined across different stakeholder groups, the expectations for this role and how the peer specialist is utilised and integrated across different types of mental health services. Data were collected through interviews and focus groups conducted in Massachusetts with peer specialists (N = 44), their supervisors (N = 14) and clients (N = 10) between September 2009 and January 2011. A consensus coding approach was used and all data outputs were reviewed by the entire team to identify themes. Peer specialists reported that their most important role is to develop relationships with clients and that having lived mental health experience is a key element in creating that bond. They also indicated that educating staff about the recovery model and peer role is another important function. However, they often felt a lack of clarity about their role within their organisation and care team. Supervisors valued the unique experience that peer specialists bring to an organisation. However, without a defined set of expectations for this role, they struggled with training, guiding and evaluating their peer specialist staff. Clients reported that the shared lived experience is important for the relationship and that working with a peer specialist has improved their mental health. With increasing support for person-centred integrated healthcare delivery models, the demand for mental health peer specialist services will probably increase. Therefore, clearer role definition, as well as workforce development focused on team orientation, is necessary for peer specialists to be fully integrated and supported in care teams. © 2013 John Wiley & Sons Ltd.

Systematic review of peer education intervention programmes among individuals with type 2 diabetes.

PubMed

Gatlin, Tricia K; Serafica, Reimund; Johnson, Michael

2017-12-01

To systematically review published randomised controlled trials of peer education interventions among adults with type 2 diabetes. Systematic reviews have shown mixed results for peer support interventions to improve diabetes self-management. Given the effectiveness of diabetes education by healthcare professionals, peer education interventions may be a useful alternative approach. This review addressed that gap. Systematic review. A systematic search of published randomised controlled trials between 2006-2016 was conducted using the keywords diabetes, type 2 diabetes, randomised controlled trials, self-management, peer education and peer support. The methodological quality of each study was assessed using the Jadad scale. Seven studies were included in the final review, and the Jadad scores ranged from 8-10 of a possible 13 points. There was no consistent design, setting, or outcome measurement among the studies. There were two types of peer education interventions compared to traditional diabetes education: face-to-face or a combination of face-to-face and telephone/texting. The most common clinical outcome measure was HbA1c. Two of six studies showed statistically significant improvement in HbA1c between intervention and control groups. An increase in diabetes knowledge was also statistically significant in two of five studies. Peer education could be successful in improving clinical outcomes. No evidence was found indicating that healthcare provider education was superior in regard to clinical knowledge or behavioural or psychological outcome measures than peer education. HbA1c was statistically significantly lower in some peer education groups compared to control groups. There is evidence that peer education can be useful in achieving positive clinical outcomes such as decreasing HbA1c levels and increasing diabetes knowledge. A certified diabetes educator or a trained healthcare professional should not be overlooked though when using peer educators. © 2017 John Wiley & Sons Ltd.

Peer review of human studies run amok: a break in the fiduciary relation between scientists and the public.

PubMed

Feldstein Ewing, Sarah W; Saitz, Richard

2015-02-01

Peer review aims to ensure the quality and credibility of research reporting. Conducted by volunteer scientists who receive no guidance or direction, peer review widely varies from fast and facilitative, to unclear and obstructive. Poor quality is an issue because most science research is publicly funded, whereby scientists must make an effort to quickly disseminate their findings back to the public. An unfortunately not uncommon barrier in this process is ineffective peer review. Most scientists agree that when done well, editors and reviewers drive and maintain the high standards of science. At the same time, ineffective peer review can cause great delay with no introduced improvement in final product. These delays and requests interfere with the path of communication between scientist and public, at a great cost to editors, reviewers, authors and those who stand to benefit from application of the results of the studies. We offer a series of concrete recommendations to improve this process.

IRIS Toxicological Review of Inorganic Arsenic (Cancer) ...

EPA Pesticide Factsheets

On February 19, 2010, the draft IRIS Toxicological Review of Inorganic Arsenic (Cancer) external review draft document and the charge to external peer reviewers were released for public review and comment. The draft document and the charge to external peer reviewers were reviewed internally by EPA and by other federal agencies and White House Offices before public release. In the new IRIS process, introduced by the EPA Administrator, all written comments on IRIS assessments submitted by other federal agencies and White House Offices will be made publicly available. Accordingly, interagency comments and the interagency science consultation draft of the Toxicological Review of Inorganic Arsenic and the charge to external peer reviewers are posted on this site. This draft IRIS health assessment addresses only cancer human health effects that may result from chronic exposure to this chemical. An assessment of noncancer health effects of inorganic arsenic will be released for external peer review and public comment at a later date.

Impact of peer review on reports of randomised trials published in open peer review journals: retrospective before and after study

PubMed Central

Collins, Gary S; Boutron, Isabelle; Yu, Ly-Mee; Cook, Jonathan; Shanyinde, Milensu; Wharton, Rose; Shamseer, Larissa; Altman, Douglas G

2014-01-01

Objective To investigate the effectiveness of open peer review as a mechanism to improve the reporting of randomised trials published in biomedical journals. Design Retrospective before and after study. Setting BioMed Central series medical journals. Sample 93 primary reports of randomised trials published in BMC-series medical journals in 2012. Main outcome measures Changes to the reporting of methodological aspects of randomised trials in manuscripts after peer review, based on the CONSORT checklist, corresponding peer reviewer reports, the type of changes requested, and the extent to which authors adhered to these requests. Results Of the 93 trial reports, 38% (n=35) did not describe the method of random sequence generation, 54% (n=50) concealment of allocation sequence, 50% (n=46) whether the study was blinded, 34% (n=32) the sample size calculation, 35% (n=33) specification of primary and secondary outcomes, 55% (n=51) results for the primary outcome, and 90% (n=84) details of the trial protocol. The number of changes between manuscript versions was relatively small; most involved adding new information or altering existing information. Most changes requested by peer reviewers had a positive impact on the reporting of the final manuscript—for example, adding or clarifying randomisation and blinding (n=27), sample size (n=15), primary and secondary outcomes (n=16), results for primary or secondary outcomes (n=14), and toning down conclusions to reflect the results (n=27). Some changes requested by peer reviewers, however, had a negative impact, such as adding additional unplanned analyses (n=15). Conclusion Peer reviewers fail to detect important deficiencies in reporting of the methods and results of randomised trials. The number of these changes requested by peer reviewers was relatively small. Although most had a positive impact, some were inappropriate and could have a negative impact on reporting in the final publication. PMID:24986891

Experiences of undergraduate nursing students in peer assisted learning in clinical practice: a qualitative systematic review.

PubMed

Carey, Matthew C; Kent, Bridie; Latour, Jos M

2018-05-01

The objective of this qualitative systematic review was to identify and synthesize the best available evidence on experiences of peer assisted learning (PAL) among student nurses in clinical practice so as to understand the value of PAL for this population. Peer-assisted learning considers the benefits of peers working in collaboration and supporting each other in professional roles. This approach to facilitate learning is effective within universities, but there is limited exploration within the clinical practice environment. Within the UK, 50% of student nurses' learning is undertaken within clinical practice, providing a large portion of student allocation within these areas, but is unexplored in relation to PAL. Therefore, existing evidence examining PAL in clinical practice needs further exploration for a better understanding of its value to student nurses' learning. The systematic review considered studies that included male and female nursing students aged 18-50 years that explored undergraduate nursing students' experiences of PAL within the clinical practice environment. Studies that utilized designs such as phenomenology, grounded theory, ethnography, action research and feminist research were considered. Other text such as opinion papers and reports were to be considered if no qualitative studies could be located. The review excluded quantitative studies, as well as those addressing PAL outside the nursing profession and students within the nursing profession but not including undergraduate student nurses. This review considered studies that included aspects related to experiences of PAL in the clinical practice setting, as seen by undergraduate nursing students and the researcher. A three-step search strategy was undertaken to find both published and unpublished studies in English from 2003 to 2017 in various databases, and included searching of reference lists within articles selected for appraisal. Each of the included studies were assessed for methodological quality independently by two reviewers, using the Joanna Briggs Institute Critical Appraisal Form for Interpretive and Critical Research. Qualitative data was extracted using the standardized JBI qualitative data extraction tool. Qualitative research findings were synthesized using JBI methodology. From the eight included studies, 37 findings were extracted. These findings were further aggregated into seven categories, and then into three synthesized findings. These three synthesized findings are: 1) Challenges of clinical practice are mitigated by peer support; 2) Peers are role models for enhancing clinical knowledge; and 3) Support and feedback develop competence and confidence, and reduce stress and anxiety. Peer-assisted learning exists in clinical practice in both formal and informal circumstances. Friendship and community are often expressed as occurring when peers work together. Support and feedback help students develop in their clinical role and enhance clinical knowledge. Outcomes include enhancing the competency and confidence of peers, and reducing stress and anxiety. Challenges of clinical practice are mitigated through PAL.

Mitigation of Disagreement in Peer Review among L2 Learners and Native Speakers in a College Writing Class (Mitigación del Impacto de las Opiniones de Desacuerdo en el Proceso de Revisión por Pares entre Estudiantes de una Segunda Lengua y Hablantes Nativos en una Clase de Escritura a Nivel Universitario)

ERIC Educational Resources Information Center

Christoffersen, Katherine O'Donnell

2015-01-01

Peer review is now a commonplace practice in process-oriented writing instruction. A crucial aspect of peer review is assessing another classmate's work, which encompasses the act of disagreement. Given its prevalence in the classroom, it is necessary to analyze how L2 learners mitigate disagreement in the context of peer review with other L2…

Doing peer review and receiving feedback: impact on scientific literacy and writing skills.

PubMed

Geithner, Christina A; Pollastro, Alexandria N

2016-03-01

Doing peer review has been effectively implemented to help students develop critical reading and writing skills; however, its application in Human Physiology programs is limited. The purpose of the present study was to determine the impact of peer review on Human Physiology majors' perceptions of their scientific literacy and writing skills. Students enrolled in the Scientific Writing course completed multiple writing assignments, including three revisions after receiving peer and instructor feedback. Students self-assessed their knowledge, skills, and attitudes related to science and writing in pre- and postcourse surveys (n = 26 with complete data). Seven survey items related to scientific literacy and writing skills impacted by peer review were selected for analysis. Scores on these survey items were summed to form a composite self-rating score. Responses to two questions regarding the most useful learning activities were submitted to frequency analysis. Mean postcourse scores for individual survey items and composite self-rating scores were significantly higher than precourse means (P < 0.05). Peer review was the most frequently noted among 21 learning activities for increasing scientific literacy and in the top 5 for improving writing skills. In conclusion, peer review is an effective teaching/learning approach for improving undergraduate Human Physiology majors' knowledge, skills, and attitudes regarding science and scientific writing. Copyright © 2016 The American Physiological Society.

Peer Acceptance and Friendship in Early Childhood: The Conceptual Distinctions between Them

ERIC Educational Resources Information Center

Beazidou, Eleftheria; Botsoglou, Kafenia

2016-01-01

This paper reviews previous literature about peer acceptance and friendship, two of the most critical aspects of peer relations that have received most of research attention during the past years. In this review, we will focus on the processes explaining the way children use the ability to socialise with peers; explore the hypothesis that certain…

Peer Response to L2 Student Writing: Patterns and Expectations

ERIC Educational Resources Information Center

Abdalla Salih, Abdel Rahman

2013-01-01

This paper reports the corrective feedback patterns in L2 writing and the student writers' preferences for peer feedback. The study examines the actual focus of peer review and the types of corrective feedback provided in L2 composing process. Sixteen L2 matriculation students at a Malaysian university took part in five peer review sessions,…

Iterative Design and Classroom Evaluation of Automated Formative Feedback for Improving Peer Feedback Localization

ERIC Educational Resources Information Center

Nguyen, Huy; Xiong, Wenting; Litman, Diane

2017-01-01

A peer-review system that automatically evaluates and provides formative feedback on free-text feedback comments of students was iteratively designed and evaluated in college and high-school classrooms. Classroom assignments required students to write paper drafts and submit them to a peer-review system. When student peers later submitted feedback…

Peer Review from the Students' Perspective: Invaluable or Invalid?

ERIC Educational Resources Information Center

Brammer, Charlotte; Rees, Mary

2007-01-01

Only a few instances of empirical research examine what the students themselves think of their participation in peer review. Perhaps because peer response is practically instinctive to those who teach writing, few have felt the need to study the student perspective. Instead, studies have focused on the quality of peer comments, their effect on the…

Peer Mentoring and Peer Tutoring among K-12 Students: A Literature Review

ERIC Educational Resources Information Center

Goodrich, Andrew

2018-01-01

The purpose of this literature review is to examine research on peer mentoring among K-12 students to assist practitioners with how to incorporate these instructional techniques into their own music programs. Primary themes across the music education literature of peer mentoring include the role of music teachers, the role of students as they…

Unmanned Maritime Systems Incremental Acquisition Approach

DTIC Science & Technology

2016-12-01

We find that current UMS acquisitions are utilizing previous acquisition reforms, but could benefit from additional contractor peer competition and...peer review. Additional cost and schedule benefits could result from contractor competition during build processes in each incremental process. We...acquisitions are utilizing previous acquisition reforms, but could benefit from additional contractor peer competition and peer review. Additional

What do we know about grant peer review in the health sciences?

PubMed Central

Guthrie, Susan; Ghiga, Ioana; Wooding, Steven

2018-01-01

Background: Peer review decisions award an estimated >95% of academic medical research funding, so it is crucial to understand how well they work and if they could be improved. Methods: This paper summarises evidence from 105 papers identified through a literature search on the effectiveness and burden of peer review for grant funding. Results: There is a remarkable paucity of evidence about the efficiency of peer review for funding allocation, given its centrality to the modern system of science. From the available evidence, we can identify some conclusions around the effectiveness and burden of peer review. The strongest evidence around effectiveness indicates a bias against innovative research. There is also fairly clear evidence that peer review is, at best, a weak predictor of future research performance, and that ratings vary considerably between reviewers. There is some evidence of age bias and cronyism. Good evidence shows that the burden of peer review is high and that around 75% of it falls on applicants. By contrast, many of the efforts to reduce burden are focused on funders and reviewers/panel members. Conclusions: We suggest funders should acknowledge, assess and analyse the uncertainty around peer review, even using reviewers’ uncertainty as an input to funding decisions. Funders could consider a lottery element in some parts of their funding allocation process, to reduce both burden and bias, and allow better evaluation of decision processes. Alternatively, the distribution of scores from different reviewers could be better utilised as a possible way to identify novel, innovative research. Above all, there is a need for open, transparent experimentation and evaluation of different ways to fund research. This also requires more openness across the wider scientific community to support such investigations, acknowledging the lack of evidence about the primacy of the current system and the impossibility of achieving perfection. PMID:29707193

Using the Soil and Water Assessment Tool (SWAT) to model ecosystem services: A systematic review

NASA Astrophysics Data System (ADS)

Francesconi, Wendy; Srinivasan, Raghavan; Pérez-Miñana, Elena; Willcock, Simon P.; Quintero, Marcela

2016-04-01

SWAT, a watershed modeling tool has been proposed to help quantify ecosystem services. The concept of ecosystem services incorporates the collective benefits natural systems provide primarily to human beings. It is becoming increasingly important to track the impact that human activities have on the environment in order to determine its resilience and sustainability. The objectives of this paper are to provide an overview of efforts using SWAT to quantify ecosystem services, to determine the model's capability examining various types of services, and to describe the approach used by various researchers. A literature review was conducted to identify studies in which SWAT was explicitly used for quantifying ecosystem services in terms of provisioning, regulating, supporting, and cultural aspects. A total of 44 peer reviewed publications were identified. Most of these used SWAT to quantify provisioning services (34%), regulating services (27%), or a combination of both (25%). While studies using SWAT for evaluating ecosystem services are limited (approximately 1% of SWAT's peered review publications), and usage (vs. potential) of services by beneficiaries is a current model limitation, the available literature sets the stage for the continuous development and potential of SWAT as a methodological framework for quantifying ecosystem services to assist in decision-making.

An integrative review of in-class activities that enable active learning in college science classroom settings

NASA Astrophysics Data System (ADS)

Arthurs, Leilani A.; Kreager, Bailey Zo

2017-10-01

Engaging students in active learning is linked to positive learning outcomes. This study aims to synthesise the peer-reviewed literature about 'active learning' in college science classroom settings. Using the methodology of an integrative literature review, 337 articles archived in the Educational Resources Information Center (ERIC) are examined. Four categories of in-class activities emerge: (i) individual non-polling activities, (ii) in-class polling activities, (iii) whole-class discussion or activities, and (iv) in-class group activities. Examining the collection of identified in-class activities through the lens of a theoretical framework informed by constructivism and social interdependence theory, we synthesise the reviewed literature to propose the active learning strategies (ALSs) model and the instructional decisions to enable active learning (IDEAL) theory. The ALS model characterises in-class activities in terms of the degrees to which they are designed to promote (i) peer interaction and (ii) social interdependence. The IDEAL theory includes the ALS model and provides a framework for conceptualising different levels of the general concept 'active learning' and how these levels connect to instructional decision-making about using in-class activities. The proposed ALS model and IDEAL theory can be utilised to inform instructional decision-making and future research about active learning in college science courses.

Peer Inclusion in Interventions for Children with ADHD: A Systematic Review and Meta-Analysis

PubMed Central

Vilaysack, Brandon; Doma, Kenji; Wilkes-Gillan, Sarah; Speyer, Renée

2018-01-01

Objective To assess the effectiveness of peer inclusion in interventions to improve the social functioning of children with ADHD. Methods We searched four electronic databases for randomized controlled trials and controlled quasi-experimental studies that investigated peer inclusion interventions alone or combined with pharmacological treatment. Data were collected from the included studies and methodologically assessed. Meta-analyses were conducted using a random-effects model. Results Seventeen studies met eligibility criteria. Studies investigated interventions consisting of peer involvement and peer proximity; no study included peer mediation. Most included studies had an unclear or high risk of bias regarding inadequate reporting of randomization, blinding, and control for confounders. Meta-analyses indicated improvements in pre-post measures of social functioning for participants in peer-inclusive treatment groups. Peer inclusion was advantageous compared to treatment as usual. The benefits of peer inclusion over other therapies or medication only could not be determined. Using parents as raters for outcome measurement significantly mediated the intervention effect. Conclusions The evidence to support or contest the efficacy of peer inclusion interventions for children with ADHD is lacking. Future studies need to reduce risks of bias, use appropriate sample sizes, and provide detailed results to investigate the efficacy of peer inclusion interventions for children with ADHD. PMID:29744363

PEER REVIEW FOR THE CONSUMER VEHICLE CHOICE MODEL

EPA Science Inventory

The U.S. Environmental Protection Agency’s (EPA) Office of Transportation and Air Quality (OTAQ) has recently sponsored the development of a Consumer Vehicle Choice Model (CVCM) by the Oak Ridge National Laboratory (ORNL). The specification by OTAQ to ORNL for consumer choice mod...

IRIS Toxicological Review of Inorganic Arsenic (Cancer) (Interagency Science Consultation Draft)

EPA Science Inventory

On February 19, 2010, the draft IRIS Toxicological Review of Inorganic Arsenic (Cancer) external review draft document and the charge to external peer reviewers were released for public review and comment. The draft document and the charge to external peer reviewers were reviewed...

Performance results for a workstation-integrated radiology peer review quality assurance program.

PubMed

O'Keeffe, Margaret M; Davis, Todd M; Siminoski, Kerry

2016-06-01

To assess review completion rates, RADPEER score distribution, and sources of disagreement when using a workstation-integrated radiology peer review program, and to evaluate radiologist perceptions of the program. Retrospective review of prospectively collected data. Large private outpatient radiology practice. Radiologists (n = 66) with a mean of 16.0 (standard deviation, 9.2) years of experience. Prior studies and reports of cases being actively reported were randomly selected for peer review using the RADPEER scoring system (a 4-point scale, with a score of 1 indicating agreement and scores of 2-4 indicating increasing levels of disagreement). Assigned peer review completion rates, review scores, sources of disagreement and radiologist survey responses. Of 31 293 assigned cases, 29 044 (92.8%; 95% CI 92.5-93.1%) were reviewed. Discrepant scores (score = 2, 3 or 4) were given in 0.69% (95% CI 0.60-0.79%) of cases and clinically significant discrepancy (score = 3 or 4) was assigned in 0.42% (95% CI 0.35-0.50%). The most common cause of disagreement was missed diagnosis (75.2%; 95% CI 66.8-82.1%). By anonymous survey, 94% of radiologists felt that peer review was worthwhile, 90% reported that the scores they received were appropriate and 78% felt that the received feedback was valuable. Workstation-based peer review can increase completion rates and levels of radiologist acceptance while producing RADPEER scores similar to those previously reported. This approach may be one way to increase radiologist engagement in peer review quality assurance. © The Author 2016. Published by Oxford University Press in association with the International Society for Quality in Health Care; all rights reserved.

Does Peer Review of Radiation Plans Affect Clinical Care? A Systematic Review of the Literature

DOE Office of Scientific and Technical Information (OSTI.GOV)

Brunskill, Kelsey; Nguyen, Timothy K.; Boldt, R. Gabriel

Purpose: Peer review is a recommended component of quality assurance in radiation oncology; however, it is resource-intensive and its effect on patient care is not well understood. We conducted a systematic review of the published data to assess the reported clinical impact of peer review on radiation treatment plans. Methods and Materials: A systematic review of published English studies was performed in accordance with the PRISMA guidelines using the MEDLINE and EMBASE databases and abstracts published from major radiation oncology scientific meeting proceedings. For inclusion, the studies were required to report the effect of peer review on ≥1 element ofmore » treatment planning (eg, target volume or organ-at-risk delineation, dose prescription or dosimetry). Results: The initial search strategy identified 882 potentially eligible studies, with 11 meeting the inclusion criteria for full-text review and final analysis. Across a total of 11,491 patient cases, peer review programs led to modifications in a weighted mean of 10.8% of radiation treatment plans. Five studies differentiated between major and minor changes and reported weighted mean rates of change of 1.8% and 7.3%, respectively. The most common changes were related to target volume delineation (45.2% of changed plans), dose prescription or written directives (24.4%), and non-target volume delineation or normal tissue sparing (7.5%). Conclusions: Our findings suggest that peer review leads to changes in clinical care in approximately 1 of every 9 cases overall. This is similar to the reported rates of change in peer review studies from other oncology-related specialties, such as radiology and pathology.« less

Does Peer Review of Radiation Plans Affect Clinical Care? A Systematic Review of the Literature.

PubMed

Brunskill, Kelsey; Nguyen, Timothy K; Boldt, R Gabriel; Louie, Alexander V; Warner, Andrew; Marks, Lawrence B; Palma, David A

2017-01-01

Peer review is a recommended component of quality assurance in radiation oncology; however, it is resource-intensive and its effect on patient care is not well understood. We conducted a systematic review of the published data to assess the reported clinical impact of peer review on radiation treatment plans. A systematic review of published English studies was performed in accordance with the PRISMA guidelines using the MEDLINE and EMBASE databases and abstracts published from major radiation oncology scientific meeting proceedings. For inclusion, the studies were required to report the effect of peer review on ≥1 element of treatment planning (eg, target volume or organ-at-risk delineation, dose prescription or dosimetry). The initial search strategy identified 882 potentially eligible studies, with 11 meeting the inclusion criteria for full-text review and final analysis. Across a total of 11,491 patient cases, peer review programs led to modifications in a weighted mean of 10.8% of radiation treatment plans. Five studies differentiated between major and minor changes and reported weighted mean rates of change of 1.8% and 7.3%, respectively. The most common changes were related to target volume delineation (45.2% of changed plans), dose prescription or written directives (24.4%), and non-target volume delineation or normal tissue sparing (7.5%). Our findings suggest that peer review leads to changes in clinical care in approximately 1 of every 9 cases overall. This is similar to the reported rates of change in peer review studies from other oncology-related specialties, such as radiology and pathology. Copyright © 2016 Elsevier Inc. All rights reserved.

Challenges in the Ethical Review of Peer Support Interventions

PubMed Central

Simmons, David; Bunn, Christopher; Nakwagala, Fred; Safford, Monika M.; Ayala, Guadalupe X.; Riddell, Michaela; Graffy, Jonathan; Fisher, Edwin B.

2015-01-01

PURPOSE Ethical review processes have become increasingly complex. We have examined how 8 collaborating diabetes peer-support clinical trials were assessed by ethics committees. METHODS The ethical reviews from the 8 peer-support studies were collated and subjected to a thematic analysis. We mapped the recommendations of local Institutional Review Boards and ethics committees onto the “4+1 ethical framework” (autonomy, beneficence, non-maleficence, and justice, along with concern for their scope of application). RESULTS Ethics committees did not consistently focus on tasks within the 4+1 framework: many conducted reviews of scientific, organizational, and administrative activities. Of the 20 themes identified across the ethical reviews, only 4 fell within the scope of the 4+1 framework. Variation in processes and requirements for ethics committees were particularly evident between study countries. Some of the consent processes mandated by ethical review boards were disproportionate for peer support, increased participant burden, and reduced the practicality of testing an ethical intervention. Across the 8 studies, ethics committees’ reviews included the required elements to ensure participant safety; however, they created a range of hurdles that in some cases delayed the research and required consent processes that could hinder the spontaneity and/or empathy of peer support. CONCLUSION Ethics committees should avoid repeating the work of other trusted agencies and consider the ethical validity of “light touch” consent procedures for peer-support interventions. The investigators propose an ethical framework for research on peer support. PMID:26304976

Turnitin and Peer Review in ESL Academic Writing Classrooms

ERIC Educational Resources Information Center

Li, Jinrong; Li, Mimi

2018-01-01

Despite the benefits of peer review, there are still challenges that need to be addressed to make it more effective for L2 students. With the development of technology, computer-mediated peer review has captured increasing attention from L2 writing researchers and instructors. While Turnitin is known for its use in detecting plagiarism, its newly…

Working in Triads: A Case Study of a Peer Review Process

ERIC Educational Resources Information Center

Grainger, Peter; Bridgstock, Martin; Houston, Todd; Drew, Steve

2015-01-01

Peer review of teaching has become an accepted educational procedure in Australia to quality assure the quality of teaching practices. The institutional implementation of the peer review process can be viewed as genuine desire to improve teaching quality or an imposition from above as a measure of accountability and performativity. One approach is…

Peer-to-Peer Teaching in Higher Education: A Critical Literature Review

ERIC Educational Resources Information Center

Stigmar, Martin

2016-01-01

The aim of my critical literature review is to identify studies where students are engaged as partners in teaching in higher education and to analyze how tutors and tutees benefit from peer teaching. Thirty studies were included for review. Thirteen countries are represented and two thirds of the studies conducted in the United States of America…

Blog Comments vs. Peer Review: Which Way Makes a Book Better?

ERIC Educational Resources Information Center

Young, Jeffrey R.

2008-01-01

What if scholarly books were peer reviewed by anonymous blog comments rather than by traditional, selected peer reviewers? This is the question posed by an unusual experiment that was started recently by Noah Wardrip-Fruin, an an assistant professor of communication at the University of California at San Diego. His experiment was started after his…

Independent Research Projects in General Chemistry Classes as an Introduction to Peer-Reviewed Literature

ERIC Educational Resources Information Center

Tribe, Lorena; Cooper, Evan L.

2008-01-01

A well-structured independent literature research project with a poster session was used to introduce students to peer-reviewed literature in a general chemistry course. Overall, students reported an enhanced appreciation of the course due to performing research at some level, using peer-reviewed literature, and presenting their results in a…

U.S. Department of Energy Hydrogen and Fuel Cells Program 2011 Annual Merit Review and Peer Evaluation Report

DOE Office of Scientific and Technical Information (OSTI.GOV)

Satypal, S.

2011-09-01

This document summarizes the comments provided by peer reviewers on hydrogen and fuel cell projects presented at the FY 2011 U.S. Department of Energy (DOE) Hydrogen Program and Vehicle Technologies Program Annual Merit Review and Peer Evaluation Meeting (AMR), held May 9-13, 2011 in Arlington, Virginia

Bound by Tradition? Peer Review and New Scholarship: An Institutional Case Study

ERIC Educational Resources Information Center

White, Barbara Jo; Cruz, Laura; Ellern, Jill; Ford, George; Moss, Hollye

2012-01-01

Peer review is by no means a routine process for traditional, or basic, research. Even so, peer review is even less routinized for other forms of scholarship. In 1990, Ernest Boyer called for a reconsideration of scholarship and extended the definition to be inclusive of non-traditional modes of scholarly production and delivery. However, peer…

Peer Review Improves the Quality of MCQ Examinations

ERIC Educational Resources Information Center

Malau-Aduli, Bunmi S.; Zimitat, Craig

2012-01-01

The aim of this study was to assess the effect of the introduction of peer review processes on the quality of multiple-choice examinations in the first three years of an Australian medical course. The impact of the peer review process and overall quality assurance (QA) processes were evaluated by comparing the examination data generated in earlier…

Academic Excellence: A Commentary and Reflections on the Inherent Value of Peer Review

ERIC Educational Resources Information Center

Roberts, Thomas J.; Shambrook, Jennifer

2012-01-01

Academic peer review is widely viewed as fair, equitable, and essential to academic quality. Successfully completing the process through publication or award is widely deemed as one of the most rigorous and prestigious forms of scholarly accomplishment. Despite this sentiment the academic peer review process is not without fault. It is criticized…

Doing Peer Review and Receiving Feedback: Impact on Scientific Literacy and Writing Skills

ERIC Educational Resources Information Center

Geithner, Christina A.; Pollastro, Alexandria N.

2016-01-01

Doing peer review has been effectively implemented to help students develop critical reading and writing skills; however, its application in Human Physiology programs is limited. The purpose of the present study was to determine the impact of peer review on Human Physiology majors' perceptions of their scientific literacy and writing skills.…

A Review of Peer-Mediated Social Interaction Interventions for Students with Autism in Inclusive Settings

ERIC Educational Resources Information Center

Watkins, Laci; O'Reilly, Mark; Kuhn, Michelle; Gevarter, Cindy; Lancioni, Giulio E.; Sigafoos, Jeff; Lang, Russell

2015-01-01

This review addresses the use of peer-mediated interventions (PMI) to improve the social interaction skills of students with autism spectrum disorder (ASD) in inclusive settings. The purpose of this review is to (a) identify the characteristics and components of peer-mediated social interaction interventions, (b) evaluate the effectiveness of PMI…

Social Workers' Attitudes toward Peer-Reviewed Literature: The Evidence Base

ERIC Educational Resources Information Center

Knight, Carolyn

2013-01-01

Social workers from one state chapter of the National Association of Social Workers were surveyed to assess their use of and attitudes toward the peer-reviewed literature and their engagement in evidence-based practice. Results reveal that, in general, the practitioners in this study did not read the peer-reviewed literature, particularly articles…

Potential Benefits of Incorporating Peer-to-Peer Interactions Into Digital Interventions for Psychotic Disorders: A Systematic Review.

PubMed

Biagianti, Bruno; Quraishi, Sophia H; Schlosser, Danielle A

2018-04-01

Peer-to-peer interactions and support groups mitigate experiences of social isolation and loneliness often reported by individuals with psychotic disorders. Online peer-to-peer communication can promote broader use of this form of social support. Peer-to-peer interactions occur naturally on social media platforms, but they can negatively affect mental health. Recent digital interventions for persons with psychotic disorders have harnessed the principles of social media to incorporate peer-to-peer communication. This review examined the feasibility, acceptability, and preliminary efficacy of recent digital interventions in order to identify strategies to maximize benefits of online peer-to-peer communication for persons with psychotic disorders. An electronic database search of PubMed, EMBASE, PsycINFO, Ovid MEDLINE, Cochrane Central Register of Controlled Trials, and Health Technology Assessment Database was conducted in February 2017 and yielded a total of 1,015 results. Eight publications that reported data from six independent trials and five interventions were reviewed. The technology supporting peer-to-peer communication varied greatly across studies, from online forums to embedded social networking. When peer-to-peer interactions were moderated by facilitators, retention, engagement, acceptability, and efficacy were higher than for interventions with no facilitators. Individuals with psychotic disorders were actively engaged with moderated peer-to-peer communication and showed improvements in perceived social support. Studies involving service users in intervention design showed higher rates of acceptability. Individuals with psychotic disorders value and benefit from digital interventions that include moderated peer-to-peer interactions. Incorporating peer-to-peer communication into digital interventions for this population may increase compliance with other evidence-based therapies by producing more acceptable and engaging online environments.

Testing the Rebound Peer Review Concept

PubMed Central

Choi, Augustine M.K.

2013-01-01

Abstract This invited editorial addresses the rescue of the article by Skrzypek et al. “Interplay between heme oxygenase-1 and miR-378 affects non-small cell lung carcinoma growth, vascularization, and metastasis.” The work was rejected by the standard peer review system and subsequently rescued by the Rebound Peer Review (RPR) mechanism offered by Antioxidants and Redox Signaling (Antioxid Redox Signal 16: 293–296, 2012). The reviewers who openly rescued the article were James F. George, Justin C. Mason, Mahin D. Maines, and Yasufumi Sato. The initial article was a de novo resubmission of a previously rejected article, which was then reviewed by six reviewers. The reviewers raised substantial scientific concerns, including questions pertaining to the specificity of the findings, quality of the presentation, and other technical concerns; the editor returned a decision of reject. The authors voluntarily chose to exercise the option to rescue the article utilizing the RPR system, where the authors found qualified reviewers who were willing to advocate for acceptance with scientific reasoning. The open reviewers felt that the scientific and technical concerns raised by the reviewers were outweighed by the strengths and novelty of the findings to justify acceptance. The RPR, in this case, was a “success” in that it rescued a rejected article. Despite this assessment, we question the necessity of open peer review as a means to overturn a peer review decision, with concerns for the larger-than-usual peer review process, and the voluntary relinquishing of editorial privilege and disclosure of reviewer identity. Antioxid. Redox Signal. 19, 639–643. PMID:23725371

Editors’ Perspectives on Enhancing Manuscript Quality and Editorial Decisions Through Peer Review and Reviewer Development

PubMed Central

Janke, Kristin K.; Traynor, Andrew P.

2017-01-01

Objectives. To identify peer reviewer and peer review characteristics that enhance manuscript quality and editorial decisions, and to identify valuable elements of peer reviewer training programs. Methods. A three-school, 15-year review of pharmacy practice and pharmacy administration faculty’s publications was conducted to identify high-publication volume journals for inclusion. Editors-in-chief identified all editors managing manuscripts for participation. A three-round modified Delphi process was used. Rounds advanced from open-ended questions regarding actions and attributes of good reviewers to consensus-seeking and clarifying questions related to quality, importance, value, and priority. Results. Nineteen editors representing eight pharmacy journals participated. Three characteristics of reviews were rated required or helpful in enhancing manuscript quality by all respondents: includes a critical analysis of the manuscript (88% required, 12% helpful), includes feedback that contains both strengths and areas of improvement (53% required, 47% helpful), and speaks to the manuscript’s utility in the literature (41% required, 59% helpful). Hands-on experience with review activities (88%) and exposure to good and bad reviews (88%) were identified as very valuable to peer reviewer development. Conclusion. Reviewers, individuals involved in faculty development, and journals should work to assist new reviewers in defining focused areas of expertise, building knowledge in these areas, and developing critical analysis skills. PMID:28630514

Impartial judgment by the "gatekeepers" of science: fallibility and accountability in the peer review process.

PubMed

Hojat, Mohammadreza; Gonnella, Joseph S; Caelleigh, Addeane S

2003-01-01

High publication demands and the low acceptance rate of peer review journals place the journal editors and their reviewers in a powerful position. Journal reviewers have a vital role not only in influencing the journal editor's publication decisions, but also in the very nature and direction of scientific research. Because of their influence in peer review outcomes, journal reviewers are aptly described as the "gatekeepers of science." In this article we describe several pitfalls that can impede reviewers' impartial judgement. These include such issues as confirmatory bias, the negative results bias (the file drawer problem), the Matthew effect, the Doctor Fox effect, and gender, race, theoretical orientation, and "political correctness." We argue that procedures currently used by many professional journals, such as blind or masked review, may not completely alleviate the effects of these pitfalls. Instead, we suggest that increasing reviewers' awareness of the pitfalls, accountability, and vigilance can improve fairness in the peer review process. The ultimate responsibilities belong to the journal editors who are confronted with the difficult task of satisfying journal readers, contributors, reviewers, and owners. We recommend that the journal editors conduct periodic internal and external evaluations of their journals' peer review process and outcomes, with participation of reviewers, contributors, readers and owners.

A randomized trial of peer review: the UK National Chronic Obstructive Pulmonary Disease Resources and Outcomes Project: three-year evaluation.

PubMed

Roberts, Christopher M; Stone, Robert A; Buckingham, Rhona J; Pursey, Nancy A; Lowe, Derek; Potter, Jonathan M

2012-06-01

Peer review has been widely used within the National Health Service to facilitate health quality improvement but evaluation has been limited particularly over the longer-term. Change within the National Health Service (NHS) can take a prolonged period--1-2 years--to occur. We report here a 3-year evaluation of the largest randomized trial of peer review ever conducted in the UK. To evaluate whether targeted mutual peer review of respiratory units brings about improvements in services for chronic obstructive pulmonary disease (COPD) over 3 years. The peer review intervention was a reciprocal supportive exercise that included clinicians, hospital management, commissioners and patients, which focused on the quality of the provision of four specific evidence-based aspects of COPD care. Follow-up at 36 months demonstrated limited significant quantitative differences in the quality of services offered in the two groups but a strong trend in favour of intervention sites. Qualitative data suggested many benefits of peer review in most but not all intervention units and some control teams. The data identify factors that promote and obstruct change. The findings demonstrate significant change in service provision over 3 years in both control and intervention sites with great variability in both groups. The combined quantitative and qualitative findings indicate that targeted mutual peer review is associated with improved quality of care, improvements in service delivery and with changes within departments that promote and are precursors to quality improvement. The generic findings of this study have potential implications for the application of peer review throughout the NHS. © 2011 Blackwell Publishing Ltd.

Peer-based health interventions for people with serious mental illness: A systematic literature review.

PubMed

Cabassa, Leopoldo J; Camacho, David; Vélez-Grau, Carolina M; Stefancic, Ana

2017-01-01

Health interventions delivered by peer specialists or co-facilitated by peer specialists and health professionals can help improve the physical health of people with serious mental illness (SMI). Yet, the quality of the studies examining these health interventions and their impact on health outcomes remains unclear. To address this gap, we conducted a systematic literature review of peer-based health interventions for people with SMI. We rated the methodological quality of studies, summarized intervention strategies and health outcomes, and evaluated the inclusion of racial and ethnic minorities in these studies. We used the Preferred Reporting Items for Systematic Review and Meta-Analysis guidelines to conduct our systematic literature review. Electronic bibliographic databases and manual searches were used to locate articles that were published in English in peer-reviewed journals between 1990 and 2015, described peer-based health interventions for people with SMI, and evaluated the impact of the interventions on physical health outcomes. Two independent reviewers used a standardized instrument to rate studies' methodological quality, abstracted study characteristics, and evaluated the effects of the interventions on different health outcomes. Eighteen articles were reviewed. Findings indicated that the strength of the evidence generated from these studies is limited due to several methodological limitations. Mixed and limited intervention effects were reported for most health outcomes. The most promising interventions were self-management and peer-navigator interventions. Efforts to strengthen the evidence of peer-based interventions require a research agenda that focuses on establishing the efficacy and effectiveness of these interventions across different populations and settings. Copyright © 2016 Elsevier Ltd. All rights reserved.

IRIS Toxicological Review of Trimethylbenzenes (Interagency Science Consultation Draft)

EPA Science Inventory

On June 26, 2012, the draft Toxicological Review of Trimethylbenzenes and the draft charge to external peer reviewers were released for external peer review and public comment. The Toxicological Review and charge were reviewed internally by EPA and by other federal agencies and W...

IRIS Toxicological Review of Trichloroethylene (Interagency Science Consultation Draft)

EPA Science Inventory

On November 3, 2009, the Toxicological Review of Trichloroethylene and the charge to external peer reviewers were released for external peer review and public comment. The Toxicological Review and charge were reviewed internally by EPA and by other federal agencies and White Hous...

IRIS Toxicological Review of Formaldehyde (Interagency Science Consultation Draft)

EPA Science Inventory

On June 2, 2010, the Toxicological Review of Formaldehyde and the charge to external peer reviewers were released for external peer review and public comment. The Toxicological Review and charge were reviewed internally by EPA and by other federal agencies and White House Offices...

IRIS Toxicological Review of Biphenyl (Interagency Science Consultation Draft)

EPA Science Inventory

On September 30, 2011, the draft Toxicological Review of Biphenyl and the charge to external peer reviewers were released for external peer review and public comment. The Toxicological Review and charge were reviewed internally by EPA and by other federal agencies and White House...

IRIS Toxicological Review of Acrylonitrile (Interagency Science Consultation Draft)

EPA Science Inventory

On June 30, 2011, the draft Toxicological Review of Acrylonitrile and the charge to external peer reviewers were released for external peer review and public comment. The Toxicological Review and charge were reviewed internally by EPA and by other federal agencies and White House...

School Programs for At-Risk Children and Youth: A Review.

ERIC Educational Resources Information Center

McLaughlin, T. F.; Vacha, Edward F.

1992-01-01

A review of the literature regarding programs that assist the at-risk student found both pull-out and in-class models. Common elements of pull-out programs included such services as tutoring, skill-based structured instruction, and homework hot lines. In-class procedures included classwide peer tutoring, direct instruction, and cooperative…

The 21st Century Writing Program: Collaboration for the Common Good

ERIC Educational Resources Information Center

Moberg, Eric

2010-01-01

The purpose of this report is to review the literature on theoretical frameworks, best practices, and conceptual models for the 21st century collegiate writing program. Methods include electronic database searches for recent and historical peer-reviewed scholarly literature on collegiate writing programs. The author analyzed over 65 sources from…

A Research Elective Course on Dietary Supplements to Engage Doctor of Pharmacy Students in Primary Literature Evaluation and Scholarly Activity.

PubMed

Islam, Mohammed A; Gunaseelan, Simi; Khan, Seher A

2015-12-01

To develop and implement a research elective course to enhance skills of pharmacy students on primary literature evaluation and evidence-based practice on dietary supplements and generate scholarly publications. A 2 credit hour independent research elective course was designed and implemented in the third-year doctor of pharmacy curriculum. The course involved student-led research activities that included formulating research project, reviewing of primary literature, collection and evaluation of data, and writing of review articles for publication in peer-reviewed journals. An online survey was administered to evaluate students' perceptions of the course. Students successfully completed the course. The course resulted in peer-reviewed publications through student-faculty collaboration. Pharmacy students enrolled in the elective course perceived that the course helped them enhance their analytical reasoning, critical thinking and drug-literature evaluation skills, gain evidence-based knowledge, and apply the knowledge into practice during their advanced pharmacy practice experiences community pharmacy rotations. The course provided opportunity to the pharmacy students to not only critically search and evaluate the literature but also publish in peer-reviewed journals. Other pharmacy schools/colleges can adopt this course model to create opportunities for student-faculty collaborations toward scholarly accomplishments. © The Author(s) 2014.

First CytoJournal Peer-Reviewer's Retreat in 2006 – Open access, peer-review, and impact factor

PubMed Central

Shidham, Vinod B; Sandweiss, Lynn; Atkinson, Barbara F

2006-01-01

CytoJournal organized its first Peer-Reviewer's Retreat of 2006 during the United States and Canadian Academy of Pathology Annual Meeting at Atlanta on Feb 12, 2006. The major topics discussed were open access, peer review, and impact factors. Representative participants volunteered to join the task force to prepare an instructional guide for peer-reviewing cytopathology manuscripts. Concern about the impact factor for CytoJournal was discussed. A feedback to its readers and authors was recommended. Impact factor calculation needs at least three years of journal statistics. It is only possible after two years from the time a journal is first accepted by Thomson-ISI for citation tracking. CytoJournal is still too new for an impact factor to be calculated. However, general progress of CytoJournal suggests an encouraging pattern for high impact factor. PMID:16566816

Science Advisory Panel Meeting on PBPK Modeling Postponed

EPA Pesticide Factsheets

EPA is postponing the Federal Insecticide, Fungicide, and Rodenticide Act Scientific Advisory Panel (SAP) meeting scheduled for October 24-27, 2017 due to the unavailability of experts for the peer review panel.

Item Development and Validity Testing for a Self- and Proxy Report: The Safe Driving Behavior Measure

PubMed Central

Classen, Sherrilene; Winter, Sandra M.; Velozo, Craig A.; Bédard, Michel; Lanford, Desiree N.; Brumback, Babette; Lutz, Barbara J.

2010-01-01

OBJECTIVE We report on item development and validity testing of a self-report older adult safe driving behaviors measure (SDBM). METHOD On the basis of theoretical frameworks (Precede–Proceed Model of Health Promotion, Haddon’s matrix, and Michon’s model), existing driving measures, and previous research and guided by measurement theory, we developed items capturing safe driving behavior. Item development was further informed by focus groups. We established face validity using peer reviewers and content validity using expert raters. RESULTS Peer review indicated acceptable face validity. Initial expert rater review yielded a scale content validity index (CVI) rating of 0.78, with 44 of 60 items rated ≥0.75. Sixteen unacceptable items (≤0.5) required major revision or deletion. The next CVI scale average was 0.84, indicating acceptable content validity. CONCLUSION The SDBM has relevance as a self-report to rate older drivers. Future pilot testing of the SDBM comparing results with on-road testing will define criterion validity. PMID:20437917

Medical students as peer tutors: a systematic review

PubMed Central

2014-01-01

Background While Peer Assisted Learning (PAL) has long occurred informally in medical education, in the past ten years, there has been increasing international interest in formally organised PAL, with many benefits for both the students and institutions. We conducted a systematic review of the literature to establish why and how PAL has been implemented, focussing on the recruitment and training process for peer tutors, the benefits for peer tutors, and the competency of peer tutors. Method A literature search was conducted in three electronic databases. Selection of titles and abstracts were made based on pre-determined eligibility criteria. We utilized the ‘AMEE Peer assisted learning: a planning and implementation framework: AMEE Guide no. 30’ to assist us in establishing the review aims in a systematic review of the literature between 2002 and 2012. Six key questions were developed and used in our analysis of particular aspects of PAL programs within medical degree programs. Results We found nineteen articles that satisfied our inclusion criteria. The PAL activities fell into three broad categories of teacher training, peer teaching and peer assessment. Variability was found in the reporting of tutor recruitment and training processes, tutor outcomes, and tutor competencies. Conclusion Results from this review suggest that there are many perceived learning benefits for student tutors. However, there were mixed results regarding the accuracy of peer assessment and feedback, and no substantial evidence to conclude that participation as a peer tutor improves one’s own examination performance. Further research into PAL in medicine is required if we are to better understand the relative impact and benefits for student tutors. PMID:24912500

Reciprocal benefit to senior and junior peers: An outcome of a pilot research workshop at medical university.

PubMed

Ahsin, Sadia; Abbas, Seyyeda; Zaidi, Noshin; Azad, Nadia; Kaleem, Fatima

2015-08-01

A study was planned to explore and evaluate the role of senior peers in the learning process of their juniors during a Research Methodology workshop, and to assess educational advantages for seniors in leading roles. Twenty medical students participated with 15 juniors (1st to 3rd year) and 5 seniors (final/fourth year) divided into 5 groups with one senior student each at Foundation University Medical College, Islamabad, Pakistan. The seniors supervised and engaged the groups to develop research questions, formulate objectives, review literature, outline study designs, develop study tools/questionnaire and finally shape their projects in synopsis. Overall advantages to both juniors and seniors through this peer-assisted learning model were assessed by feedback proformas with open and closed-ended questions. Senior peers' facilitation was effective in the learning process of junior peers. Senior peers also gained academic benefit by exercising their leadership qualities through teaching and maintaining group dynamics.

Peer support in anesthesia: turning war stories into wellness.

PubMed

Vinson, Amy E; Randel, Gail

2018-06-01

Peer support, a method of providing for the well being of healthcare providers following adverse or stressful events, is garnering increased attention in light of the increased prevalence and awareness of burnout, depression and suicidality in physicians. In this review, we will summarize the evolution of the 'second victim,' explore methods of support and examine how new regulatory requirements are changing the peer support landscape. As peer support and the second victim are investigated more, themes are emerging regarding the natural history of recovery. As these are delineated, more targeted peer support models are being developed. One major change in 2017 is the institution of new Accreditation Council for Graduate Medical Education's Common Program Requirements, now including topics targeted on well being. Effective and accessible peer support is developing in many departments nationwide and can only be expected to continue, given new regulatory requirements. As these programs develop, and research on their effect continues, best practices will likely emerge.

What Health and Aged Care Culture Change Models Mean for Residents and Their Families: A Systematic Review.

PubMed

Petriwskyj, Andrea; Parker, Deborah; Brown Wilson, Christine; Gibson, Alexandra

2016-04-01

A range of commercialized programs are increasingly being adopted which involve broad culture change within care organizations to implement person-centered care. These claim a range of benefits for clients; however, the published evidence for client and family outcomes from culture change is inconclusive and the evidence for these specific models is difficult to identify. The purpose of this review was to identify and evaluate the peer-reviewed evidence regarding consumer outcomes for these subscription-based models. The review followed the Joanna Briggs Institute procedure. The review considered peer-reviewed literature that reported on studies conducted with health and aged care services, their staff, and consumers, addressed subscription-based person-centered culture change models, and were published in English up to and including 2015. The review identified 19 articles of sufficient quality that reported evidence relating to consumer outcomes and experience. Resident outcomes and family and resident satisfaction and experiences were mixed. Findings suggest potential benefits for some outcomes, particularly related to quality of life and psychiatric symptoms, staff engagement, and functional ability. Although residents and families identified some improvements in residents' lives, both also identified problematic aspects of the change related to staff adjustment and staff time. Outcomes for these models are at best comparable with traditional care with limited suggestions that they result in poorer outcomes and sufficient potential for benefits to warrant further investigation. Although these models may have the potential to benefit residents, the implementation of person-centered principles may affect the outcomes. © The Author 2015. Published by Oxford University Press on behalf of The Gerontological Society of America. All rights reserved. For permissions, please e-mail: journals.permissions@oup.com.

48 CFR 201.170 - Peer Reviews.

Code of Federal Regulations, 2011 CFR

2011-10-01

... Section 201.170 Federal Acquisition Regulations System DEFENSE ACQUISITION REGULATIONS SYSTEM, DEPARTMENT... Peer Reviews, the military departments, defense agencies, and DoD field activities shall provide a... departments, defense agencies, and DoD field activities shall establish procedures for— (1) Pre-award Peer...

48 CFR 201.170 - Peer Reviews.

Code of Federal Regulations, 2010 CFR

2010-10-01

... Section 201.170 Federal Acquisition Regulations System DEFENSE ACQUISITION REGULATIONS SYSTEM, DEPARTMENT... Peer Reviews, the military departments, defense agencies, and DoD field activities shall provide a... departments, defense agencies, and DoD field activities shall establish procedures for— (1) Pre-award Peer...

A Review of the Literature on Rural and Remote Pre-Service Teacher Preparation with a Focus on Blended and E-Learning Models

ERIC Educational Resources Information Center

Eaton, Sarah Elaine; Dressler, Roswita; Gereluk, Dianne

2015-01-01

Purpose: To review a broad array of current literature related to pre-service teacher education offered in blended and e-learning formats, with a focus on rural and remote teacher education. Results: The range of literature that we have surveyed is broad. We have consulted peer-reviewed academic journals, books, conference proceedings, government…

Expanding Capacity and Promoting Inclusion in Introductory Computer Science: A Focus on Near-Peer Mentor Preparation and Code Review

ERIC Educational Resources Information Center

Pon-Barry, Heather; Packard, Becky Wai-Ling; St. John, Audrey

2017-01-01

A dilemma within computer science departments is developing sustainable ways to expand capacity within introductory computer science courses while remaining committed to inclusive practices. Training near-peer mentors for peer code review is one solution. This paper describes the preparation of near-peer mentors for their role, with a focus on…

Types of Feedback in Peer Review and the Effect on Student Motivation and Writing Quality

ERIC Educational Resources Information Center

Sloan, Christopher Colgan

2017-01-01

In writing classrooms, peer review has been shown to have numerous practical and cognitive benefits. However, little research has been done that examines how different types of peer feedback motivate adolescent students and the effects that different types of feedback have on writing quality. While the literature has indicated that peers give each…

Fragments of peer review: A quantitative analysis of the literature (1969-2015)

PubMed Central

Grimaldo, Francisco; Marušić, Ana

2018-01-01

This paper examines research on peer review between 1969 and 2015 by looking at records indexed from the Scopus database. Although it is often argued that peer review has been poorly investigated, we found that the number of publications in this field doubled from 2005. A half of this work was indexed as research articles, a third as editorial notes and literature reviews and the rest were book chapters or letters. We identified the most prolific and influential scholars, the most cited publications and the most important journals in the field. Co-authorship network analysis showed that research on peer review is fragmented, with the largest group of co-authors including only 2.1% of the whole community. Co-citation network analysis indicated a fragmented structure also in terms of knowledge. This shows that despite its central role in research, peer review has been examined only through small-scale research projects. Our findings would suggest that there is need to encourage collaboration and knowledge sharing across different research communities. PMID:29466467

The Influence of Peers on Diet and Exercise Among Adolescents: A Systematic Review.

PubMed

Chung, Sophia Jihey; Ersig, Anne L; McCarthy, Ann Marie

Adolescents' diet and exercise are modifiable factors contributing to high rates of adolescent obesity. Diverse contextual factors, including family, social environment, and peers, affect adolescents' diet and exercise behaviors. Because peer influence increases during adolescence, peers' contributions to adolescents' diet and exercise behaviors should be examined as potential targets for intervention to reduce the prevalence of adolescent obesity. The purpose of this systematic review is to identify research examining the contribution of peers to diet and exercise of adolescents. The electronic databases PubMed, CINAHL, Web of Science, and SCOPUS were searched. A total of 24 unique articles were included: seven examined diet only, fourteen studied exercise only, and three explored diet and exercise. This review provided evidence that diet and exercise of adolescents were significantly associated with those of their peers. However, these associations differed depending on gender, the type of diet and exercise, and closeness of friends. Findings from this review suggest that peers could be possible targets for interventions to promote healthier diet and exercise among adolescents; however, more studies are needed to identify specific peer influences and develop tailored interventions. Copyright © 2017 Elsevier Inc. All rights reserved.

Exploration and practice of methods and processes of evidence-based rapid review on peer review of WHO EML application.

PubMed

Li, Youping; Yu, Jiajie; Du, Liang; Sun, Xin; Kwong, Joey S W; Wu, Bin; Hu, Zhiqiang; Lu, Jing; Xu, Ting; Zhang, Lingli

2015-11-01

After 38 years of development, the procedure of selection and evaluation of the World Health Organization Essential Medicine List (WHO EML) is increasingly scientific and formal. However, peer review for the applications of World Health Organization Essential Medicine List is always required in a short period. It is necessary to build up a set of methods and processes for rapid review. We identified the process of evidenced-based rapid review on WHO EML application for peer reviews according to 11 items which were required during reporting of the peer review results of the proposals. The most important items for the rapid review of World Health Organization Essential Medicine List peer reviewers are (1) to confirm the requirements and identify the purposes; (2) to establish the research questions and translate the questions into the 'Participants, Interventions, Comparators, Outcomes, Study design' (PICOS) format; (3) to search and screen available evidence, for which high-level evidence is preferred, such as systematic reviews or meta-analyses, health technology assessment, clinical guidelines; (4) to extract data, where we extract primary information based on the purposes; (5) to synthesize data by qualitative methods, assess the quality of evidence, and compare the results; (6) to provide the answers to the applications, quality of evidences and strength of recommendations. Our study established a set of methods and processes for the rapid review of World Health Organization Essential Medicine List peer review, and our findings were used to guide the reviewers to fulfill the 19(th) World Health Organization Essential Medicine List peer review. The methods and processes were feasible and met the necessary requirements in terms of time and quality. Continuous improvement and evaluation in practice are warranted. © 2015 Chinese Cochrane Center, West China Hospital of Sichuan University and Wiley Publishing Asia Pty Ltd.

Community-Clinical Linkages With Community Health Workers in the United States: A Scoping Review.

PubMed

Lohr, Abby M; Ingram, Maia; Nuñez, Annabelle V; Reinschmidt, Kerstin M; Carvajal, Scott C

2018-05-01

Despite the proliferation of community-clinical linkage (CCL) interventions with community health workers (CHWs), little is known about the components of these programs or how linkages are realized. In this scoping review, we synthesize evidence concerning the role of CHWs in creating and sustaining CCLs aimed at improving individual health outcomes. Our inclusion criteria included peer-reviewed articles that described a CHW intervention in the United States that used a CCL model. A total of 2,776 titles and/or abstracts were screened and 47 articles underwent full text review. Two independent reviewers rated the screened articles based on additional criteria including the CHW connection to community and evidence of linkage follow up rather than simple referral. For the 11 peer-reviewed articles included in the final review, we describe the CHW's relationship to the community, training, and role within the intervention, linkage, and outcomes. We used a standardized framework to determine commonalities in CHW roles across the interventions. CCLs with CHWs positively affect the delivery of both clinical care and community resources across a range of disease areas in a variety of contexts. To identify effective CCL models, additional information on CHW training, CCL follow-up methods, and the CHW role in CCLs is recommended.

Validity of peer grading using Calibrated Peer Review in a guided-inquiry, conceptual physics course

NASA Astrophysics Data System (ADS)

Price, Edward; Goldberg, Fred; Robinson, Steve; McKean, Michael

2016-12-01

Constructing and evaluating explanations are important science practices, but in large classes it can be difficult to effectively engage students in these practices and provide feedback. Peer review and grading are scalable instructional approaches that address these concerns, but which raise questions about the validity of the peer grading process. Calibrated Peer Review (CPR) is a web-based system that scaffolds peer evaluation through a "calibration" process where students evaluate sample responses and receive feedback on their evaluations before evaluating their peers. Guided by an activity theory framework, we developed, implemented, and evaluated CPR-based tasks in guided-inquiry, conceptual physics courses for future teachers and general education students. The tasks were developed through iterative testing and revision. Effective tasks had specific and directed prompts and evaluation instructions. Using these tasks, over 350 students at three universities constructed explanations or analyzed physical phenomena, and evaluated their peers' work. By independently assessing students' responses, we evaluated the CPR calibration process and compared students' peer reviews with expert evaluations. On the tasks analyzed, peer scores were equivalent to our independent evaluations. On a written explanation item included on the final exam, students in the courses using CPR outperformed students in similar courses using traditional writing assignments without a peer evaluation element. Our research demonstrates that CPR can be an effective way to explicitly include the science practices of constructing and evaluating explanations into large classes without placing a significant burden on the instructor.

IRIS Toxicological Review of Dichloromethane (Methylene Chloride) (Interagency Science Consultation Draft)

EPA Science Inventory

On March 31, 2010, the draft IRIS Toxicological Review of Dichloromethane (Methylene Chloride) external review draft document and the charge to external peer reviewers were released for public review and comment. The draft document and the charge to external peer reviewers were r...

IRIS TOXICOLOGICAL REVIEW OF HEXAVALENT CHROMIUM (INTERAGENCY SCIENCE CONSULTATION DRAFT)

EPA Science Inventory

On Septemeber 30, 2010, the draft Toxicological Review of Hexavalent Chromium and the charge to external peer reviewers were released for external peer review and public comment. The Toxicological Review and charge were reviewed internally by EPA and by other federal agenc...

IRIS Toxicological Review of Libby Amphibole Asbestos (Interagency Science Consultation Draft)

EPA Science Inventory

On August 25, 2011, the draft Toxicological Review of Libby Amphibole Asbestos and the charge to external peer reviewers were released for external peer review and public comment. The Toxicological Review and charge were reviewed internally by EPA and by other federal agencies an...

IRIS Toxicological Review of Urea (Interagency Science Consultation Draft)

EPA Science Inventory

On September 28, 2010, the Toxicological Review of Urea and the charge to external peer reviewers were released for external peer review and public comment. The Toxicological Review and charge were reviewed internally by EPA and by other federal agencies and White House Of...

IRIS Toxicological Review of Ammonia (Interagency Science Consultation Draft)

EPA Science Inventory

On June 1, 2012, the draft Toxicological Review of Ammonia and the draft charge to external peer reviewers were released for external peer review and public comment. The Toxicological Review and charge were reviewed internally by EPA and by other federal agencies and White House ...

IRIS Toxicological Review of Vanadium Pentoxide (Interagency Science Consultation Draft)

EPA Science Inventory

On September 30, 2011, the draft Toxicological Review of Vanadium Pentoxide and the charge to external peer reviewers were released for external peer review and public comment. The Toxicological Review and charge were reviewed internally by EPA and by other federal agencies and W...

IRIS Toxicological Review of Tert-Butyl Alcohol (Tert-Butanol) ...

EPA Pesticide Factsheets

The IRIS Toxicological Review of tert-Butyl Alcohol (tert-Butanol) was released for external peer review in June 2017. EPA’s Science Advisory Board’s (SAB) Chemical Assessment Advisory Committee (CAAC) will conduct a peer review of the scientific basis supporting the tert-butanol assessment and release a final report of their review. Information regarding the peer review can be found on the SAB website. EPA is conducting an Integrated Risk Information System (IRIS) health assessment for tert-butanol. The outcome of this project is a Toxicological Review and IRIS Summary for tert-butanol that will be entered into the IRIS database.

Assessing Postgraduate Student Perceptions and Measures of Learning in a Peer Review Feedback Process

ERIC Educational Resources Information Center

Simpson, Genevieve; Clifton, Julian

2016-01-01

Peer review feedback, developed to assist students with increasing the quality of group reports and developing peer review skills, was added to a master's level Climate Change Policy and Planning unit. A pre- and post-survey was conducted to determine whether students found the process a valuable learning opportunity: 87% of students responding to…

Is Peer Review an Appropriate Form of Assessment in a MOOC? Student Participation and Performance in Formative Peer Review

ERIC Educational Resources Information Center

Meek, Sarah E. M.; Blakemore, Louise; Marks, Leah

2017-01-01

Many aspects of higher education must be reconceptualised for massive open online courses (MOOCs). Formative and summative assessment of qualitative work in particular requires novel approaches to cope with the numbers involved. Peer review has been proposed as one solution, and has been widely adopted by major MOOC providers, but there is…

The Effect of Peer Review on Student Learning Outcomes in a Research Methods Course

ERIC Educational Resources Information Center

Crowe, Jessica A.; Silva, Tony; Ceresola, Ryan

2015-01-01

In this study, we test the effect of in-class student peer review on student learning outcomes using a quasiexperimental design. We provide an assessment of peer review in a quantitative research methods course, which is a traditionally difficult and technical course. Data were collected from 170 students enrolled in four sections of a…

Using Peer Reviews to Examine Micropolitics and Disciplinary Development of Engineering Education: A Case Study

ERIC Educational Resources Information Center

Beddoes, Kacey

2014-01-01

This article presents a case study of the peer review process for a feminist article submitted to an engineering education journal. It demonstrates how an examination of peer review can be a useful approach to further understanding the development of feminist thought in education fields. Rather than opposition to feminist thought per se, my…

Adding Value to the Learning Process by Online Peer Review Activities: Towards the Elaboration of a Methodology to Promote Critical Thinking in Future Engineers

ERIC Educational Resources Information Center

Dominguez, Caroline; Nascimento, Maria M.; Payan-Carreira, Rita; Cruz, Gonçalo; Silva, Helena; Lopes, José; Morais, Maria da Felicidade A.; Morais, Eva

2015-01-01

Considering the results of research on the benefits and difficulties of peer review, this paper describes how teaching faculty, interested in endorsing the acquisition of communication and critical thinking (CT) skills among engineering students, has been implementing a learning methodology throughout online peer review activities. While…

Accelerating Educational Innovation in the MPH Degree Program: What Is the Role of Peer Review of Teaching?

ERIC Educational Resources Information Center

Vian, Taryn; Ashigbie, Paul G.

2015-01-01

Purpose: The environment of public health practice is rapidly changing, creating the need to adapt graduate education and accelerate educational innovation. Formative peer review is a strategy designed to promote critical reflection on teaching and to develop faculty as teachers. Through case study methods, we explore how peer review of teaching…

Issues in Peer Review of the Scientific Basis for Regulatory Decisions.

ERIC Educational Resources Information Center

American Chemical Society, Washington, DC.

This document is intended to provide a discussion of the issues that need to be addressed in the development of peer review guidelines, the options for addressing the issues, and a range of views about such options. The document focuses on peer review with regard to regulatory decisions and contains major sections which deal with: (1) what should…

Investigating Peer Review as an Intentional Learning Strategy to Foster Collaborative Knowledge-Building in Students of Instructional Design

ERIC Educational Resources Information Center

Brill, Jennifer M.; Hodges, Charles B.

2011-01-01

Peer review has been advocated for as an intentional strategy to support the knowledge and skill attainment of adult learners preparing for professional practice, including those students preparing for instructional design and technology practice. The purposes of this article are to discuss the practical application of peer review as an…

Peer Review and the Dilemmas of Quality Control in Programme Accreditation in South African Higher Education: Challenges and Possibilities

ERIC Educational Resources Information Center

Cross, Michael; Naidoo, Devika

2011-01-01

The paper scrutinises the dynamics and the nature of peer review in the programme evaluation and accreditation process within the context of diverse individual and institutional legacies in South Africa. It analyses the peer review process and highlights the contestation at political, policy and epistemological levels. The paper argues that,…

The Multiple Faces of Peer Review in Higher Education. Five Learning Scenarios Developed for Digital Business

ERIC Educational Resources Information Center

Herzog, Michael A.; Katzlinger, Elisabeth

2017-01-01

Peer review, as an e-assessment tool incorporates the human factor to treat complexity for rating and grading students. It could address the qualitative more than quantitative aspects with flexible human feedback that leads up to metacognitive knowledge aspects, which e-assessment usually is not able to achieve. Peer review is an internationally…

Bristol Bay Assessment – Supplemental Peer Review Reports ...

EPA Pesticide Factsheets

These reports represent the results of independent peer reviews of several technical reports submitted to the public docket for the May 2012 draft of the Bristol Bay Assessment, An Assessment of Potential Mining Impacts on Salmon Ecosystems of Bristol Bay, Alaska. Background In May 2012, the U.S. Environmental Protection Agency (USEPA) released the draft assessment entitled An Assessment of Potential Mining Impacts on Salmon Ecosystems of Bristol Bay, Alaska, or the Bristol Bay Assessment. The purpose of the assessment is to provide a characterization of the biological and mineral resources of the Bristol Bay watershed, increase understanding of the potential impacts of large-scale mining on the region’s fish resources, and inform future governmental decisions. During the public comment period for the May 2012 draft, numerous technical reports were submitted to the public docket. The USEPA identified several of these reports as providing information about issues raised by the peer reviewers, but the reports did not show evidence of prior peer review. The USEPA made arrangements for a contractor to conduct independent peer reviews of seven such reports. The reports and the results of these supplemental peer reviews are provided here to document that the reports are of

A narrative review of research impact assessment models and methods.

PubMed

Milat, Andrew J; Bauman, Adrian E; Redman, Sally

2015-03-18

Research funding agencies continue to grapple with assessing research impact. Theoretical frameworks are useful tools for describing and understanding research impact. The purpose of this narrative literature review was to synthesize evidence that describes processes and conceptual models for assessing policy and practice impacts of public health research. The review involved keyword searches of electronic databases, including MEDLINE, CINAHL, PsycINFO, EBM Reviews, and Google Scholar in July/August 2013. Review search terms included 'research impact', 'policy and practice', 'intervention research', 'translational research', 'health promotion', and 'public health'. The review included theoretical and opinion pieces, case studies, descriptive studies, frameworks and systematic reviews describing processes, and conceptual models for assessing research impact. The review was conducted in two phases: initially, abstracts were retrieved and assessed against the review criteria followed by the retrieval and assessment of full papers against review criteria. Thirty one primary studies and one systematic review met the review criteria, with 88% of studies published since 2006. Studies comprised assessments of the impacts of a wide range of health-related research, including basic and biomedical research, clinical trials, health service research, as well as public health research. Six studies had an explicit focus on assessing impacts of health promotion or public health research and one had a specific focus on intervention research impact assessment. A total of 16 different impact assessment models were identified, with the 'payback model' the most frequently used conceptual framework. Typically, impacts were assessed across multiple dimensions using mixed methodologies, including publication and citation analysis, interviews with principal investigators, peer assessment, case studies, and document analysis. The vast majority of studies relied on principal investigator interviews and/or peer review to assess impacts, instead of interviewing policymakers and end-users of research. Research impact assessment is a new field of scientific endeavour and there are a growing number of conceptual frameworks applied to assess the impacts of research.

Open access to scientific articles: a review of benefits and challenges.

PubMed

Björk, Bo-Christer

2017-03-01

The Internet has fundamentally changed the publishing of scholarly peer reviewed journals, and the way readers find and access articles. Digital access is nowadays the norm, in particular for researchers. The Internet has enabled a totally new business model, Open Access (OA), in which an article is openly available in full text for anyone with Internet access. This article reviews the different options to achieve this, whether by journals changing their revenue structures from subscription to publishing charges, or authors utilizing a number of options for posting OA versions of article manuscripts in repositories. It also discusses the regrettable emergence of "predatory" publishers, who spam academics, and make money by promising them rapid publication with only the semblance of peer review. The situation is further discussed from the viewpoints of different stakeholders, including academics as authors and readers, practicing physicians and the general public.

Peer Coaching Interventions for Parents of Children with Type 1 Diabetes.

PubMed

Tully, Carrie; Shneider, Caitlin; Monaghan, Maureen; Hilliard, Marisa E; Streisand, Randi

2017-06-01

Peer support is a promising model of providing psychosocial support to parents of children with type 1 diabetes. This review seeks to discuss the findings of the existing literature in peer coaching as it relates to parents and diabetes as well as to identify gaps in knowledge for future intervention development and implementation. Peer support programs vary widely with regard to recruitment, training, and delivery protocols. Across most programs, ongoing support and supervision are provided to peer coaches. Despite inconsistent effects on psychosocial and child health outcomes, parent coaching is consistently a highly acceptable and feasible intervention with parents of children with T1D. Current evidence supports use of parent coaching as part of a multicomponent intervention or program to increase patient satisfaction, but more research is needed to determine if it can stand alone as an active mechanism for behavior change. The use of peer coach interventions for parents of young children with diabetes is feasible to implement and highly acceptable. However, more research is needed to understand the enduring impact for target parents and peer coaches alike, as well as impact on child outcomes.

A meta-synthesis of women's perceptions and experiences of breastfeeding support.

PubMed

Schmied, Virginia; Beake, Sarah; Sheehan, Athena; McCourt, Christine; Dykes, Fiona

Breastfeeding conveys significant health benefits to infants and mothers yet in many affluent nations breastfeeding rates continue to decline across the early months following birth. Both peer and professional support have been identified as important to the success of breastfeeding. What is not known are the key components or elements of support that are effective in increasing the duration of breastfeeding? The aim of this meta-synthesis was to examine women's perceptions and experiences of breastfeeding support, either professional or peer, in order to illuminate the components of support that they deem 'supportive'. A secondary aim was to describe any differences between components of Peer and Professional support. Both primiparous and multiparous women who initiated breastfeeding were included in the study. Studies that included a specific demographic sub-group, such as adolescents, were included. Studies focused on a specific clinical sub-group, such as women post-caesarean, were not included. This meta-synthesis focused on maternal experiences of breastfeeding support. The meta-synthesis included both formal or 'created' peer and professional support for breastfeeding women but excluded studies of family or informal support for breastfeeding. Primarily qualitative studies were included in the review. Studies such as large scale surveys were also included if they reported in sufficient detail the analysis of qualitative data gathered through open ended responses or included in depth interviews. Only studies published or available in English, in peer reviewed journals and undertaken between 1990 and December 2007 were included. Key data bases were searched. The following search terms were individually added to the main keyword - breastfeeding: qualitative research, breast feeding support, peer support, professional support, postnatal support, post-natal support, volunteer support, lay support, breastfeeding counsellors, lactation consultants, social support, health education, breastfeeding education and lactation. Delimiters applied were humans, English language and years 1990-2007. JBI-QARI (Qualitative Assessment and Review Instrument) was used to assess the quality of 38 articles selected for full review. Seven were excluded primarily because they included little qualitative data relevant to the review focus. The studies reviewed were generally of reasonable quality in terms of clarity, appropriate methodology, credibility and evidence cited to support the conclusions drawn. However, most included relatively limited discussion of theoretical or conceptual perspectives, discussion of relevant literature and reflection on the roles of the researchers. JBI-QARI was used to manage and appraise textual data, Meta-ethnographic methods were used to develop 'interpretive explanations and understanding of breastfeeding support. Each study was systematically reviewed, reading and re-reading papers to create a list of themes through 'reciprocal translation'. Both first order and second order constructs were used to create the themes and these were then synthesised into four interpretive categories. The meta-synthesis resulted in four categories comprising a total of 20 themes. The synthesis indicates that support for breastfeeding occurs along a continuum from authentic presence at one end, perceived as effective support, to disconnected encounters at the other, perceived as ineffective or even discouraging and counter productive. Second, the synthesis identified a facilitative approach, versus a reductionist approach as contrasting styles of support women experienced as helpful or unhelpful. The findings of this meta-synthesis emphasise the importance of person-centred communication skills and of relationships in supporting a woman to breastfeed. Authentic presence is best supported by building a trusting relationship, demonstrating empathy, listening and being responsive to a woman's needs. Organisational systems and services that facilitate continuity of care/r and time spent with the woman, for example continuity of midwifery care or peer support models, are more likely to facilitate an authentic presence. The findings suggest the need to increase opportunities to offer women across all social groups access to peer support. The review indicates several changes in direction for practice to foster provision of support that women consider helpful and enabling, rather than disabling. These include service design that facilitates effective relationships to be established between supporters and the woman, including greater continuity of carer, Midwives need to work in service models that enable them to provide more individualised, rather than standard care and advice, to spend time and provide practical help to those women who need it. Antenatal education needs to be more learner-centred, using pedagogic models based on adult-learning principles, and should provide women with information that is realistic, detailed and positively encouraging. Midwifery education needs to integrate sufficient focus on developing midwives' communication and information giving skills. Schemes to offer peer support should be developed further, using a pro-active approach, including home visits and support groups. Further research is warranted on schemes to develop peer models of support. Research is also needed to investigate in more depth the service models and conditions that are conducive to midwives' ability to offer effective support for breastfeeding.