The Effects of Resident Peer- and Self-Chart Review on Outpatient Laboratory Result Follow-up.
Hale, Andrew J; Nall, Ryan W; Mukamal, Kenneth J; Libman, Howard; Smith, C Christopher; Sternberg, Scot B; Kim, Hans S; Kriegel, Gila
2016-05-01
Performing and teaching appropriate follow-up of outpatient laboratory results (LRs) is a challenge. The authors tested peer-review among residents as a potentially valuable intervention. Investigators assigned residents to perform self-review (n = 27), peer-review (n = 21), or self- + peer-review (n = 30) of outpatient charts. They also compared residence performance with that of historical controls (n = 20). In September 2012, residents examined 10 LRs from April 2012 onward. A second review in November 2012 ascertained whether performing chart review improved residents' practice behaviors. Initially, the least-square (LS) mean number of LRs without documentation of follow-up per resident in the self-, peer-, and self- + peer-review group was, respectively, 0.5 (SD 1.0), 1.0 (SD 1.7), and 0.9 (SD 1.3), and post intervention, this was 1.0 (SD 0.2), 0.3 (SD 0.2), and 0.6 (SD 0.2) (self- versus peer-review P = .03). Initially the LS mean follow-up time per resident in the self-, peer-, and self- + peer-review group was, respectively, 4.2 (SD 1.2), 6.9 (SD 1.4), and 5.9 (SD 1.2) days, and after the intervention, LS mean time was 5.0 (SD 0.5), 2.5 (SD 0.6), and 3.9 (SD 0.5) days (self- versus peer-review P < .01). Self-review was not associated with significant improvements in practice. In this comparison of self- and peer-review, only residents who performed peer-review demonstrated significant improvements in their documentation practices. These findings support the use of resident peer-review in improving LR follow-up, and potentially, in other, broader resident quality improvement initiatives.
7 CFR 3411.10 - Establishment and operation of peer review groups.
Code of Federal Regulations, 2011 CFR
2011-01-01
... INSTITUTE OF FOOD AND AGRICULTURE NATIONAL RESEARCH INITIATIVE COMPETITIVE GRANTS PROGRAM Scientific Peer Review of Research Grant Applications § 3411.10 Establishment and operation of peer review groups. Subject to § 3411.5, the Administrator shall adopt procedures for the conduct of peer reviews and the...
Peer Review of Teaching: Sharing Best Practices
ERIC Educational Resources Information Center
Golparian, Shaya; Chan, Judy; Cassidy, Alice
2015-01-01
In this paper, we share examples of best peer review of teaching practices, drawing on our involvement in the design and implementation of the Peer Review of Teaching program at the Centre for Teaching, Learning and Technology. We review the history of the Peer Review of Teaching Initiative at the University of British Columbia and explain key…
Building Scholarly Writers: Student Perspectives on Peer Review in a Doctoral Writing Seminar
ERIC Educational Resources Information Center
Adamek, Margaret Ellen
2015-01-01
Peer review was used as a primary pedagogical tool in a scholarly writing course for social work doctoral students. To gauge student response to peer review and learning as a result of peer review, the instructor used narrative analysis to organize student comments into themes. Themes identified included initial trepidation, "no pain, no…
Rodríguez-Carrio, Javier; Putrik, Polina; Sepriano, Alexandre; Moltó, Anna; Nikiphorou, Elena; Gossec, Laure; Kvien, Tore K; Ramiro, Sofia
2018-01-01
Although peer review plays a central role in the maintenance of high standards in scientific research, training of reviewing skills is not included in the common education programmes. The Emerging EULAR (European League Against Rheumatism) Network (EMEUNET) developed a programme to address this unmet need. The EMEUNET Peer Review Mentoring Program for Rheumatology Journals promotes a systematic training of reviewing skills by engaging mentees in a 'real world' peer review experience supervised by experienced mentors with support from rheumatology journals. This viewpoint provides an overview of this initiative and its outcomes, and discusses its potential limitations. Over 4 years, 18 mentors and 86 mentees have participated. Among the 33 participants who have completed the programme, 13 (39.3%) have become independent reviewers for Annals of the Rheumatic Diseases after the training. This programme has been recently evaluated by a survey and qualitative interviews, revealing a high interest in this initiative. The main strengths (involvement of a top journal and learning opportunities) and weaknesses of the programme (limited number of places and insufficient dissemination) were identified. Overall, this programme represents an innovative and successful approach to peer review training. Continuous evaluation and improvement are key to its functioning. The EMEUNET Peer Review Mentoring Program may be used as a reference for peer review training in areas outside rheumatology.
7 CFR 3411.10 - Establishment and operation of peer review groups.
Code of Federal Regulations, 2010 CFR
2010-01-01
...) COOPERATIVE STATE RESEARCH, EDUCATION, AND EXTENSION SERVICE, DEPARTMENT OF AGRICULTURE NATIONAL RESEARCH INITIATIVE COMPETITIVE GRANTS PROGRAM Scientific Peer Review of Research Grant Applications § 3411.10 Establishment and operation of peer review groups. Subject to § 3411.5, the Administrator shall adopt procedures...
ERIC Educational Resources Information Center
Hutchings, Pat
A collection of program descriptions and case studies in college faculty peer collaboration and peer review includes: "Setting a Scholarly Tone: Teaching Circles in the History Department at Kent State University"; "Fostering Collective Responsibility for Student Learning: Teaching Seminars in the University of North Carolina at Charlotte…
Evaluation of the Inhalation Carcinogenicity of Ethylene Oxide ...
EPA is initiating a public comment period prior to peer review of the scientific basis supporting the human health hazard and dose-response assessment of ethylene oxide (cancer) that will appear in the Integrated Risk Information System (IRIS) database. EPA seeks external peer review on how the Agency responded to the SAB panel recommendations, the exposure-response modeling of epidemiologic data, including new analyses since the 2007 external peer review, and on the adequacy, transparency, and clarity of the revised draft. The peer review will include an opportunity for the public to address the peer reviewers.
Nimptsch, Ulrike; Peschke, Dirk; Mansky, Thomas
2016-10-01
In 2008 the 'Initiative Qualitätsmedizin' (initiative for quality in medical care, IQM) was established as a voluntary non-profit association of hospital providers of all kinds of ownership. Currently, about 350 hospitals from Germany and Switzerland participate in IQM. Member hospitals are committed to a quality strategy based on measuring outcome indicators using administrative data, peer review procedures to improve medical quality, and transparency by public reporting. This study aims to investigate whether voluntary implementation of this approach is associated with improvements in medical outcome. Within a retrospective before-after study 63 hospitals, which started to participate in IQM between 2009 and 2011, were monitored. In-hospital mortality in these hospitals was studied for 14 selected inpatient services in comparison to the German national average. The analyses examine whether in-hospital mortality declined after participation of the studied hospitals in IQM, independently of secular trends or deviations in case mix when compared to the national average, and whether such findings were associated with initial hospital performance or peer review procedures. Declining in-hospital mortality was observed in hospitals with initially subpar performance. These declines were statistically significant for treatment of myocardial infarction, heart failure, pneumonia, and septicemia. Similar, but statistically non-significant trends were observed for nine further treatments. Following peer-review procedures significant declines in in-hospital mortality were observed for treatments of myocardial infarction, heart failure, and pneumonia. Mortality declines after peer reviews regarding stroke, hip fracture and colorectal resection were not significant, and after peer reviews regarding mechanically ventilated patients no changes were observed. The results point to a positive impact of the quality approach applied by IQM on clinical outcomes. A more targeted selection of hospitals to be peer-reviewed might further enhance the impact of this approach. Copyright © 2016. Published by Elsevier GmbH.
Research Integrity and Peer Review-past highlights and future directions.
Boughton, Stephanie L; Kowalczuk, Maria K; Meerpohl, Joerg J; Wager, Elizabeth; Moylan, Elizabeth C
2018-01-01
In May 2016, we launched Research Integrity and Peer Review , an international, open access journal with fully open peer review (reviewers are identified on their reports and named reports are published alongside the article) to provide a home for research on research and publication ethics, research reporting, and research on peer review. As the journal enters its third year, we reflect on recent events and highlights for the journal and explore how the journal is faring in terms of gender and diversity in peer review. We also share the particular interests of our Editors-in-Chief regarding models of peer review, reporting quality, common research integrity issues that arise during the publishing process, and how people interact with the published literature. We continue to encourage further research into peer review, research and publication ethics and research reporting, as we believe that all new initiatives should be evidence-based. We also remain open to constructive discussions of the developments in the field that offer new solutions.
DOE Hydrogen Program: 2006 Annual Merit Review and Peer Evaluation Report
DOE Office of Scientific and Technical Information (OSTI.GOV)
Milliken, J.
This report summarizes comments from the Peer Review Panel at the FY 2006 DOE Hydrogen Program Annual Merit Review, held on May 16-19, 2006, in Arlington, Virginia. The projects evaluated support the Department of Energy and President Bush's Hydrogen Initiative. The results of this merit review and peer evaluation are major inputs used by DOE to make funding decisions. Project areas include hydrogen production and delivery; hydrogen storage; fuel cells; technology validation; safety, codes and standards; education; and systems analysis.
DOE Hydrogen Program: 2005 Annual Merit Review and Peer Evaluation Report
DOE Office of Scientific and Technical Information (OSTI.GOV)
Chalk, S. G.
This report summarizes comments from the Peer Review Panel at the FY 2005 DOE Hydrogen Program Annual Merit Review, held on May 23-26, 2005, in Arlington, Virginia. The projects evaluated support the Department of Energy and President Bush's Hydrogen Initiative. The results of this merit review and peer evaluation are major inputs used by DOE to make funding decisions. Project areas include hydrogen production and delivery; hydrogen storage; fuel cells; technology validation; safety, codes and standards; education; and systems analysis.
DOE Hydrogen Program: 2007 Annual Merit Review and Peer Evaluation Report
DOE Office of Scientific and Technical Information (OSTI.GOV)
Milliken, J.
This report summarizes comments from the Peer Review Panel at the FY 2007 DOE Hydrogen Program Annual Merit Review, held on May 14-18, 2007, in Washington, D.C. The projects evaluated support the Department of Energy and President Bush's Hydrogen Initiative. The results of this merit review and peer evaluation are major inputs used by DOE to make funding decisions. Project areas include hydrogen production and delivery; hydrogen storage; fuel cells; technology validation; safety, codes and standards; education; and systems analysis.
ERIC Educational Resources Information Center
Parkes, David; Nielsen, Soren
2006-01-01
The European Training Foundation EU European (ETF) Peer Review is an initiative that was launched in the South Eastern European countries in 2002. It combines policy advice to individual countries with a regional dimension. The key objectives for the peer reviews are to: (1) provide an external assessment of VET (vocational education and training)…
Necessary Social Skills Related to Peer Acceptance. Review of Research.
ERIC Educational Resources Information Center
Kim, Yanghee A.
2003-01-01
Differentiates behaviors of peer-rejected and peer-neglected children at the early childhood level. Offers suggestions for teaching alternative behaviors to aggressive or withdrawn children, direct entry behaviors, positive responses to peers' initiation, verbal assertiveness, engagement in complex pretend play, and ways to show positive affection…
7 CFR 3411.11 - Composition of peer review groups.
Code of Federal Regulations, 2010 CFR
2010-01-01
... 7 Agriculture 15 2010-01-01 2010-01-01 false Composition of peer review groups. 3411.11 Section 3411.11 Agriculture Regulations of the Department of Agriculture (Continued) COOPERATIVE STATE RESEARCH, EDUCATION, AND EXTENSION SERVICE, DEPARTMENT OF AGRICULTURE NATIONAL RESEARCH INITIATIVE COMPETITIVE GRANTS...
Brundage, Michael; Foxcroft, Sophie; McGowan, Tom; Gutierrez, Eric; Sharpe, Michael; Warde, Padraig
2013-01-01
Objectives To describe current patterns of practice of radiation oncology peer review within a provincial cancer system, identifying barriers and facilitators to its use with the ultimate aim of process improvement. Design A survey of radiation oncology programmes at provincial cancer centres. Setting All cancer centres within the province of Ontario, Canada (n=14). These are community-based outpatient facilities overseen by Cancer Care Ontario, the provincial cancer agency. Participants A delegate from each radiation oncology programme filled out a single survey based on input from their multidisciplinary team. Outcome measures Rated importance of peer review; current utilisation; format of the peer-review process; organisation and timing; case attributes; outcomes of the peer-review process and perceived barriers and facilitators to expanding peer-review processes. Results 14 (100%) centres responded. All rated the importance of peer review as at least 8/10 (10=extremely important). Detection of medical error and improvement of planning processes were the highest rated perceived benefits of peer review (each median 9/10). Six centres (43%) reviewed at least 50% of curative cases; four of these centres (29%) conducted peer review in more than 80% of cases treated with curative intent. Fewer than 20% of cases treated with palliative intent were reviewed in most centres. Five centres (36%) reported usually conducting peer review prior to the initiation of treatment. Five centres (36%) recorded the outcomes of peer review on the medical record. Thirteen centres (93%) planned to expand peer-review activities; a critical mass of radiation oncologists was the most important limiting factor (median 6/10). Conclusions Radiation oncology peer-review practices can vary even within a cancer system with provincial oversight. The application of guidelines and standards for peer-review processes, and monitoring of implementation and outcomes, will require effective knowledge translation activities. PMID:23903814
IRIS Toxicological Review of Libby Amphibole Asbestos ...
On August 25, 2011, the draft Toxicological Review of Libby Amphibole Asbestos and the charge to external peer reviewers were released for external peer review and public comment. The Toxicological Review and charge were reviewed internally by EPA and by other federal agencies and White House Offices before public release. In the new IRIS process (May 2009), introduced by the EPA Administrator, all written comments on IRIS assessments submitted by other federal agencies and White House Offices will be made publicly available. Accordingly, interagency comments and the interagency science consultation draft of the IRIS Toxicological Review of Libby Amphibole Asbestos and the charge to external peer reviewers are posted on this site. The project supports OSWER and Region 8 site clean-up and related risk management initiatives at this Superfund site. As with all IRIS assessments, the draft document will undergo agency review, OMB/interagency review and independent external peer review before being included on the IRIS data base.
Expanding Group Peer Review: A Proposal for Medical Education Scholarship.
Dumenco, Luba; Engle, Deborah L; Goodell, Kristen; Nagler, Alisa; Ovitsh, Robin K; Whicker, Shari A
2017-02-01
After participating in a group peer-review exercise at a workshop presented by Academic Medicine and MedEdPORTAL editors at the 2015 Association of American Medical Colleges Medical Education Meeting, the authors realized that the way their work group reviewed a manuscript was very different from the way by which they each would have reviewed the paper as an individual. Further, the group peer-review process yielded more robust feedback for the manuscript's authors than did the traditional individual peer-review process. This realization motivated the authors to reconvene and collaborate to write this Commentary to share their experience and propose the expanded use of group peer review in medical education scholarship.The authors consider the benefits of a peer-review process for reviewers, including learning how to improve their own manuscripts. They suggest that the benefits of a team review model may be similar to those of teamwork and team-based learning in medicine and medical education. They call for research to investigate this, to provide evidence to support group review, and to determine whether specific paper types would benefit most from team review (e.g., particularly complex manuscripts, those receiving widely disparate initial individual reviews). In addition, the authors propose ways in which a team-based approach to peer review could be expanded by journals and institutions. They believe that exploring the use of group peer review potentially could create a new methodology for skill development in research and scholarly writing and could enhance the quality of medical education scholarship.
Peer Reviewing of OER in a Contested Domain--An Activity Theoretical Analysis
ERIC Educational Resources Information Center
Algers, Anne; Ljung, Magnus
2015-01-01
Globally, we experience numerous initiatives to increase the adoption of open educational resources (OER), but quality concerns challenge the adoption. In this study we present an analysis of the peer review process of an OER. The OER under review is produced by the European Commission (EU). It has the goal to teach children about farm animal…
An Online Peer Assisted Learning Community Model and its Application in ZJNU
ERIC Educational Resources Information Center
Gaofeng, Ruan; Yeyu, Lin
2007-01-01
Peer coaching, or peer assisting, was established in 1970s by Joyce and Showers. Initially used in teachers' professional development, it refers to a process that two or more teacher peers evaluate current practice mutually; expand skills, extract and build new skills; share ideas, and review & solve problems of classroom teaching in a way of…
Rigby, J; Cox, D; Julian, K
2018-01-01
Journal peer review lies at the heart of academic quality control. This article explores the journal peer review process and seeks to examine how the reviewing process might itself contribute to papers, leading them to be more highly cited and to achieve greater recognition. Our work builds on previous observations and views expressed in the literature about (a) the role of actors involved in the research and publication process that suggest that peer review is inherent in the research process and (b) on the contribution reviewers themselves might make to the content and increased citation of papers. Using data from the journal peer review process of a single journal in the Social Sciences field (Business, Management and Accounting), we examine the effects of peer review on papers submitted to that journal including the effect upon citation, a novel step in the study of the outcome of peer review. Our detailed analysis suggests, contrary to initial assumptions, that it is not the time taken to revise papers but the actual number of revisions that leads to greater recognition for papers in terms of citation impact. Our study provides evidence, albeit limited to the case of a single journal, that the peer review process may constitute a form of knowledge production and is not the simple correction of errors contained in submitted papers.
To Name or Not to Name: The Effect of Changing Author Gender on Peer Review
ERIC Educational Resources Information Center
Borsuk, Robyn M.; Aarssen, Lonnie W.; Budden, Amber E.; Koricheva, Julia; Leimu, Roosa; Tregenza, Tom; Lortie, Christopher J.
2009-01-01
The peer review model is one of the most important tools used in science to assess the relative merit of research. We manipulated a published article to reflect one of the following four author designations: female, male, initial, and no name provided. This article was then reviewed by referees of both genders at various stages of scientific…
Coached Peer Review: Developing the Next Generation of Authors.
Sidalak, Daniel; Purdy, Eve; Luckett-Gatopoulos, S; Murray, Heather; Thoma, Brent; Chan, Teresa M
2017-02-01
Publishing in academic journals is challenging for learners. Those who pass the initial stages of internal review by an editor often find the anonymous peer review process harsh. Academic blogs offer alternate avenues for publishing medical education material. Many blogs, however, lack a peer review process, which some consumers argue compromises the quality of materials published. CanadiEM (formerly BoringEM) is an academic educational emergency medicine blog dedicated to publishing high-quality materials produced by learners (i.e., residents and medical students). The editorial team has designed and implemented a collaborative "coached peer review" process that comprises an open exchange among the learner-author, editors, and reviewers. The goal of this process is to facilitate the publication of high-quality academic materials by learner-authors while providing focused feedback to help them develop academic writing skills. The authors of this Innovation Report surveyed (February-June 2015) their blog's learner-authors and external expert "staff" reviewers who had participated in coached peer review for their reactions to the process. The survey results revealed that participants viewed the process positively compared with both traditional journal peer review and academic blog publication processes. Participants found the process friendly, easy, efficient, and transparent. Learner-authors also reported increased confidence in their published material. These outcomes met the goals of coached peer review. CanadiEM aims to inspire continued participation in, exposure to, and high-quality production of academic writing by promoting the adoption of coached peer review for online educational resources produced by learners.
Chauvin, Anthony; Moher, David; Altman, Doug; Schriger, David L; Alam, Sabina; Hopewell, Sally; Shanahan, Daniel R; Recchioni, Alessandro; Ravaud, Philippe; Boutron, Isabelle
2017-09-15
Systematic reviews evaluating the impact of interventions to improve the quality of peer review for biomedical publications highlighted that interventions were limited and have little impact. This study aims to compare the accuracy of early career peer reviewers who use an innovative online tool to the usual peer reviewer process in evaluating the completeness of reporting and switched primary outcomes in completed reports. This is a cross-sectional study of individual two-arm parallel-group randomised controlled trials (RCTs) published in the BioMed Central series medical journals, BMJ , BMJ Open and Annals of Emergency Medicine and indexed with the publication type 'Randomised Controlled Trial'. First, we will develop an online tool and training module based (a) on the Consolidated Standards of Reporting Trials (CONSORT) 2010 checklist and the Explanation and Elaboration document that would be dedicated to junior peer reviewers for assessing the completeness of reporting of key items and (b) the Centre for Evidence-Based Medicine Outcome Monitoring Project process used to identify switched outcomes in completed reports of the primary results of RCTs when initially submitted. Then, we will compare the performance of early career peer reviewers who use the online tool to the usual peer review process in identifying inadequate reporting and switched outcomes in completed reports of RCTs at initial journal submission. The primary outcome will be the mean number of items accurately classified per manuscript. The secondary outcomes will be the mean number of items accurately classified per manuscript for the CONSORT items and the sensitivity, specificity and likelihood ratio to detect the item as adequately reported and to identify a switch in outcomes. We aim to include 120 RCTs and 120 early career peer reviewers. The research protocol was approved by the ethics committee of the INSERM Institutional Review Board (21 January 2016). The study is based on voluntary participation and informed written consent. NCT03119376. © Article author(s) (or their employer(s) unless otherwise stated in the text of the article) 2017. All rights reserved. No commercial use is permitted unless otherwise expressly granted.
A multi-disciplinary perspective on emergent and future innovations in peer review
Tennant, Jonathan P.; Dugan, Jonathan M.; Graziotin, Daniel; Jacques, Damien C.; Waldner, François; Mietchen, Daniel; Elkhatib, Yehia; B. Collister, Lauren; Pikas, Christina K.; Crick, Tom; Masuzzo, Paola; Caravaggi, Anthony; Berg, Devin R.; Niemeyer, Kyle E.; Ross-Hellauer, Tony; Mannheimer, Sara; Rigling, Lillian; Katz, Daniel S.; Greshake Tzovaras, Bastian; Pacheco-Mendoza, Josmel; Fatima, Nazeefa; Poblet, Marta; Isaakidis, Marios; Irawan, Dasapta Erwin; Renaut, Sébastien; Madan, Christopher R.; Matthias, Lisa; Nørgaard Kjær, Jesper; O'Donnell, Daniel Paul; Neylon, Cameron; Kearns, Sarah; Selvaraju, Manojkumar; Colomb, Julien
2017-01-01
Peer review of research articles is a core part of our scholarly communication system. In spite of its importance, the status and purpose of peer review is often contested. What is its role in our modern digital research and communications infrastructure? Does it perform to the high standards with which it is generally regarded? Studies of peer review have shown that it is prone to bias and abuse in numerous dimensions, frequently unreliable, and can fail to detect even fraudulent research. With the advent of web technologies, we are now witnessing a phase of innovation and experimentation in our approaches to peer review. These developments prompted us to examine emerging models of peer review from a range of disciplines and venues, and to ask how they might address some of the issues with our current systems of peer review. We examine the functionality of a range of social Web platforms, and compare these with the traits underlying a viable peer review system: quality control, quantified performance metrics as engagement incentives, and certification and reputation. Ideally, any new systems will demonstrate that they out-perform and reduce the biases of existing models as much as possible. We conclude that there is considerable scope for new peer review initiatives to be developed, each with their own potential issues and advantages. We also propose a novel hybrid platform model that could, at least partially, resolve many of the socio-technical issues associated with peer review, and potentially disrupt the entire scholarly communication system. Success for any such development relies on reaching a critical threshold of research community engagement with both the process and the platform, and therefore cannot be achieved without a significant change of incentives in research environments. PMID:29188015
A multi-disciplinary perspective on emergent and future innovations in peer review.
Tennant, Jonathan P; Dugan, Jonathan M; Graziotin, Daniel; Jacques, Damien C; Waldner, François; Mietchen, Daniel; Elkhatib, Yehia; B Collister, Lauren; Pikas, Christina K; Crick, Tom; Masuzzo, Paola; Caravaggi, Anthony; Berg, Devin R; Niemeyer, Kyle E; Ross-Hellauer, Tony; Mannheimer, Sara; Rigling, Lillian; Katz, Daniel S; Greshake Tzovaras, Bastian; Pacheco-Mendoza, Josmel; Fatima, Nazeefa; Poblet, Marta; Isaakidis, Marios; Irawan, Dasapta Erwin; Renaut, Sébastien; Madan, Christopher R; Matthias, Lisa; Nørgaard Kjær, Jesper; O'Donnell, Daniel Paul; Neylon, Cameron; Kearns, Sarah; Selvaraju, Manojkumar; Colomb, Julien
2017-01-01
Peer review of research articles is a core part of our scholarly communication system. In spite of its importance, the status and purpose of peer review is often contested. What is its role in our modern digital research and communications infrastructure? Does it perform to the high standards with which it is generally regarded? Studies of peer review have shown that it is prone to bias and abuse in numerous dimensions, frequently unreliable, and can fail to detect even fraudulent research. With the advent of web technologies, we are now witnessing a phase of innovation and experimentation in our approaches to peer review. These developments prompted us to examine emerging models of peer review from a range of disciplines and venues, and to ask how they might address some of the issues with our current systems of peer review. We examine the functionality of a range of social Web platforms, and compare these with the traits underlying a viable peer review system: quality control, quantified performance metrics as engagement incentives, and certification and reputation. Ideally, any new systems will demonstrate that they out-perform and reduce the biases of existing models as much as possible. We conclude that there is considerable scope for new peer review initiatives to be developed, each with their own potential issues and advantages. We also propose a novel hybrid platform model that could, at least partially, resolve many of the socio-technical issues associated with peer review, and potentially disrupt the entire scholarly communication system. Success for any such development relies on reaching a critical threshold of research community engagement with both the process and the platform, and therefore cannot be achieved without a significant change of incentives in research environments.
Peer-Led Nutrition Education Programs for School-Aged Youth: A Systematic Review of the Literature
ERIC Educational Resources Information Center
Yip, Calvin; Gates, Michelle; Gates, Allison; Hanning, Rhona M.
2016-01-01
To date, the impacts of school-based, peer-led nutrition education initiatives have not been summarized or assessed collectively. This review presents the current evidence, identifies knowledge gaps, and provides recommendations for future research. PubMed, Scopus, ERIC and Google Scholar were searched for refereed Canadian and American primary…
Mager, Diana R; Kazer, Meredith W; Conelius, Jaclyn; Shea, Joyce; Lippman, Doris T; Torosyan, Roben; Nantz, Kathryn
2014-06-03
For many years, an area of research in higher education has been emerging around the development and implementation of fair and effective peer evaluation programs. Recently, a new body of knowledge has developed regarding the development and implementation of fair and effective peer evaluation programs resulting in formative and summative evaluations. The purpose of this article is to describe the development, implementation, and evaluation of a peer review of teaching (PRoT) program for nursing faculty, initiated at one small comprehensive university in the northeastern United States. Pairs of nursing faculty evaluated each other's teaching, syllabi, and course materials after collaborating in a pre-evaluation conference to discuss goals of the classroom visit. Qualitative data gathered in post project focus groups revealed that faculty found their modified PRoT process to be a mutually beneficial experience that was more useful, flexible and collegial, and less stressful than their previous evaluation process.
Peer support for people with chronic conditions in rural areas: a scoping review.
Lauckner, Heidi M; Hutchinson, Susan L
2016-01-01
Chronic conditions are a growing healthcare concern. People living in rural regions are particularly affected because many barriers exist to accessing services and supports. Peer support for chronic condition self-management, where people living with chronic conditions learn about how to care for themselves and maintain their health from people also living with chronic conditions, is one approach gaining recognition. What remains unknown are the unique challenges and strategies associated with peer support for chronic condition self-management in rural contexts. In order to inform the development of peer supports in the authors' local context in rural eastern Canada, a scoping review was undertaken to discover community-based peer support initiatives for adults in rural settings living with chronic conditions. The authors followed established scoping review methods to answer the research question What is known from the existing literature about the key features and potential formats of community-based peer support initiatives for adults living with chronic conditions in rural settings? Six databases (CINAHL, PubMed, Sociological Abstracts, Embase, Cochrane Libraries and PsycInfo) were searched using the following concepts: chronic conditions, peer support, community-based and rural context. Two researchers reviewed the titles and/or abstracts of the 1978 articles retrieved from the initial search to include articles that were in English, published in 2000 to 2014, and that explicitly discussed rural programs/interventions with peers that were community-based. The initial screen excluded 1907 articles, leaving 71 articles, which were read by two research members in light of the inclusion/exclusion criteria. Thirteen articles representing 10 separate programs were included and analyzed using qualitative content analysis. Included programs were from the USA, Australia and Canada. A range of formats (telecommunications only, in-person meetings only, or a combination of both) were used. Peer leaders had varied experiences with chronic conditions and received training in content and facilitation skills. Peer leaders were provided with ongoing support. Program participants received training on chronic conditions, and programs provided opportunities for social support and the development of new skills. Programs focused on creating social connections, reducing stigma, ensuring relevance and promoting empowerment. Of the nine programs that reported outcomes, eight reported positive outcomes and one reported mixed results. Consistent with the extant literature, the programs identified unique issues faced by people with chronic conditions in rural areas that these programs addressed. The key findings of this scoping review are as follows: 1. A combination of telecommunications with some face-to-face meetings can support the accessibility of peer support programs in rural areas. 2. Core elements of these programs are the provision of social support and skill development. 3. Peer leaders benefit from skills training and ongoing support. 4. Sustainability of such programs is complex and requires multiple strategies. Cultural relevance, ongoing support and the use of telecommunications were key features of rural peer support programs. Guiding questions to facilitate a community consultation around these findings are provided. Peer support chronic condition self-management programs require further research.
Roberts, Christopher M; Buckingham, Rhona J; Stone, Robert A; Lowe, Derek; Pearson, Michael G
2010-10-01
Service provision and clinical outcomes for patients admitted with chronic obstructive pulmonary disease remain unacceptably variable despite guidelines and performance feedback of national audit, data. This study aims to assess the impact of mutual peer review on service improvement. The initial phase of this study was to assess the feasibility and determine the practicalities of delivering such a peer review programme on a large scale. All UK acute hospitals were invited to participate in a reciprocal peer review programme administered by a central team from three UK health organizations. Hospitals with the most resources were paired with those with the least (as defined in a baseline survey) and pairs randomized on a 3:2 basis into intervention or control groups. A number of key quality indicators were derived to measure service levels at the beginning and end of the study. Peer review teams included clinicians and managers from acute and primary care organizations and when possible a patient representative. Visits were focussed on four key areas of chronic obstructive pulmonary disease service. Teams were to agree service improvements and submit plans signed off by participants. Monthly change diaries were to be used to record progress towards agreed goals. A total of 100 hospitals participated in the programme. Overall, 52 of 54 peer review visits took place within a 4-week time frame and all units submitted service improvement plans within an agreed time frame. Secondary care representatives participated in all visits, primary care in 30 but patients in only 17. The mean number of diaries returned was 2, but 94% of units returned initial and final versions. It is possible to deliver successful large-scale mutual peer review using a limited but focussed programme. Participation of patients and use of change diaries requires further evaluation. © 2010 Blackwell Publishing Ltd.
Byrnes, Matthew C; Irwin, Eric; Becker, Leslie; Thorson, Melissa; Beilman, Greg; Horst, Patrick; Croston, Kevin
2010-04-01
The initial care of critically injured patients has profound effects on ultimate outcomes. The "golden hour" of trauma care is often provided by rural hospitals before definitive transfer. There are, however, no standardized methods for providing educational feedback to these hospitals for the purposes of performance improvement. We hypothesized that an outreach program would stimulate peer review and identify systematic deficiencies in the care of patients with injuries. We developed a quality improvement program aimed at providing educational feedback to hospitals that referred patients to our American College of Surgeons-verified level I trauma center. We traveled to each referral center to provide feedback on the initial treatment and ultimate outcome of patients that were transferred to us. These feedback sessions were presented in the format of case presentations and case discussions. The outreach program was presented at each hospital every 3 months to 6 months. Nine hospitals were included in our program. We received 334 patients in transfer from these hospitals during the study period. Formal peer review that focused on trauma patients increased from 14% of hospitals to 100% of hospitals after institution of the program. Eighty-five percent of hospitals thought that the care of patients with injuries was improved as a result of the program. Eighty-five percent of hospitals developed process improvement initiatives as a result of the program. A formal outreach program can stimulate peer review at rural hospitals, provide continuing education in the care of patients with injuries, and foster process improvements at referring hospitals.
Statistical Reviewers Improve Reporting in Biomedical Articles: A Randomized Trial
Cobo, Erik; Selva-O'Callagham, Albert; Ribera, Josep-Maria; Cardellach, Francesc; Dominguez, Ruth; Vilardell, Miquel
2007-01-01
Background Although peer review is widely considered to be the most credible way of selecting manuscripts and improving the quality of accepted papers in scientific journals, there is little evidence to support its use. Our aim was to estimate the effects on manuscript quality of either adding a statistical peer reviewer or suggesting the use of checklists such as CONSORT or STARD to clinical reviewers or both. Methodology and Principal Findings Interventions were defined as 1) the addition of a statistical reviewer to the clinical peer review process, and 2) suggesting reporting guidelines to reviewers; with “no statistical expert” and “no checklist” as controls. The two interventions were crossed in a 2×2 balanced factorial design including original research articles consecutively selected, between May 2004 and March 2005, by the Medicina Clinica (Barc) editorial committee. We randomized manuscripts to minimize differences in terms of baseline quality and type of study (intervention, longitudinal, cross-sectional, others). Sample-size calculations indicated that 100 papers provide an 80% power to test a 55% standardized difference. We specified the main outcome as the increment in quality of papers as measured on the Goodman Scale. Two blinded evaluators rated the quality of manuscripts at initial submission and final post peer review version. Of the 327 manuscripts submitted to the journal, 131 were accepted for further review, and 129 were randomized. Of those, 14 that were lost to follow-up showed no differences in initial quality to the followed-up papers. Hence, 115 were included in the main analysis, with 16 rejected for publication after peer review. 21 (18.3%) of the 115 included papers were interventions, 46 (40.0%) were longitudinal designs, 28 (24.3%) cross-sectional and 20 (17.4%) others. The 16 (13.9%) rejected papers had a significantly lower initial score on the overall Goodman scale than accepted papers (difference 15.0, 95% CI: 4.6–24.4). The effect of suggesting a guideline to the reviewers had no effect on change in overall quality as measured by the Goodman scale (0.9, 95% CI: −0.3–+2.1). The estimated effect of adding a statistical reviewer was 5.5 (95% CI: 4.3–6.7), showing a significant improvement in quality. Conclusions and Significance This prospective randomized study shows the positive effect of adding a statistical reviewer to the field-expert peers in improving manuscript quality. We did not find a statistically significant positive effect by suggesting reviewers use reporting guidelines. PMID:17389922
Calanzani, Natalia; Weller, David; Campbell, Christine
2017-01-01
Introduction The increasing burden of cancer morbidity and mortality has led to the development of national health initiatives to promote earlier cancer diagnosis and improve cancer survival. This protocol describes a systematic review aiming to identify the evidence about such initiatives among the adult population. We will describe their components, stakeholders and target populations, and summarise their outcomes. Methods and analysis We will search databases and websites for peer-reviewed publications and grey literature on national health initiatives in high-income countries as defined by the World Bank. Quantitative, qualitative and mixed-methods studies will be included and assessed for their methodological quality. Study selection, quality assessment and data extraction will be carried out independently by two reviewers. Narrative synthesis will be used to analyse the findings. Ethics and dissemination This systematic review analyses secondary data and ethical approval is not required. Review findings will be helpful to researchers, policy makers, governments and other key stakeholders developing similar initiatives and assessing cancer outcomes. The results will be submitted to a peer-reviewed journal in order to reach a diverse group of healthcare professionals, researchers and policy makers. This systematic review protocol is registered at PROSPERO (CRD42016047233). PMID:28698336
Fikes, James D; Patrick, Daniel J; Francke, Sabine; Frazier, Kendall S; Reindel, James F; Romeike, Annette; Spaet, Robert H; Tomlinson, Lindsay; Schafer, Kenneth A
2015-10-01
In 2014, the Organisation for Economic Co-operation and Development (OECD) issued guidance no. 16, Guidance on the GLP Requirements for Peer Review of Histopathology. The stated purpose of the guidance document is "to provide guidance to pathologists, test facility management, study directors and quality assurance personnel on how the peer review of histopathology should be planned, managed, documented, and reported in order to meet Good Laboratory Practice (GLP) expectations and requirements." On behalf of and in collaboration with the global societies of toxicologic pathology, the Society of Toxicologic Pathology initiated a review of OECD guidance no. 16. The objectives of this review are to provide a unified interpretation of the guidance, to recommend compliant processes for organizations to implement, and to avoid inconsistent process adaptations across the industry. This review of the guidance document is the product of a global collaboration with other societies of toxicologic pathology and provides a section-by-section international consensus view and interpretation of the OECD guidance on peer review. © 2015 by The Author(s).
Griffiths, Louise; Bailey, Di
2015-01-01
The purpose of this paper is to critically evaluate the current evidence for peer support in prisons, in particular its contribution to working with prisoners who self-injure and the extent to which the success of peer support schemes such as the prison listeners, hinges upon staff's willingness to engage with the initiative. The review was constructed by using primary and secondary terms to search the literature. The studies focused on peer support in custody with reference to mental health and self-injury. Searches identified papers on the prison listener scheme and staff perspectives on prison peer support, as these formed a central focus of the review. Studies were excluded from the review if the participants' behaviours was explicitly linked to suicidal intent, as the review focused on self-injury as a coping strategy. A total of 24 studies were selected according to specific inclusion criteria (six were grey literature, 18 academic literature). Of the 24 studies ten studies focused on peer support and self-injury. Of the 24 studies the listener scheme was the focus of 16 studies, of these 16 studies self-injury and the listener scheme was a focus of eight studies. Evidence from the review suggests that prison peer support could be considered on a continuum depending on the different degrees of peer involvement.
Calibrated peer review assignments for the earth sciences
Rudd, J.A.; Wang, V.Z.; Cervato, C.; Ridky, R.W.
2009-01-01
Calibrated Peer Review ??? (CPR), a web-based instructional tool developed as part of the National Science Foundation reform initiatives in undergraduate science education, allows instructors to incorporate multiple writing assignments in large courses without overwhelming the instructor. This study reports successful implementation of CPR in a large, introductory geology course and student learning of geoscience content. For each CPR assignment in this study, students studied web-based and paper resources, wrote an essay, and reviewed seven essays (three from the instructor, three from peers, and their own) on the topic. Although many students expressed negative attitudes and concerns, particularly about the peer review process of this innovative instructional approach, they also recognized the learning potential of completing CPR assignments. Comparing instruction on earthquakes and plate boundaries using a CPR assignment vs. an instructional video lecture and homework essay with extensive instructor feedback, students mastered more content via CPR instruction.
Testing the Rebound Peer Review Concept
Choi, Augustine M.K.
2013-01-01
Abstract This invited editorial addresses the rescue of the article by Skrzypek et al. “Interplay between heme oxygenase-1 and miR-378 affects non-small cell lung carcinoma growth, vascularization, and metastasis.” The work was rejected by the standard peer review system and subsequently rescued by the Rebound Peer Review (RPR) mechanism offered by Antioxidants and Redox Signaling (Antioxid Redox Signal 16: 293–296, 2012). The reviewers who openly rescued the article were James F. George, Justin C. Mason, Mahin D. Maines, and Yasufumi Sato. The initial article was a de novo resubmission of a previously rejected article, which was then reviewed by six reviewers. The reviewers raised substantial scientific concerns, including questions pertaining to the specificity of the findings, quality of the presentation, and other technical concerns; the editor returned a decision of reject. The authors voluntarily chose to exercise the option to rescue the article utilizing the RPR system, where the authors found qualified reviewers who were willing to advocate for acceptance with scientific reasoning. The open reviewers felt that the scientific and technical concerns raised by the reviewers were outweighed by the strengths and novelty of the findings to justify acceptance. The RPR, in this case, was a “success” in that it rescued a rejected article. Despite this assessment, we question the necessity of open peer review as a means to overturn a peer review decision, with concerns for the larger-than-usual peer review process, and the voluntary relinquishing of editorial privilege and disclosure of reviewer identity. Antioxid. Redox Signal. 19, 639–643. PMID:23725371
Programmatic and teaching initiatives for ethnically diverse nursing students: a literature review.
Torregosa, Marivic B; Morin, Karen H
2012-06-01
The purpose of this study was to examine the evidence of programmatic and teaching initiatives implemented by nursing faculty to enhance the academic success rates of ethnically diverse students (EDS). A search of the literature in the Cumulative Index to Nursing and Allied Health Literature and MEDLINE databases, wherein primary sources about programmatic and teaching initiative to promote academic success among EDS, was conducted. Using specific the Cumulative Index to Nursing and Allied Health Literature subject headings and Medical Subject Headings, 230 articles were retrieved from both databases. A total of 22 peer-reviewed articles published between 2000 and 2011 were included in the literature review. We found that evidence on the predominant programmatic and teaching initiatives for EDS academic success was inconclusive. The most common programmatic and teaching initiatives implemented by nursing faculty were peer mentoring, faculty-student mentoring, social networking, academic support, and financial support. Although positive student outcomes were reported about programmatic and teaching initiatives for EDS, the evidence remained inconclusive. Recommendations for policy and future research in this area of nursing education research were provided. Copyright © 2012. Published by Elsevier B.V.
Radiologist Peer Review by Group Consensus.
Harvey, H Benjamin; Alkasab, Tarik K; Prabhakar, Anand M; Halpern, Elkan F; Rosenthal, Daniel I; Pandharipande, Pari V; Gazelle, G Scott
2016-06-01
The objective of this study was to evaluate the feasibility of the consensus-oriented group review (COGR) method of radiologist peer review within a large subspecialty imaging department. This study was institutional review board approved and HIPAA compliant. Radiologist interpretations of CT, MRI, and ultrasound examinations at a large academic radiology department were subject to peer review using the COGR method from October 2011 through September 2013. Discordance rates and sources of discordance were evaluated on the basis of modality and division, with group differences compared using a χ(2) test. Potential associations between peer review outcomes and the time after the initiation of peer review or the number of radiologists participating in peer review were tested by linear regression analysis and the t test, respectively. A total of 11,222 studies reported by 83 radiologists were peer reviewed using COGR during the two-year study period. The average radiologist participated in 112 peer review conferences and had 3.3% of his or her available CT, MRI and ultrasound studies peer reviewed. The rate of discordance was 2.7% (95% confidence interval [CI], 2.4%-3.0%), with significant differences in discordance rates on the basis of division and modality. Discordance rates were highest for MR (3.4%; 95% CI, 2.8%-4.1%), followed by ultrasound (2.7%; 95% CI, 2.0%-3.4%) and CT (2.4%; 95% CI, 2.0%-2.8%). Missed findings were the most common overall cause for discordance (43.8%; 95% CI, 38.2%-49.4%), followed by interpretive errors (23.5%; 95% CI, 18.8%-28.3%), dictation errors (19.0%; 95% CI, 14.6%-23.4%), and recommendation (10.8%; 95% CI, 7.3%-14.3%). Discordant cases, compared with concordant cases, were associated with a significantly greater number of radiologists participating in the peer review process (5.9 vs 4.7 participating radiologists, P < .001) and were significantly more likely to lead to an addendum (62.9% vs 2.7%, P < .0001). COGR permits departments to collect highly contextualized peer review data to better elucidate sources of error in diagnostic imaging reports, while reviewing a sufficient case volume to comply with external standards for ongoing performance review. Copyright © 2016 American College of Radiology. Published by Elsevier Inc. All rights reserved.
Does Peer Review of Radiation Plans Affect Clinical Care? A Systematic Review of the Literature
DOE Office of Scientific and Technical Information (OSTI.GOV)
Brunskill, Kelsey; Nguyen, Timothy K.; Boldt, R. Gabriel
Purpose: Peer review is a recommended component of quality assurance in radiation oncology; however, it is resource-intensive and its effect on patient care is not well understood. We conducted a systematic review of the published data to assess the reported clinical impact of peer review on radiation treatment plans. Methods and Materials: A systematic review of published English studies was performed in accordance with the PRISMA guidelines using the MEDLINE and EMBASE databases and abstracts published from major radiation oncology scientific meeting proceedings. For inclusion, the studies were required to report the effect of peer review on ≥1 element ofmore » treatment planning (eg, target volume or organ-at-risk delineation, dose prescription or dosimetry). Results: The initial search strategy identified 882 potentially eligible studies, with 11 meeting the inclusion criteria for full-text review and final analysis. Across a total of 11,491 patient cases, peer review programs led to modifications in a weighted mean of 10.8% of radiation treatment plans. Five studies differentiated between major and minor changes and reported weighted mean rates of change of 1.8% and 7.3%, respectively. The most common changes were related to target volume delineation (45.2% of changed plans), dose prescription or written directives (24.4%), and non-target volume delineation or normal tissue sparing (7.5%). Conclusions: Our findings suggest that peer review leads to changes in clinical care in approximately 1 of every 9 cases overall. This is similar to the reported rates of change in peer review studies from other oncology-related specialties, such as radiology and pathology.« less
Does Peer Review of Radiation Plans Affect Clinical Care? A Systematic Review of the Literature.
Brunskill, Kelsey; Nguyen, Timothy K; Boldt, R Gabriel; Louie, Alexander V; Warner, Andrew; Marks, Lawrence B; Palma, David A
2017-01-01
Peer review is a recommended component of quality assurance in radiation oncology; however, it is resource-intensive and its effect on patient care is not well understood. We conducted a systematic review of the published data to assess the reported clinical impact of peer review on radiation treatment plans. A systematic review of published English studies was performed in accordance with the PRISMA guidelines using the MEDLINE and EMBASE databases and abstracts published from major radiation oncology scientific meeting proceedings. For inclusion, the studies were required to report the effect of peer review on ≥1 element of treatment planning (eg, target volume or organ-at-risk delineation, dose prescription or dosimetry). The initial search strategy identified 882 potentially eligible studies, with 11 meeting the inclusion criteria for full-text review and final analysis. Across a total of 11,491 patient cases, peer review programs led to modifications in a weighted mean of 10.8% of radiation treatment plans. Five studies differentiated between major and minor changes and reported weighted mean rates of change of 1.8% and 7.3%, respectively. The most common changes were related to target volume delineation (45.2% of changed plans), dose prescription or written directives (24.4%), and non-target volume delineation or normal tissue sparing (7.5%). Our findings suggest that peer review leads to changes in clinical care in approximately 1 of every 9 cases overall. This is similar to the reported rates of change in peer review studies from other oncology-related specialties, such as radiology and pathology. Copyright © 2016 Elsevier Inc. All rights reserved.
Variability of Reviewers' Comments in the Peer Review Process for Orthopaedic Research.
Iantorno, Stephanie E; Andras, Lindsay M; Skaggs, David L
2016-07-01
Retrospective analysis of peer review comments. To assess the likelihood that comments provided by peer reviewers of one orthopaedic journal would be similar to comments of reviewers from the same journal and a second journal. The consistency of the peer review process in orthopedic research has not been objectively examined. Nine separate clinical papers related to spinal deformity were submitted for publication in major peer-reviewed journals and initially rejected. The exact same manuscripts were then submitted to different journals. All papers were returned with comments from two to three reviewers from each journal. Reviews were divided into distinct conceptual criticisms that were regarded as separate comments. Comments were compared between reviewers of the same journal and to comments from reviewers of the second journal. When comparing comments from reviewers of the same journal, an average of 11% of comments were repeated (range 0% [0/12] to 23% [3/13]). On average, 20% of comments from the first journal were repeated by a reviewer at the second journal (range 10% [1/10] to 33% [6/18]). If a comment was made by two or more reviewers from the first journal, it had a higher likelihood (43% [6/14]) of being repeated by a reviewer from the second journal. When an identical manuscript is submitted to a second journal after being rejected, 80% of peer review comments from the first journal are not repeated by reviewers from the second journal. One may question if addressing every peer review comment in a rejected manuscript prior to resubmission is an efficient use of resources. Comments that appear twice or more in the first journal review are more likely to reappear and may warrant special attention from the researcher. Level IV. Copyright © 2016 Scoliosis Research Society. Published by Elsevier Inc. All rights reserved.
NASA Astrophysics Data System (ADS)
Mayernik, M. S.; Daniels, M.; Eaker, C.; Strand, G.; Williams, S. F.; Worley, S. J.
2012-12-01
Data sets exist within scientific research and knowledge networks as both technical and non-technical entities. Establishing the quality of data sets is a multi-faceted task that encompasses many automated and manual processes. Data sets have always been essential for science research, but now need to be more visible as first-class scholarly objects at national, international, and local levels. Many initiatives are establishing procedures to publish and curate data sets, as well as to promote professional rewards for researchers that collect, create, manage, and preserve data sets. Traditionally, research quality has been assessed by peer review of textual publications, e.g. journal articles, conference proceedings, and books. Citation indices then provide standard measures of productivity used to reward individuals for their peer-reviewed work. Whether a similar peer review process is appropriate for assessing and ensuring the quality of data sets remains as an open question. How does the traditional process of peer review apply to data sets? This presentation will describe current work being done at the National Center for Atmospheric Research (NCAR) in the context of the Peer REview for Publication & Accreditation of Research Data in the Earth sciences (PREPARDE) project. PREPARDE is assessing practices and processes for data peer review, with the goal of developing recommendations. NCAR data management teams perform various kinds of quality assessment and review of data sets prior to making them publicly available. The poster will investigate how notions of peer review relate to the types of data review already in place at NCAR. We highlight the data set characteristics and management/archiving processes that challenge the traditional peer review processes by using a number of questions as probes, including: Who is qualified to review data sets? What formal and informal documentation is necessary to allow someone outside of a research team to review a data set? What data set review can be done pre-publication, and what must be done post-publication? What components of the data sets review processes can be automated, and what components will always require human expertise and evaluation?
Trotman, Judith; Trinh, Jimmy; Kwan, Yiu Lam; Estell, Jane A; Fletcher, Julie; Archer, Kate; Lee, Kenneth; Foo, Kerwin; Curnow, Jennifer; Bianchi, Alessandra; Wignall, Lynda; Verner, Emma; Gasiorowski, Robin; Siedlecka, Elizabeth; Cunningham, Ilona
2017-05-01
Multidisciplinary team (MDT) meetings aimed at facilitating peer review have become standard practice in oncology. However, there is scant literature on the optimal structure and conduct of such meetings. To develop a process for formal peer review of patients with haematological malignancies and to audit any resulting changes made to the management recommendations of the treating physician. A standard operating procedure (SOP) for MDT meetings was developed essentially to integrate clinical peer review with weekly pathology and radiology meetings. The centrepiece is the electronic submission of a patient-specific proforma (Microsoft InfoPath) prior to the meeting. It serves as the template for presentation, discussion and recording of recommendations and conclusions. The final verified document is stored in the electronic patient record, and a copy is sent to the general practitioner. The proposed management plans were compared to the consensus recommendations of the meeting for the first 4 years since inception. Both SOP and proforma underwent continual improvements. These provided the framework for the conduct of a robust weekly MDT meeting for peer review of the management of patients with haematological malignancies. On 20% of occasions, patient management plans were altered to optimise patient care as a direct consequence on peer review at the MDT. Our streamlined process, in its ultimate format, has provided a mature and efficient forum for formal peer review in a genuine multidisciplinary environment. Both initial data and informal feedback support its ongoing activity as an integral component of delivering quality patient care. © 2016 Royal Australasian College of Physicians.
Gabriel, Peter E; Woodhouse, Kristina D; Lin, Alexander; Finlay, Jarod C; Young, Richard B; Volz, Edna; Hahn, Stephen M; Metz, James M; Maity, Amit
Assuring quality in cancer care through peer review has become increasingly important in radiation oncology. In 2012, our department implemented an automated electronic system for managing radiation treatment plan peer review. The purpose of this study was to compare the overall impact of this electronic system to our previous manual, paper-based system. In an effort to improve management, an automated electronic system for case finding and documentation of review was developed and implemented. The rates of missed initial reviews, late reviews, and missed re-reviews were compared for the pre- versus postelectronic system cohorts using Pearson χ 2 test and relative risk. Major and minor changes or recommendations were documented and shared with the assigned clinical provider. The overall rate of missed reviews was 7.6% (38/500) before system implementation versus 0.4% (28/6985) under the electronic system (P < .001). In terms of relative risk, courses were 19.0 times (95% confidence interval, 11.8-30.7) more likely to be missed for initial review before the automated system. Missed re-reviews occurred in 23.1% (3/13) of courses in the preelectronic system cohort and 6.6% (10/152) of courses in the postelectronic system cohort (P = .034). Late reviews were more frequent during high travel or major holiday periods. Major changes were recommended in 2.2% and 2.8% in the pre- versus postelectronic systems, respectively. Minor changes were recommended in 5.3% of all postelectronic cases. The implementation of an automated electronic system for managing peer review in a large, complex department was effective in significantly reducing the number of missed reviews and missed re-reviews when compared to our previous manual system. Copyright © 2016 American Society for Radiation Oncology. Published by Elsevier Inc. All rights reserved.
7 CFR 3411.14 - Proposal review.
Code of Federal Regulations, 2011 CFR
2011-01-01
... 7 Agriculture 15 2011-01-01 2011-01-01 false Proposal review. 3411.14 Section 3411.14 Agriculture Regulations of the Department of Agriculture (Continued) NATIONAL INSTITUTE OF FOOD AND AGRICULTURE NATIONAL RESEARCH INITIATIVE COMPETITIVE GRANTS PROGRAM Scientific Peer Review of Research Grant Applications § 3411...
Emerging trends in peer review—a survey
Walker, Richard; Rocha da Silva, Pascal
2015-01-01
“Classical peer review” has been subject to intense criticism for slowing down the publication process, bias against specific categories of paper and author, unreliability, inability to detect errors and fraud, unethical practices, and the lack of recognition for unpaid reviewers. This paper surveys innovative forms of peer review that attempt to address these issues. Based on an initial literature review, we construct a sample of 82 channels of scientific communication covering all forms of review identified by the survey, and analyze the review mechanisms used by each channel. We identify two major trends: the rapidly expanding role of preprint servers (e.g., ArXiv) that dispense with traditional peer review altogether, and the growth of “non-selective review,” focusing on papers' scientific quality rather than their perceived importance and novelty. Other potentially important developments include forms of “open review,” which remove reviewer anonymity, and interactive review, as well as new mechanisms for post-publication review and out-of-channel reader commentary, especially critical commentary targeting high profile papers. One of the strongest findings of the survey is the persistence of major differences between the peer review processes used by different disciplines. None of these differences is likely to disappear in the foreseeable future. The most likely scenario for the coming years is thus continued diversification, in which different review mechanisms serve different author, reader, and publisher needs. Relatively little is known about the impact of these innovations on the problems they address. These are important questions for future quantitative research. PMID:26074753
ERIC Educational Resources Information Center
Giacumo, Lisa A.; Breman, Jeroen
2016-01-01
This article provides a systematic literature review about nonprofit and for-profit organizations using "big data" to inform performance improvement initiatives. The review of literature resulted in 4 peer-reviewed articles and an additional 33 studies covering the topic for these contexts. The review found that big data and analytics…
The privilege and burden of peer review.
Blume, Arthur W; Schmaling, Karen B
2016-01-01
Peer review is a core value and method of quality control in psychological research, academic psychology, and other disciplines, but little is known about the peer-reviewing behavior of ethnic minority reviewers in particular. The purpose of this study was to examine the self-identified ethnicity of those invited to peer review articles for 76 journals that utilized the American Psychological Association's Journals Back Office (JBO) system from 2003 to 2012. It was hypothesized that a modest increase in the ratio of requests for reviews from self-identified ethnic minority reviewers would be observed over time, that self-identified ethnic minority reviewers would be less likely to refuse a review request than those who do not self-identify as an ethnic minority, and finally that increases in reviewer burden would be evident in significant increases in declines to requests by all reviewers. Reviewer requests and responses were examined among the 76 journals that used the JBO system over a 10-year period. Using hierarchical linear models, the percentage of review invitations extended to ethnic minorities was found to significantly increase over time: Initially, an estimated 8.34% of review requests were made to ethnic minority reviewers, and that percentage increased an average of 0.41% per year. Ethnic minority reviewers were significantly less likely to refuse a review request than ethnic majority reviewers. Results are discussed in terms of perceived pressure to demonstrate scholastic impact and the disproportionate service burden often borne by ethnic minority psychologists. (c) 2016 APA, all rights reserved).
7 CFR 3411.14 - Proposal review.
Code of Federal Regulations, 2010 CFR
2010-01-01
... 7 Agriculture 15 2010-01-01 2010-01-01 false Proposal review. 3411.14 Section 3411.14 Agriculture Regulations of the Department of Agriculture (Continued) COOPERATIVE STATE RESEARCH, EDUCATION, AND EXTENSION SERVICE, DEPARTMENT OF AGRICULTURE NATIONAL RESEARCH INITIATIVE COMPETITIVE GRANTS PROGRAM Scientific Peer...
Lee, Ping-Tzu; Dakin, Emily; McLure, Merinda
2016-05-01
Equine-assisted psychotherapy (EAP) is an innovative emerging approach to mental health treatment. This narrative synthesis explores the current state of knowledge and areas for future research in EAP. Specifically reviewed are qualitative and quantitative empirical studies, including both articles published in peer-reviewed journals and research presented in theses and dissertations. We selected 24 studies for final inclusion in this study, dating between 2005 and 2013, and including the first EAP empirical research completed in 2005. Four of these studies are peer-reviewed journal articles, while 20 are master's theses or doctoral dissertations. The reviewed qualitative research provides initial evidence for the value of EAP for enhancing adolescents' communication and relationship skills. The reviewed experimental and quasi-experimental research provides initial evidence for the value of EAP for enhancing children's and adolescents' emotional, social and behavioural functioning. Yet, conclusions about the effectiveness of EAP must still be considered preliminary due to various methodological limitations in the reviewed research. The narrative review describes these methodological limitations and concludes with recommendations for future research. © 2015 John Wiley & Sons Ltd.
Greer, Alissa M; Luchenski, Serena A; Amlani, Ashraf A; Lacroix, Katie; Burmeister, Charlene; Buxton, Jane A
2016-05-27
Engaging people with drug use experience, or 'peers,' in decision-making helps to ensure harm reduction services reflect current need. There is little published on the implementation, evaluation, and effectiveness of meaningful peer engagement. This paper aims to describe and evaluate peer engagement in British Columbia from 2010-2014. A process evaluation framework specific to peer engagement was developed and used to assess progress made, lessons learned, and future opportunities under four domains: supportive environment, equitable participation, capacity building and empowerment, and improved programming and policy. The evaluation was conducted by reviewing primary and secondary qualitative data including focus groups, formal documents, and meeting minutes. Peer engagement was an iterative process that increased and improved over time as a consequence of reflexive learning. Practical ways to develop trust, redress power imbalances, and improve relationships were crosscutting themes. Lack of support, coordination, and building on existing capacity were factors that could undermine peer engagement. Peers involved across the province reviewed and provided feedback on these results. Recommendations from this evaluation can be applied to other peer engagement initiatives in decision-making settings to improve relationships between peers and professionals and to ensure programs and policies are relevant and equitable.
Salvatori, Penny; Simonavicius, Nijole; Moore, Joan; Rimmer, Georgina; Patterson, Michele
2008-02-01
Program management models have raised concerns among occupational therapists about professional standards related to clinical competence, performance review procedures, and quality improvement initiatives. This paper describes how a chart-stimulated recall (CSR) peer-review process and interview tool was revised, implemented, and evaluated as a pilot project to assess the clinical competence of occupational therapy staff at a large urban health centre in southern Ontario. Fourteen pairs (n=28) of occupational therapists representing various practice areas participated in this project. Half served as peer assessors and half as interviewees. Peer assessors conducted an independent chart review followed by a one-hour personal interview with a peer partner to discuss clinical management issues related to the client cases. Each interviewer rated his or her partner's clinical competence in eight areas of performance using a 7-point Likert scale. Results indicated that the CSR tool could discriminate among occupational therapists in terms of overall levels of clinical competence and also identify specific areas of concern that could be targeted for professional development. Feedback from participants was positive. The CSR tool was found to be useful for assessing clinical competence of occupational therapists in this large health centre as a quality improvement initiative within that discipline group. Further research is needed to establish the reliability and validity of the CSR tool.
2016-01-01
The Peer Reviewers' Openness Initiative (PROI) is a move to enlist reviewers in the promotion of data-sharing. In this commentary, I discuss objections that can be raised, first to the specific proposals in the PROI, and second to data-sharing in general. I argue that although many objections have strong counter-arguments, others merit more serious consideration. Regarding the PROI, I suggest that it could backfire if editors and authors feel coerced into data-sharing and so may not be the most pragmatic way of encouraging greater openness. More generally, while promoting data-sharing, we need to be sensitive to cases where sharing of data from human participants could create ethical problems. Furthermore, those interested in promoting reproducible science need to defend against an increased risk of data-dredging when large, multivariable datasets are shared. I end with some suggestions to avoid these unintended consequences. PMID:27152225
A digital peer-to-peer learning platform for clinical skills development.
Basnak, Jesse; Ortynski, Jennifer; Chow, Meghan; Nzekwu, Emeka
2017-02-01
Due to constraints in time and resources, medical curricula may not provide adequate opportunities for pre-clerkship students to practice clinical skills. To address this, medical students at the University of Alberta developed a digital peer-to-peer learning initiative. The initiative assessed if students can learn clinical skills from their peers in co-curricular practice objective structured clinical exams (OSCEs). A total of 144 first-year medical students participated. Students wrote case scenarios that were reviewed by physicians. Students enacted the cases in practice OSCEs, acting as the patient, physician, and evaluator. Verbal and electronic evaluations were completed. A digital platform was used to automate the process. Surveys were disseminated to assess student perceptions of their experience. Seventy-five percent of participants said they needed opportunities to practice patient histories and physical exams in addition to those provided in the medical school curriculum. All participants agreed that the co-curricular practice OSCEs met this need. The majority of participants also agreed that the digital platform was efficient and easy to use. Students found the practice OSCEs and digital platform effective for learning clinical skills. Thus, peer-to-peer learning and computer automation can be useful adjuncts to traditional medical curricula.
Koyama, Momoko; Rai, Sarju Sing; Miyaguchi, Moe; Dhakal, Sumi; Sandy, Su; Sunguya, Bruno Fokas; Jimba, Masamine
2017-01-01
Breastfeeding is associated with reduced mortality in children aged less than 5 years. We conducted a systematic review and meta-analysis (registered as PROSPERO 2015: CRD42015019105) to examine the effectiveness of community-based peer support for mothers on their breastfeeding practices as compared to mothers who have not received such a support. Methods We searched for evidence regarding community-based peer support for mothers in databases, such as PubMed/MEDLINE, the Cochrane Library, CINAHL, Web of Science, SocINDEX, and PsycINFO. We selected three outcome variables for breastfeeding practices, namely, exclusive breastfeeding duration, breastfeeding within the first hour of life, and prelacteal feeding. We conducted meta-analyses of the included randomized controlled trials and quasi-experimental studies. Results For our review, we selected 47 articles for synthesis out of 1,855 retrieved articles. In low- and middle-income countries, compared to usual care, community-based peer support increased exclusive breastfeeding at 3 months (RR: 1.90, 95% CI: 1.62–2.22), at 5 months (RR: 9.55, 95% CI: 6.65–13.70) and at 6 months (RR: 3.53, 95% CI: 2.49–5.00). In high-income countries, compared to usual care, peer support increased exclusive breastfeeding at 3 months (RR: 2.61, 95% CI: 1.15–5.95). In low- and middle-income countries, compared to usual care, peer support increased the initiation of breastfeeding within the first hour of life (RR: 1.51, 95% CI: 1.04–2.21) and decreased the risk of prelacteal feeding (RR: 0.38, 95% CI: 0.33–0.45). Conclusions Community-based peer support for mothers is effective in increasing the duration of exclusive breastfeeding, particularly for infants aged 3–6 months in low- and middle-income countries. Such support also encourages mothers to initiate breastfeeding early and prevents newborn prelacteal feeding. PMID:28510603
DOE Office of Scientific and Technical Information (OSTI.GOV)
None, None
In the spring and summer of 2015, the Bioenergy Technologies Office (BETO or the Office) of the U.S. Department of Energy (DOE) implemented an external peer review of the projects in its research, development and demonstration (RD&D) portfolio. The Office manages a diverse portfolio of technologies across the spectrum of applied RD&D within the dynamic context of changing budgets and Administration priorities. The Office portfolio is organized according to the biomass-to-bioenergy supply chain—from the feedstock source to the end user (see Figure 1)—with major focus on feedstock supply and biomass conversion. The 2015 Project Peer Review took place March 23-27,more » 2015, outside of Washington, D.C., in Alexandria, Virginia, and evaluated most of the publicly funded projects in BETO’s portfolio. The subsequent Program Management Review took place on June 25, 2015, in Washington, D.C., and provided an Office- level assessment of strategic planning and programmatic initiatives. The peer review process enables external stakeholders to provide feedback on the responsible use of taxpayer funding and develop recommendations for the most efficient and effective ways to accelerate the development of an advanced bioenergy industry. The planning and execution of these reviews was completed over the course of 10 months, and this report includes the results of both events.« less
Peer review at the Health Information and Libraries Journal.
Grant, Maria J
2014-12-01
At its best, peer review can mean receiving constructive feedback to help you make the most of your writing. At the Health Information and Libraries Journal, we strive to make the peer review a positive process for both authors and referees. We adopt a process of double-blind peer review. To receive two reviews in a timely manner, three referees are initially invited for each article submitted. The referees are asked to submit their review noting errors, areas of ambiguity or clarification required before the editor and editorial team consider the manuscript ready for publication. As with most journals, it's unlikely that your writing will be accepted in its original form; a typical outcome will be for a recommendation for major or minor revisions. This is good! It means the editorial team has seen something of likely interest to their readership and wants to help you develop it to a publishable standard. There can be a surprising amount of development and change in a manuscript from original submission through to publication. While you may be experienced in your field, you may not have much experience of writing for publication. As a referee, you get an intriguing insight into the shape of manuscripts in their original form. © 2014 The authors. Health Information and Libraries Journal © 2014 Health Libraries Journal.
Lobb, Rebecca; Petermann, Lisa; Manafo, Elizabeth; Keen, Deb; Kerner, Jon
2013-01-01
Funding for transdisciplinary chronic disease prevention research has increased over the past decade. However, few studies have evaluated whether networking and knowledge exchange activities promote the creation of transdisciplinary teams to successfully respond to requests for proposals (RFPs). Such evaluations are critical to understanding how to accelerate the integration of research with practice and policy to improve population health. To examine (1) the extent of participation in pre-RFP activities among funded and nonfunded transdisciplinary coalitions that responded to a RFP for cancer and chronic disease prevention initiatives and (2) levels of agreement in proposal ratings among research, practice, and policy peer reviewers. Descriptive report of a Canadian funding initiative to increase the integration of evidence with action. Four hundred forty-nine representatives in 41 research, practice, and policy coalitions who responded to a RFP and whose proposals were peer reviewed by a transdisciplinary adjudication panel. The funder hosted 6 national meetings and issued a letter of intent (LOI) to foster research, practice, and policy collaborations before issuing a RFP. All provinces and territories in Canada were represented by the coalitions. Funded coalitions were 2.5 times more likely than nonfunded coalitions to submit a LOI. A greater proportion of funded coalitions were exposed to the pre-RFP activities (100%) compared with coalitions that were not funded (68%). Overall research, practice, and policy peer reviewer agreement was low (intraclass correlation 0.12). There is widespread interest in transdisciplinary collaborations to improve cancer and chronic disease prevention. Engagement in networking and knowledge exchange activities, and feedback from LOIs prior to submission of a final application, may contribute to stronger proposals and subsequent funding success. Future evaluations should examine best practices for transdisciplinary peer review to facilitate funding of proposals that on balance have both scientific rigor and are relevant to the real world.
ERIC Educational Resources Information Center
Meekums, Bonnie; Macaskie, Jane; Kapur, Tricia
2016-01-01
The authors conducted a scoping review of the peer-reviewed literature associated with Interpersonal Process Recall (IPR) and Reflecting Team (RT) methods in order to find evidence for their use within skills development in therapist trainings. Inclusion criteria were: empirical research, reviews of empirical research, and responses to these; RT…
Ray, P.; Liaw, S.-T.
2016-01-01
Summary Objectives This paper is a systematic literature review intended to gain an understanding of the most original, excellent, state-of-the-art research in the application of eHealth (including mHealth) in the management of chronic diseases with a focus on cancer over the past two years. Method This review looks at peer-reviewed papers published between 2013 and 2015 and examines the background and trends in this area. It systematically searched peer-reviewed journals in databases PubMed, Proquest, Cochrane Library, Elsevier, Sage and the Institute of Electrical and Electronic Engineers (IEEE Digital Library) using a set of pre-defined keywords. It then employed an iterative process to filter out less relevant publications. Results From an initial search return of 1,519,682 results returned, twenty nine of the most relevant peer reviewed articles were identified as most relevant. Conclusions Based on the results we conclude that innovative eHealth and its subset mHealth initiatives are rapidly emerging as an important means of managing cancer and other chronic diseases. The adoption is following different paths in the developed and developing worlds. Besides governance and regulatory issues, barriers still exist around information management, interoperability and integration. These include medical records available online information for clinicians and consumers on cancer and other chronic diseases, mobile app bundles that can help manage co-morbidities and the capacity of supporting communication technologies. PMID:27830236
Smoking Prevention Program for Children: A Review.
ERIC Educational Resources Information Center
Oei, Tian P. S.; Fea, Annette
1987-01-01
Reviews literature regarding factors associated with children's initiation into smoking and examines efficacy of health education programs in preventing smoking in children. Though using peer leaders as health educators has been successful, parent-implemented health prevention programs aiming at children at younger ages may be more effective in…
77 FR 66852 - Submission for OMB Review; Comment Request; Hazardous Waste Worker Training
Federal Register 2010, 2011, 2012, 2013, 2014
2012-11-07
...; Comment Request; Hazardous Waste Worker Training AGENCY: National Institute of Environmental Health... Sciences (NIEHS) was given major responsibility for initiating a worker safety and health training program... workers and their communities by delivering high-quality, peer-reviewed safety and health curricula to...
Wong, Victoria S S; Strowd, Roy E; Aragón-García, Rebeca; Moon, Yeseon Park; Ford, Blair; Haut, Sheryl R; Kass, Joseph S; London, Zachary N; Mays, MaryAnn; Milligan, Tracey A; Price, Raymond S; Reynolds, Patrick S; Selwa, Linda M; Spencer, David C; Elkind, Mitchell S V
2017-01-01
There is increasing need for peer reviewers as the scientific literature grows. Formal education in biostatistics and research methodology during residency training is lacking. In this pilot study, we addressed these issues by evaluating a novel method of teaching residents about biostatistics and research methodology using peer review of standardized manuscripts. We hypothesized that mentored peer review would improve resident knowledge and perception of these concepts more than non-mentored peer review, while improving review quality. A partially blinded, randomized, controlled multi-center study was performed. Seventy-eight neurology residents from nine US neurology programs were randomized to receive mentoring from a local faculty member or not. Within a year, residents reviewed a baseline manuscript and four subsequent manuscripts, all with introduced errors designed to teach fundamental review concepts. In the mentored group, mentors discussed completed reviews with residents. Primary outcome measure was change in knowledge score between pre- and post-tests, measuring epidemiology and biostatistics knowledge. Secondary outcome measures included level of confidence in the use and interpretation of statistical concepts before and after intervention, and RQI score for baseline and final manuscripts. Sixty-four residents (82%) completed initial review with gradual decline in completion on subsequent reviews. Change in primary outcome, the difference between pre- and post-test knowledge scores, did not differ between mentored (-8.5%) and non-mentored (-13.9%) residents ( p = 0.48). Significant differences in secondary outcomes (using 5-point Likert scale, 5 = strongly agree) included mentored residents reporting enhanced understanding of research methodology (3.69 vs 2.61; p = 0.001), understanding of manuscripts (3.73 vs 2.87; p = 0.006), and application of study results to clinical practice (3.65 vs 2.78; p = 0.005) compared to non-mentored residents. There was no difference between groups in level of interest in peer review (3.00 vs 3.09; p = 0.72) or the quality of manuscript review assessed by the Review Quality Instrument (RQI) (3.25 vs 3.06; p = 0.50). We used mentored peer review of standardized manuscripts to teach biostatistics and research methodology and introduce the peer review process to residents. Though knowledge level did not change, mentored residents had enhanced perception in their abilities to understand research methodology and manuscripts and apply study results to clinical practice.
MacKinney, Erin C; Chun, Robert H; Cassidy, Laura D; Link, T Roxanne; Sulman, Cecille G; Kerschner, Joseph E
2015-03-01
To analyze factors associated with progression of an original scientific presentation at the American Society of Pediatric Otolaryngology (ASPO) Annual Meeting to publication in a peer-reviewed journal. A dataset of presenters was created to enable prospective follow-up to assess early impressions regarding publication success with longer-term publication outcomes. Prior to the Annual ASPO meeting in 2013, a survey consisting of 10 questions was e-mailed to all 59 presenters. Questions were designed to assess presenter expectations on publication, barriers to publishing, and experience in presenting, publishing and clinical practice. A second survey was sent 12 months later to those respondents of the first survey who were amenable to follow-up. Overall, 46 of 59 (78%) presenters responded to the initial survey prior to their ASPO 2013 presentation. Of these, 34 agreed to participate in a longer-term follow-up of their presentation to publication experience. Of these 34, there were 17 who participated in the follow-up survey 1 year later. Just under half of the original respondents were residents (46%). All presenters (100%) planned to re-submit a revised manuscript if initially rejected. However, 35% of follow-up respondents did not make initial submission to a peer-reviewed journal. Results of a descriptive analysis suggest that more experienced researchers expect their submitted manuscript to be accepted for publication within a shorter time frame than those that have published fewer papers. Time was ranked as the greatest barrier to publication (60%) of those surveyed both in the initial prospective survey and for those who did not publish a paper in the follow-up survey (83%). This study suggests a strong desire and expectation of publishing ASPO presentations. Despite this expectation, past research and this data set suggest this expectation often does not materialize. "Time constraints" were the most commonly identified barrier to publication. To enhance dissemination of new findings from ASPO meetings, institutions and individuals should examine methods that facilitate and incentivize publication of findings in peer-reviewed publications. Copyright © 2015 Elsevier Ireland Ltd. All rights reserved.
Portfolios in Preservice Teacher Education: What the Students Say.
ERIC Educational Resources Information Center
Zidon, Margaret
1996-01-01
This study examined preservice teachers' perspectives of a required portfolio construction and review in one course. Interviews, surveys, reflective statements, and videotapes indicated that students initially questioned it, but after review with faculty and peers, they valued what they learned about their own knowledge of content, teaching and…
EPA is initiating a public comment period prior to peer review of the scientific basis supporting the human health hazard and dose-response assessment of ethylene oxide (cancer) that will appear in the Integrated Risk Information System (IRIS) database.
NASA Product Peer Review Process
NASA Technical Reports Server (NTRS)
Jenks, Ken
2009-01-01
This viewgraph presentation describes NASA's product peer review process. The contents include: 1) Inspection/Peer Review at NASA; 2) Reasons for product peer reviews; 3) Different types of peer reviews; and 4) NASA requirements for peer reviews. This presentation also includes a demonstration of an actual product peer review.
Laughter and the Management of Divergent Positions in Peer Review Interactions
Raclaw, Joshua; Ford, Cecilia E.
2017-01-01
In this paper we focus on how participants in peer review interactions use laughter as a resource as they publicly report divergence of evaluative positions, divergence that is typical in the give and take of joint grant evaluation. Using the framework of conversation analysis, we examine the infusion of laughter and multimodal laugh-relevant practices into sequences of talk in meetings of grant reviewers deliberating on the evaluation and scoring of high-level scientific grant applications. We focus on a recurrent sequence in these meetings, what we call the score-reporting sequence, in which the assigned reviewers first announce the preliminary scores they have assigned to the grant. We demonstrate that such sequences are routine sites for the use of laugh practices to navigate the initial moments in which divergence of opinion is made explicit. In the context of meetings convened for the purposes of peer review, laughter thus serves as a valuable resource for managing the socially delicate but institutionally required reporting of divergence and disagreement that is endemic to meetings where these types of evaluative tasks are a focal activity. PMID:29170594
7 CFR 3411.13 - Availability of information.
Code of Federal Regulations, 2011 CFR
2011-01-01
... AGRICULTURE NATIONAL RESEARCH INITIATIVE COMPETITIVE GRANTS PROGRAM Scientific Peer Review of Research Grant... available to the extent permitted under the Freedom of Information Act (5 U.S.C. 552), the Privacy Act (5 U...
How to Write a Scholarly Book Review for Publication in a Peer-Reviewed Journal
Lee, Alexander D.; Green, Bart N.; Johnson, Claire D.; Nyquist, Julie
2010-01-01
Purpose: To describe and discuss the processes used to write scholarly book reviews for publication in peer-reviewed journals and to provide a recommended strategy and book appraisal worksheet to use when conducting book reviews. Methods: A literature search of MEDLINE, EMBASE, CINAHL, and the Index to Chiropractic Literature was conducted in June 2009 using a combination of controlled vocabulary and truncated text words to capture articles relevant to writing scholarly book reviews for publication in peer-reviewed journals. Results: The initial search identified 839 citations. Following the removal of duplicates and the application of selection criteria, a total of 78 articles were included in this review including narrative commentaries (n = 26), editorials or journal announcements (n = 25), original research (n = 18), and journal correspondence pieces (n = 9). Discussion: Recommendations for planning and writing an objective and quality book review are presented based on the evidence gleaned from the articles reviewed and from the authors' experiences. A worksheet for conducting a book review is provided. Conclusions: The scholarly book review serves many purposes and has the potential to be an influential literary form. The process of publishing a successful scholarly book review requires the reviewer to appreciate the book review publication process and to be aware of the skills and strategies involved in writing a successful review. PMID:20480015
Transformational Leadership and Organizational Change during Agile and DevOps Initiatives
ERIC Educational Resources Information Center
Mayner, Stephen W.
2017-01-01
Organizational change initiatives are more likely to fail than to succeed, especially when the change challenges corporate culture and norms. Researchers have explored factors that contribute to change failure, to include the relationship between leadership behaviors and change success. Peer reviewed studies have yet to examine these variables in…
Bruce, Rachel; Chauvin, Anthony; Trinquart, Ludovic; Ravaud, Philippe; Boutron, Isabelle
2016-06-10
The peer review process is a cornerstone of biomedical research. We aimed to evaluate the impact of interventions to improve the quality of peer review for biomedical publications. We performed a systematic review and meta-analysis. We searched CENTRAL, MEDLINE (PubMed), Embase, Cochrane Database of Systematic Reviews, and WHO ICTRP databases, for all randomized controlled trials (RCTs) evaluating the impact of interventions to improve the quality of peer review for biomedical publications. We selected 22 reports of randomized controlled trials, for 25 comparisons evaluating training interventions (n = 5), the addition of a statistical peer reviewer (n = 2), use of a checklist (n = 2), open peer review (i.e., peer reviewers informed that their identity would be revealed; n = 7), blinded peer review (i.e., peer reviewers blinded to author names and affiliation; n = 6) and other interventions to increase the speed of the peer review process (n = 3). Results from only seven RCTs were published since 2004. As compared with the standard peer review process, training did not improve the quality of the peer review report and use of a checklist did not improve the quality of the final manuscript. Adding a statistical peer review improved the quality of the final manuscript (standardized mean difference (SMD), 0.58; 95 % CI, 0.19 to 0.98). Open peer review improved the quality of the peer review report (SMD, 0.14; 95 % CI, 0.05 to 0.24), did not affect the time peer reviewers spent on the peer review (mean difference, 0.18; 95 % CI, -0.06 to 0.43), and decreased the rate of rejection (odds ratio, 0.56; 95 % CI, 0.33 to 0.94). Blinded peer review did not affect the quality of the peer review report or rejection rate. Interventions to increase the speed of the peer review process were too heterogeneous to allow for pooling the results. Despite the essential role of peer review, only a few interventions have been assessed in randomized controlled trials. Evidence-based peer review needs to be developed in biomedical journals.
Singh, S K; Enzhong, L; Reidpath, D D; Allotey, P
2017-03-01
To explore the initiating factors of waterpipe tobacco smoking (WTS) among youth. The analytic framework for this scoping review was performed using the methodology outlined by Arksey and O'Malley, which includes identification of the research question, study selection, charting the data, collating, summarizing and reporting the results that were primarily guided by the research question; 'what is known about the initiation of shisha smoking among youth?' Electronic databases such as Cochrane, MEDLINE and PsycINFO were used to search for relevant articles. Articles included were all in English and published within the year of 2006 to 2015. Inclusion criteria; i) age range of 10 to 29 years; ii) examined the reasons why youth started or tried WTS; iii) in full text. Therefore, 26 articles were included in this scoping review. This review has identified and classified the initiating factors of WTS among youth in four subtopics: individual factors, interpersonal influences, cigarettes and alcohol use, and media influences. Individual factors and interpersonal influences played an important role in initiation factors of WTS among youth. This study concludes that public health professionals within the Southeast Asia region need to promote innovative preventive measures through peer-to-peer led interventions that are also easily assessable on social media platforms. The public health messages need to address the misconceptions of risk associated to WTS use. Copyright © 2016 The Royal Society for Public Health. Published by Elsevier Ltd. All rights reserved.
28 CFR 34.109 - Qualifications of peer reviewers.
Code of Federal Regulations, 2010 CFR
2010-07-01
... Section 34.109 Judicial Administration DEPARTMENT OF JUSTICE OJJDP COMPETITION AND PEER REVIEW PROCEDURES Peer Review § 34.109 Qualifications of peer reviewers. The general reviewer qualification criteria to...). Additional details concerning peer reviewer qualifications are provided in the OJJDP “Peer Review Guideline”. ...
NASA Astrophysics Data System (ADS)
Johnson, D.; Ruzek, M.; Weatherley, J.
2001-05-01
The Journal of Earth System Science Education is a new interdisciplinary electronic journal aiming to foster the study of the Earth as a system and promote the development and exchange of interdisciplinary learning resources for formal and informal education. JESSE will serve educators and students by publishing and providing ready electronic access to Earth system and global change science learning resources for the classroom and will provide authors and creators with professional recognition through publication in a peer reviewed journal. JESSE resources foster a world perspective by emphasizing interdisciplinary studies and bridging disciplines in the context of the Earth system. The Journal will publish a wide ranging variety of electronic content, with minimal constraints on format, targeting undergraduate educators and students as the principal readership, expanding to a middle and high school audience as the journal matures. JESSE aims for rapid review and turn-around of resources to be published, with a goal of 12 weeks from submission to publication for resources requiring few changes. Initial publication will be on a quarterly basis until a flow of resource submissions is established to warrant continuous electronic publication. JESSE employs an open peer review process in which authors and reviewers discuss directly the acceptability of a resource for publication using a software tool called the Digital Document Discourse Environment. Reviewer comments and attribution will be available with the resource upon acceptance for publication. JESSE will also implement a moderated peer commentary capability where readers can comment on the use of a resource or make suggestions. In the development phase, JESSE will also conduct a parallel anonymous review of content to validate and ensure credibility of the open review approach. Copyright of materials submitted remains with the author, granting JESSE the non-exclusive right to maintain a copy of the resource published on the JESSE web server, ensuring long term access to the resource as reviewed. JESSE is collaborating with the Digital Library for Earth System Education (DLESE) as a federated partner. Initial release is planned for Summer, 2001.
The social ecology of adolescent-initiated parent abuse: a review of the literature.
Hong, Jun Sung; Kral, Michael J; Espelage, Dorothy L; Allen-Meares, Paula
2012-06-01
This article provides an ecological framework for understanding adolescent-initiated parent abuse. We review research on adolescent-initiated parent abuse, identifying sociodemographic characteristics of perpetrators and victims (e.g., gender, age, race/ethnicity, and socioeconomic status [SES]). Bronfenbrenner's [1] ecological systems theory is applied, which examines the risk and protective factors for adolescent-initiated parent abuse within micro- (maltreatment, domestic violence, parenting behavior and disciplinary strategies), meso- (peer influence), exo- (media influence), macro- (gender role socialization), and chronosystem (change in family structure) levels. Findings from our review suggest that older and White children are significantly more likely to abuse their parents. Females are selective in the target of their aggression, while males target family members in general. Mothers are significantly more likely to be abused than fathers. However, researchers also report variations in the association between SES and parent abuse. Domestic violence and child maltreatment are risk factors, while findings on parenting behavior and disciplinary strategies are mixed. Peer influence, exposure to media violence, gender role socialization, and change in family structure can potentially increase the risk of parent abuse. Practice and research implications are also discussed. An ecological systems framework allows for an examination of how various contexts interact and influence parent abuse behavior, and can provide needed directions for further research.
Callaham, Michael; John, Leslie K
2018-01-05
We define a minimally important difference for the Likert-type scores frequently used in scientific peer review (similar to existing minimally important differences for scores in clinical medicine). The magnitude of score change required to change editorial decisions has not been studied, to our knowledge. Experienced editors at a journal in the top 6% by impact factor were asked how large a change of rating in "overall desirability for publication" was required to trigger a change in their initial decision on an article. Minimally important differences were assessed twice for each editor: once assessing the rating change required to shift the editor away from an initial decision to accept, and the other assessing the magnitude required to shift away from an initial rejection decision. Forty-one editors completed the survey (89% response rate). In the acceptance frame, the median minimally important difference was 0.4 points on a scale of 1 to 5. Editors required a greater rating change to shift from an initial rejection decision; in the rejection frame, the median minimally important difference was 1.2 points. Within each frame, there was considerable heterogeneity: in the acceptance frame, 38% of editors did not change their decision within the maximum available range; in the rejection frame, 51% did not. To our knowledge, this is the first study to determine the minimally important difference for Likert-type ratings of research article quality, or in fact any nonclinical scientific assessment variable. Our findings may be useful for future research assessing whether changes to the peer review process produce clinically meaningful differences in editorial decisionmaking. Copyright © 2017 American College of Emergency Physicians. Published by Elsevier Inc. All rights reserved.
Goldman, Kara N; Patrizio, Pasquale; Albertini, David
2017-01-01
The Journal of Assisted Reproduction and Genetics introduces the JARG Young Investigator Forum, an in-training initiative aimed to expand opportunities for young investigators. The JARG Young Investigator Forum has three primary goals: first, to increase opportunities for trainees and young investigators to contribute as researchers and writers. Trainees will be invited to publish mini-reviews based on their area of research interest/expertise and will have the opportunity to indicate "in-training" when submitting manuscripts as first author Educational research pertaining to reproductive medicine training will be added to the purview of the journal. Second, the Young Investigator Forum will increase opportunities for trainees to serve as journal reviewers and will provide mentorship throughout the peer review process. Third, trainees will have the unique opportunity to gain editorial experience by serving as a "guest editor" of the Young Investigator Forum, overseeing all editorial aspects of their assigned particular issue. Through authorship, peer review, and editorial experience, we seek to nurture the academic skills that are critical to a well-rounded career. The JARG Young Investigator Forum aims to foster career development for a generation of trainees who represent the future of reproductive medicine, and here, we outline the primary goals and objectives of the initiative.
Sanghavi, Ankit; Siddiqui, Nadia J
2017-06-01
While a large body of work documents the interconnections between oral health and obesity, less is known about the role that oral health professionals and organizations play to prevent childhood obesity, especially by influencing children's consumption of sugar-sweetened beverages (SSBs). This review identifies efforts by oral health professionals and organizations to influence such policy and advocacy, while informing future opportunities to leverage and expand on existing efforts. A scoping review of peer-reviewed literature and a web-based review of oral health policy and advocacy initiatives addressing prevention of obesity and reducing children's consumption of SSBs were conducted. Of 30 unique references identified, four peer-reviewed and seven non-peer-reviewed references met selection criteria. Qualitative and quantitative data were extracted using a priori determined headings. Findings suggest a strong role for oral health professionals in preventing childhood obesity and reducing children's consumption of SSBs; however, only a few national, state, and local oral-health-advocacy and -policy efforts were identified, such as policy statements by national associations, state and local education campaigns, and clinical guidelines. Evidence was limited on the role of oral health professionals in influencing broader communitywide advocacy and policy efforts such as soda taxation and limiting SSB consumption in schools. This review provides an emerging evidence base to support growing recognition among oral health professionals of their dual role in preventing childhood obesity and dental caries by targeting SSB consumption. It also identifies opportunities for oral health professionals to build on initial efforts to more proactively influence future policy and advocacy. © 2017 American Association of Public Health Dentistry.
Peer reviewing e-learning: opportunities, challenges, and solutions.
Ruiz, Jorge G; Candler, Chris; Teasdale, Thomas A
2007-05-01
Peer review is the foundation of academic publication and a necessary step in the scrutiny of any scholarly work. Simply defined, peer review is the attentive, unbiased assessment of any scholarly work that is submitted for formal scrutiny. Although medical school faculty increasingly use technology in clinical teaching, e-learning materials are often not subjected to a rigorous peer review process. The authors contrast peer review of e-learning materials with that of print materials, describe peer review issues regarding e-learning materials, propose approaches to address the challenges of peer review of e-learning materials, and outline directions for refinement of the e-learning peer review process. At its core, the peer review of e-learning materials should not differ substantially from that of traditional manuscripts. However, e-learning introduces new demands that impel reviewers to consider aspects that are unique to educational technology, including pedagogy, format, usability, navigation, interactivity, delivery, ease of updating, distribution, and access. Four approaches are offered to ease the burden and improve the quality of e-learning peer review: develop peer review training, embrace multidisciplinary peer review, develop guidelines, and provide incentives and compensation. The authors conclude with suggestions about peer review research.
28 CFR 34.106 - Number of peer reviewers.
Code of Federal Regulations, 2010 CFR
2010-07-01
... 28 Judicial Administration 1 2010-07-01 2010-07-01 false Number of peer reviewers. 34.106 Section 34.106 Judicial Administration DEPARTMENT OF JUSTICE OJJDP COMPETITION AND PEER REVIEW PROCEDURES Peer Review § 34.106 Number of peer reviewers. The number of peer reviewers will vary by program (as...
28 CFR 34.106 - Number of peer reviewers.
Code of Federal Regulations, 2013 CFR
2013-07-01
... 28 Judicial Administration 1 2013-07-01 2013-07-01 false Number of peer reviewers. 34.106 Section 34.106 Judicial Administration DEPARTMENT OF JUSTICE OJJDP COMPETITION AND PEER REVIEW PROCEDURES Peer Review § 34.106 Number of peer reviewers. The number of peer reviewers will vary by program (as...
Do peer review models affect clinicians' trust in journals? A survey of junior doctors.
Patel, Jigisha; Pierce, Mary; Boughton, Stephanie L; Baldeweg, Stephanie E
2017-01-01
The aim of this survey was to determine the level of awareness and understanding of peer review and peer review models amongst junior hospital doctors and whether this influences clinical decision-making. A 30-question online anonymous survey was developed aimed at determining awareness of peer review models and the purpose of peer review, perceived trustworthiness of different peer review models and the role of peer review in clinical decision-making. It was sent to 800 trainee doctors in medical specialties on the University College London Partners trainee database. The response rate was (178/800) 22%. Most respondents were specialist registrars. Checking that research is conducted correctly (152/178, 85%) and the data interpreted correctly (148/178, 83%) were viewed as the most important purposes of peer review. Most respondents were aware of open (133/178, 75%), double-blind (125/178, 70%) and single-blind peer review (121/178, 68%). 101/178 (57%) had heard of collaborative, 87/178 (49%) of post publication and 29/178 (16%) of decoupled peer review. Of those who were aware of double-blind, single-blind open and collaborative peer review, 85 (68%), 82 (68%), 74 (56%) and 24 (24%), respectively, understood how they worked. The NEJM , Lancet and The BMJ were deemed to have most trustworthy peer review, 137/178 (77%), 129/178 (72%) and 115/178 (65%), respectively. That peer review had taken place was important for a journal content to be used for clinical decision-making 152/178 (85%), but the ability to see peer review reports was not as important 22/178 (12%). Most felt there was a need for peer review training and that this should be at the specialist registrar stage of training. Junior hospital doctors view peer review to be important as a means of quality control, but do not value the ability to scrutinize peer review themselves. The unquestioning acceptance of peer review as final validation in the field of medicine emphasises not only the responsibility held by medical journals to ensure peer review is done well but also the need to raise awareness amongst the medical community of the limitations of the current peer review process.
Bain, P; Wareing, A; Henderson, I
2017-09-01
Peer-assisted learning provides a means through which individuals can learn from one another through a reciprocal process. Radiographic image interpretation skills are fundamental to both diagnostic radiography students and medical students due to their shared role in preliminary evaluation of conventional radiographic images. Medical students on graduation, may not be well prepared to carry out image interpretation, since evidence suggests that they perform less well than radiographers in e.g. Accident and Emergency situations. A review of literature was conducted exploring the application of peer-assisted learning within diagnostic radiography and health education more widely as well as the practice of initial image interpretation. An extensive and systematic search strategy was developed which provided a range of material related to the areas. An overview was obtained of the effectiveness of peer-assisted learning and the issues associated with development of image interpretation skills and a degree of discrepancy was identified between the two cohorts regarding their interpretative competence and confidence. This inconsistency may create an opportunity to apply peer-assisted learning, better preparing both disciplines for the practical application of image interpretation skills. The review identified the lack of a substantial evidence base relating to peer-assisted learning in radiography. Peer-assisted learning is not widely embraced in an interprofessional context. Multiple positive factors of such an intervention are identified which outweigh perceived negative issues. Student teacher and learner may benefit as should the clinical service from enhanced practitioner performance. The findings justify further research to develop the evidence base. Copyright © 2017 The College of Radiographers. Published by Elsevier Ltd. All rights reserved.
Clinical peer review in the United States: history, legal development and subsequent abuse.
Vyas, Dinesh; Hozain, Ahmed E
2014-06-07
The Joint Commission on Accreditation requires hospitals to conduct peer review to retain accreditation. Despite the intended purpose of improving quality medical care, the peer review process has suffered several setbacks throughout its tenure. In the 1980s, abuse of peer review for personal economic interest led to a highly publicized multimillion-dollar verdict by the United States Supreme Court against the perpetrating physicians and hospital. The verdict led to decreased physician participation for fear of possible litigation. Believing that peer review was critical to quality medical care, Congress subsequently enacted the Health Care Quality Improvement Act (HCQIA) granting comprehensive legal immunity for peer reviewers to increase participation. While serving its intended goal, HCQIA has also granted peer reviewers significant immunity likely emboldening abuses resulting in Sham Peer Reviews. While legal reform of HCQIA is necessary to reduce sham peer reviews, further measures including the need for standardization of the peer review process alongside external organizational monitoring are critical to improving peer review and reducing the prevalence of sham peer reviews.
Clinical peer review in the United States: History, legal development and subsequent abuse
Vyas, Dinesh; Hozain, Ahmed E
2014-01-01
The Joint Commission on Accreditation requires hospitals to conduct peer review to retain accreditation. Despite the intended purpose of improving quality medical care, the peer review process has suffered several setbacks throughout its tenure. In the 1980s, abuse of peer review for personal economic interest led to a highly publicized multimillion-dollar verdict by the United States Supreme Court against the perpetrating physicians and hospital. The verdict led to decreased physician participation for fear of possible litigation. Believing that peer review was critical to quality medical care, Congress subsequently enacted the Health Care Quality Improvement Act (HCQIA) granting comprehensive legal immunity for peer reviewers to increase participation. While serving its intended goal, HCQIA has also granted peer reviewers significant immunity likely emboldening abuses resulting in Sham Peer Reviews. While legal reform of HCQIA is necessary to reduce sham peer reviews, further measures including the need for standardization of the peer review process alongside external organizational monitoring are critical to improving peer review and reducing the prevalence of sham peer reviews. PMID:24914357
In Referees We Trust? Controversies over Grant Peer Review in the Late Twentieth Century
NASA Astrophysics Data System (ADS)
Baldwin, Melinda
While many accounts of external refereeing assume that it has been a consistent part of science since the seventeenth century, the practice developed far more slowly and haphazardly than many observers realize, and it was not until after the Second World War that ''peer review'' became considered an essential part of scientific publishing or grant-making. This talk will explore refereeing procedures at American grant-giving organizations in the twentieth century, focusing especially on the National Science Foundation and the National Institutes of Health. The creators of the NSF and the NIH put refereeing systems in place at their foundation. However, the form and function of these systems differed from modern ''peer review'' in several important ways. At the NSF the initial purpose of the referee process was to advise the NSF program directors, not to dictate funding decisions. At the NIH, small ''study sections'' devoted to particular subjects made recommendations to the NIH leadership, which rendered final judgments. However, beginning in the 1960s a series of controversies about NIH and NSF grants placed refereeing procedures at these organizations under more intense scrutiny. These debates culminated in six days of Special Oversight Hearings into the NSF's peer review process in the summer of 1975. Following the hearings, both the NSF and NIH reformed their review processes to place more emphasis on referees' opinions about grant proposals, making peer review increasingly responsible for decision-making. These controversies illustrate that refereeing continued to undergo significant changes in form and purpose throughout the twentieth century, and further suggest that both the scientific community and the public placed increased emphasis on the role of the referee during the late twentieth century.
A longitudinal study of clinical peer review's impact on quality and safety in U.S. hospitals.
Edwards, Marc T
2013-01-01
Clinical peer review is the dominant method of event analysis in U.S. hospitals. It is pivotal to medical staff efforts to improve quality and safety, yet the quality assurance process model that has prevailed for the past 30 years evokes fear and is fundamentally antithetical to a culture of safety. Two prior national studies characterized a quality improvement model that corrects this dysfunction but failed to demonstrate progress toward its adoption despite a high rate of program change between 2007 and 2009. This study's online survey of 470 organizations participating in either of the prior studies further assessed relationships between clinical peer review program factors, including the degree of conformance to the quality improvement model (the QI model score), and subjectively measured program impact variables. Among the 300 hospitals (64%) that responded, the median QI model score was only 60 on a 100-point scale. Scores increased somewhat for the 2007 cohort (mean pair-wise difference of 5.9 [2-10]), but not for the 2009 cohort. The QI model is expanded as the result of the finding that self-reporting of adverse events, near misses, and hazardous conditions--an essential practice in high-reliability organizations--is no longer rare in hospitals. Self-reporting and the quality of case review are additional multivariate predictors of the perceived ongoing impact of clinical peer review on quality and safety, medical staff perceptions of the program, and medical staff engagement in quality and safety initiatives. Hospital leaders and trustees who seek to improve patient outcomes should facilitate the adoption of this best practice model for clinical peer review.
ERIC Educational Resources Information Center
Wharton, Tracy
2017-01-01
Dissemination of research is the most challenging aspect of building the evidence base. Despite peer review, evidence suggests that a substantial proportion of papers leave out details that are necessary to judge bias, consider replication, or initiate meta-analyses and systematic reviews. Reporting guidelines were created to ensure minimally…
HST Peer Review, Where We've Been, Where We Are Now and Possibly Where the Future Lies
NASA Astrophysics Data System (ADS)
Blacker, Brett S.; Macchetto, Duccio; Meylan, Georges; Stanghellini, Letizia; van der Marel, Roeland P.
2002-12-01
In some eyes, the Phase I proposal selection process is the most important activity handled by the Space Telescope Science Institute (STScI). Proposing for HST and other missions consists of requesting observing time and/or archival research funding. This step is called Phase I, where the scientific merit of a proposal is considered by a community based peer-review process. Accepted proposals then proceed thru Phase II, where the observations are specified in sufficient detail to enable scheduling on the telescope. Each cycle the Hubble Space Telescope (HST) Telescope Allocation Committee (TAC) reviews proposals and awards observing time that is valued at $0.5B, when the total expenditures for HST over its lifetime are figured on an annual basis. This is in fact a very important endeavor that we continue to fine-tune and tweak. This process is open to the science community and we constantly receive comments and praise for this process. Several cycles ago we instituted several significant changes to the process to address concerns such as: Fewer, broader panels, with redundancy to avoid conflicts of interest; Redefinition of the TAC role, to focus on Larger programs; and incentives for the panels to award time to medium sized proposals. In the last cycle, we offered new initiatives to try to enhance the scientific output of the telescope. Some of these initiatives were: Hubble Treasury Program; AR Legacy Program; and the AR Theory Program. This paper will outline the current HST Peer review process. We will discuss why we made changes and how we made changes from our original system. We will also discuss some ideas as to where we may go in the future to generate a stronger science program for HST and to reduce the burden on the science community. This paper is an update of the status of the HST Peer Review Process that was described in the published paper "Evolution of the HST Proposal Selection Process".
Open peer review at four STEM journals: an observational overview.
Ford, Emily
2015-01-01
Open peer review, peer review where authors' and reviewers' identities are disclosed to one another, is a growing trend in scholarly publishing. Through observation of four journals in STEM disciplines, PLOS One, Atmospheric Chemistry & Physics, PeerJ, and F1000Research, an observational overview is conducted. The overview relies on defined characteristics of open peer review. Results show that despite differing open peer review implementations, each journal retains editorial involvement in scholarly publishing. Further, the analysis shows that only one of these implementations is fully transparent in its peer review and decision making process. Finally, the overview contends that journals should clearly outline peer review and editorial processes in order to allow for open peer review to be better understood and adopted by authors, reviewers, editors, and readers of science communications.
Cooley, John L; Frazer, Andrew L; Fite, Paula J; Brown, Shaquanna; DiPierro, Moneika
2017-09-01
The current short-term longitudinal study evaluated whether anxiety symptoms moderated the bidirectional associations between forms (i.e., physical and relational) of aggression and peer victimization over a 1-year period during middle childhood. Participants were 228 predominantly Caucasian children (50.4% boys; M = 8.32 years, SD = .95 years) in the second through fourth grades and their homeroom teachers. Children completed a self-report measure of anxiety symptoms at Time 1. Peer victimization was assessed using self-reports at Time 1 and approximately 1 year later (Time 2), and teachers provided ratings of children's aggressive behavior at both time points. A series of cross-lagged path analysis models indicated that high (+1 SD) initial levels of anxiety symptoms exacerbated the prospective link from Time 1 relational aggression to Time 2 peer victimization; conversely, when initial levels of anxiety symptoms were low (-1 SD), relational aggression predicted lower levels of subsequent peer victimization. Time 1 peer victimization was also found to predict lower levels of Time 2 physical aggression when initial levels of anxiety symptoms were low, and Time 1 anxiety symptoms were uniquely related to higher levels of relational aggression over a 1-year period. Regions of significance were calculated to further decompose significant interactions, which did not differ according to gender. Study findings are discussed within a social information processing theoretical framework, and directions for future research and implications for practice are reviewed. Specifically, co-occurring anxiety symptoms may need to be addressed in interventions for both aggression and peer victimization during middle childhood. © 2017 Wiley Periodicals, Inc.
Kirsch, Daniel J; Pinder-Amaker, Stephanie L; Morse, Charles; Ellison, Marsha L; Doerfler, Leonard A; Riba, Michelle B
2014-12-01
College students' need for mental health care has increased dramatically, leaving campus counseling and mental health centers struggling to meet the demand. This has led to the investigation and development of extra-center, population-based interventions. Student-to-student support programs are but one example. Students themselves are a plentiful, often-untapped resource that extends the reach of mental health services on campus. Student-to-student programs capitalize on students' natural inclination to assist their peers. A brief review of the prevalence and effects of mental disorders in the college population is provided, followed by a broad overview of the range of peer-to-peer programs that can be available on college campuses. Two innovative programs are highlighted: (1) a hospital- and community-based program, the College Mental Health Program (CMHP) at McLean Hospital, and 2) the Student Support Network (SSN) at Worcester Polytechnic Institute. The subsequent section reviews the literature on peer-to-peer programs for students with serious and persistent mental illness for which there is a small but generally positive body of research. This lack of an empirical basis in college mental health leads the authors to argue for development of broad practice-research networks.
Neural Correlates of Social Influence Among Cannabis Users
Gilman, Jodi M.
2017-01-01
Purpose of review Although peer influence is an important factor in the initiation and maintenance of cannabis use, few studies have investigated the neural correlates of peer influence among cannabis users. The current review summarizes research on the neuroscience of social influence in cannabis users, with the goal of highlighting gaps in the literature and the need for future research. Recent findings Brain regions underlying peer influence may function differently in cannabis users. Compared to non-using controls, regions of the brain underlying reward, such as the striatum, show greater connectivity with frontal regions, and also show hyperactivity when participants are presented with peer information. Other subcortical regions, such as the insula, show hypoactivation during social exclusion in cannabis users, indicating that neural responses to peer interactions may be altered in cannabis users. Summary Although neuroscience is increasingly being used to study social behavior, few studies have specifically focused on cannabis use, and therefore it is difficult to draw conclusions about social mechanisms that may differentiate cannabis users and controls. This area of research may be a promising avenue in which to explore a critical factor underlying cannabis use and addiction. PMID:29057199
Peer review and the publication process.
Ali, Parveen Azam; Watson, Roger
2016-10-01
To provide an overview of the peer review process, its various types, selection of peer reviewers, the purpose and significance of the peer review with regard to the assessment and management of quality of publications in academic journals. Discussion paper. This paper draws on information gained from literature on the peer review process and the authors' knowledge and experience of contributing as peer reviewers and editors in the field of health care, including nursing. There are various types of peer review: single blind; double blind; open; and post-publication review. The role of the reviewers in reviewing manuscripts and their contribution to the scientific and academic community remains important.
Reiner, Bruce I
2017-12-01
In conventional radiology peer review practice, a small number of exams (routinely 5% of the total volume) is randomly selected, which may significantly underestimate the true error rate within a given radiology practice. An alternative and preferable approach would be to create a data-driven model which mathematically quantifies a peer review risk score for each individual exam and uses this data to identify high risk exams and readers, and selectively target these exams for peer review. An analogous model can also be created to assist in the assignment of these peer review cases in keeping with specific priorities of the service provider. An additional option to enhance the peer review process would be to assign the peer review cases in a truly blinded fashion. In addition to eliminating traditional peer review bias, this approach has the potential to better define exam-specific standard of care, particularly when multiple readers participate in the peer review process.
Patient-Focused Drug Development: A New Direction for Collaboration.
Perfetto, Eleanor M; Burke, Laurie; Oehrlein, Elisabeth M; Epstein, Robert S
2015-01-01
Patient-Focused Drug Development (PFDD) is a new initiative from the Food and Drug Administration (FDA) intended to bring patient perspectives into an earlier stage of product development. The goal is that patients will be able to provide context for benefit-risk assessments and input to review divisions, and also aid in the development of new assessment tools, study endpoints, and risk communications. This paper provides a summary on what is known to date about FDA's PFDD initiative and describes implications for patients, researchers, payers, and the biopharmaceutical industry. It also provides a roadmap for stakeholders to consider in defining their role in and in shaping PFDD's direction, and for expanding PFDD principles to conditions beyond the current 20 under FDA consideration. A search was conducted of the peer-reviewed and gray literature using PubMed and Google. This included laws, FDA guidance documents, the peer-reviewed literature, and FDA presentations for content relevant to the search term "patient-focused drug development." Currently, FDA activities within PFDD are limited to gaining patient insights through 20 disease-specific meetings. However, many stakeholders see the initiative much more generally as representing a broad shift toward patient centeredness in biopharmaceutical product development. Depending upon the trajectory taken and whether or not all PFDD aims are eventually addressed, the initiative has the potential to change product development in fundamental ways. Further research should explore how patient input on disease manifestation and treatment options is best ascertained from patients and documented before initiating and during drug development.
Group consensus peer review in radiation oncology: commitment to quality.
Duggar, W Neil; Bhandari, Rahul; Yang, Chunli Claus; Vijayakumar, Srinivasan
2018-03-27
Peer review, especially prospective peer review, has been supported by professional organizations as an important element in optimal Radiation Oncology practice based on its demonstration of efficacy at detecting and preventing errors prior to patient treatment. Implementation of peer review is not without barriers, but solutions do exist to mitigate or eliminate some of those barriers. Peer review practice at our institution involves three key elements: new patient conference, treatment planning conference, and chart rounds. The treatment planning conference is an adaptation of the group consensus peer review model from radiology which utilizes a group of peers reviewing each treatment plan prior to implementation. The peer group in radiation oncology includes Radiation Oncologists, Physician Residents, Medical Physicists, Dosimetrists, and Therapists. Thus, technical and clinical aspects of each plan are evaluated simultaneously. Though peer review is held in high regard in Radiation Oncology, many barriers commonly exist preventing optimal implementation such as time intensiveness, repetition, and distraction from clinic time with patients. Through the use of automated review tools and commitment by individuals and administration in regards to staffing, scheduling, and responsibilities, these barriers have been mitigated to implement this Group Consensus Peer Review model into a Radiation Oncology Clinic. A Group Consensus Peer Review model has been implemented with strategies to address common barriers to effective and efficient peer review.
Akazhanov, Nurbek A.; Voronov, Alexander A.; Kitas, George D.
2014-01-01
Unique identifiers of researchers and authors can help all stakeholders of scientific communications improve their workflows. There have been several attempts to establish professional networks of scholars and list their scholarly achievements on digital platforms. Some of these platforms such as Google Scholar, Web of Knowledge and PubMed are searched to pick relevant peer reviewers, assess authors' publication history or choose suitable candidates for research and academic projects. However, each of these hubs has its specific applications, limiting the universal use for permanent tagging of researcher profiles. The Open Researcher and Contributor ID (ORCID) initiative, launched in 2012, is aimed at registering scholarly contributors and averting the persistent ambiguity of recorded author names. The ORCID registry is growing fast and integrating with other ID-generating platforms, thereby increasing the functionality of the integrated systems. ORCID identifiers are increasingly used for selecting peer reviewers and acknowledging various scholarly contributions (e.g., published articles, reviewer comments, conference presentations). The initiative offers unique opportunities for transparent disclosures of author contributions and competing interests and improving ethical standards of research, editing, and publishing. PMID:25408574
Gasparyan, Armen Yuri; Akazhanov, Nurbek A; Voronov, Alexander A; Kitas, George D
2014-11-01
Unique identifiers of researchers and authors can help all stakeholders of scientific communications improve their workflows. There have been several attempts to establish professional networks of scholars and list their scholarly achievements on digital platforms. Some of these platforms such as Google Scholar, Web of Knowledge and PubMed are searched to pick relevant peer reviewers, assess authors' publication history or choose suitable candidates for research and academic projects. However, each of these hubs has its specific applications, limiting the universal use for permanent tagging of researcher profiles. The Open Researcher and Contributor ID (ORCID) initiative, launched in 2012, is aimed at registering scholarly contributors and averting the persistent ambiguity of recorded author names. The ORCID registry is growing fast and integrating with other ID-generating platforms, thereby increasing the functionality of the integrated systems. ORCID identifiers are increasingly used for selecting peer reviewers and acknowledging various scholarly contributions (e.g., published articles, reviewer comments, conference presentations). The initiative offers unique opportunities for transparent disclosures of author contributions and competing interests and improving ethical standards of research, editing, and publishing.
Barwise, Amelia; Garcia-Arguello, Lisbeth; Dong, Yue; Hulyalkar, Manasi; Vukoja, Marija; Schultz, Marcus J; Adhikari, Neill K J; Bonneton, Benjamin; Kilickaya, Oguz; Kashyap, Rahul; Gajic, Ognjen; Schmickl, Christopher N
2016-10-03
The Checklist for Early Recognition and Treatment of Acute Illness (CERTAIN) is an international collaborative project with the overall objective of standardizing the approach to the evaluation and treatment of critically ill patients world-wide, in accordance with best-practice principles. One of CERTAIN's key features is clinical decision support providing point-of-care information about common acute illness syndromes, procedures, and medications in an index card format. This paper describes 1) the process of developing and validating the content for point-of-care decision support, and 2) the content management system that facilitates frequent peer-review and allows rapid updates of content across different platforms (CERTAIN software, mobile apps, pdf-booklet) and different languages. Content was created based on survey results of acute care providers and validated using an open peer-review process. Over a 3 year period, CERTAIN content expanded to include 67 syndrome cards, 30 procedure cards, and 117 medication cards. 127 (59 %) cards have been peer-reviewed so far. Initially MS Word® and Dropbox® were used to create, store, and share content for peer-review. Recently Google Docs® was used to make the peer-review process more efficient. However, neither of these approaches met our security requirements nor has the capacity to instantly update the different CERTAIN platforms. Although we were able to successfully develop and validate a large inventory of clinical decision support cards in a short period of time, commercially available software solutions for content management are suboptimal. Novel custom solutions are necessary for efficient global point of care content system management.
28 CFR 34.110 - Management of peer reviews.
Code of Federal Regulations, 2010 CFR
2010-07-01
... 28 Judicial Administration 1 2010-07-01 2010-07-01 false Management of peer reviews. 34.110 Section 34.110 Judicial Administration DEPARTMENT OF JUSTICE OJJDP COMPETITION AND PEER REVIEW PROCEDURES Peer Review § 34.110 Management of peer reviews. A technical support contractor may assist in managing...
28 CFR 34.102 - Peer review procedures.
Code of Federal Regulations, 2010 CFR
2010-07-01
...” describes a process that evolves in accordance with experience and opportunities to effect improvements. The... Review § 34.102 Peer review procedures. The OJJDP peer review process is contained in an OJJDP “Peer... substantive and procedural matters related to the peer review process, the “Guideline” addresses such issues...
Semper, Julie; Halvorson, Betty; Hersh, Mary; Torres, Clare; Lillington, Linda
2016-01-01
The aim of the study was to describe the clinical nurse specialist role in developing and implementing a staff nurse education program to promote practice accountability using peer review principles. Peer review is essential for professional nursing practice demanding a significant culture change. Clinical nurse specialists in a Magnet-designated community hospital were charged with developing a staff nurse peer review education program. Peer review is a recognized mechanism of professional self-regulation to ensure delivery of quality care. The American Nurses Association strongly urges incorporating peer review in professional nursing practice models. Clinical nurse specialists play a critical role in educating staff nurses about practice accountability. Clinical nurse specialists developed an education program guided by the American Nurses Association's principles of peer review. A baseline needs assessment identified potential barriers and learning needs. Content incorporated tools and strategies to build communication skills, collaboration, practice change, and peer accountability. The education program resulted in increased staff nurse knowledge about peer review and application of peer review principles in practice. Clinical nurse specialists played a critical role in helping staff nurses understand peer review and its application to practice. The clinical nurse specialist role will continue to be important in sustaining the application of peer review principles in practice.
The ethics of peer review in bioethics
Wendler, David; Miller, Franklin
2014-01-01
A good deal has been written on the ethics of peer review, especially in the scientific and medical literatures. In contrast, we are unaware of any articles on the ethics of peer review in bioethics. Recognising this gap, we evaluate the extant proposals regarding ethical standards for peer review in general and consider how they apply to bioethics. We argue that scholars have an obligation to perform peer review based on the extent to which they personally benefit from the peer review process. We also argue, contrary to existing proposals and guidelines, that it can be appropriate for peer reviewers to benefit in their own scholarship from the manuscripts they review. With respect to bioethics in particular, we endorse double-blind review and suggest several ways in which the peer review process might be improved. PMID:24131903
75 FR 29769 - Notice of Meetings
Federal Register 2010, 2011, 2012, 2013, 2014
2010-05-27
... DEPARTMENT OF HEALTH AND HUMAN SERVICES Agency for Healthcare Research and Quality Notice of...., Appendix 2), the Agency for Healthcare Research and Quality (AHRQ) announces meetings of scientific peer review groups. The subcommittees listed below are part of the Agency's Health Services Research Initial...
75 FR 5091 - Notice of Meetings
Federal Register 2010, 2011, 2012, 2013, 2014
2010-02-01
... DEPARTMENT OF HEALTH AND HUMAN SERVICES Agency for Healthcare Research and Quality Notice of...., Appendix 2), the Agency for Healthcare Research and Quality (AHRQ) announces meetings of scientific peer review groups. The subcommittees listed below are part of the Agency's Health Services Research Initial...
75 FR 56553 - Notice of Meetings
Federal Register 2010, 2011, 2012, 2013, 2014
2010-09-16
... DEPARTMENT OF HEALTH AND HUMAN SERVICES Agency for Healthcare Research and Quality Notice of...., Appendix 2), the Agency for Healthcare Research and Quality (AHRQ) announces meetings of scientific peer review groups. The subcommittees listed below are part of the Agency's Health Services Research Initial...
7 CFR 3411.12 - Conflicts of interest.
Code of Federal Regulations, 2011 CFR
2011-01-01
... 7 Agriculture 15 2011-01-01 2011-01-01 false Conflicts of interest. 3411.12 Section 3411.12 Agriculture Regulations of the Department of Agriculture (Continued) NATIONAL INSTITUTE OF FOOD AND AGRICULTURE NATIONAL RESEARCH INITIATIVE COMPETITIVE GRANTS PROGRAM Scientific Peer Review of Research Grant...
Trucco, Elisa M.; Colder, Craig R.; Wieczorek, William F.
2011-01-01
Affiliation with deviant peers is a correlate of adolescent alcohol use; however, the mechanism accounting for this association remains unclear, particularly with respect to initiation of alcohol use in early adolescence. This prospective study examines perceived peer attitudes and use as a mediator between peer delinquency and initiation of alcohol use, and how parenting may moderate vulnerability to this risk pathway. Participants included 371 11–13 year-old adolescents (55.5% female, 83.0% Caucasian). Results suggested that high levels of peer delinquency prospectively predicted perceived peer approval and use of alcohol and that peer approval and use of alcohol prospectively predicted initiation of alcohol use. Thus, reinforcement and modeling alcohol use appear to be important mechanisms by which delinquent peers influence the initiation of drinking. There was no support for parental warmth or control as moderators of peer influence. PMID:21420241
Code of Federal Regulations, 2010 CFR
2010-10-01
... 45 Public Welfare 4 2010-10-01 2010-10-01 false Peer review. 1388.9 Section 1388.9 Public Welfare... PROGRAM THE UNIVERSITY AFFILIATED PROGRAMS § 1388.9 Peer review. (a) The purpose of the peer review... D, Section 152 of the Act, must be evaluated through the peer review process. (c) Panels must be...
Peer Review in Higher Education: Student Perceptions before and after Participation
ERIC Educational Resources Information Center
Mulder, Raoul A.; Pearce, Jon M.; Baik, Chi
2014-01-01
Peer review is integral to academic endeavour, but opportunities for students to benefit from peer review in higher education remain limited, and relatively little is known about how student perceptions influence their appreciation of peer review. University student perceptions were examined before and after experiencing student peer review in…
ERIC Educational Resources Information Center
Soh, Kay Cheng
2013-01-01
Although its history is short, peer review has fast become a fixture of journal publications acquiring the status of a ritual in the academia. Many relevant and important issues have been raised leading to doubts about the value of peer review. The advent of electronic publishing further threatens the future of peer review. For peer review to…
Code of Federal Regulations, 2010 CFR
2010-07-01
... 40 Protection of Environment 24 2010-07-01 2010-07-01 false Peer review. 194.27 Section 194.27... § 194.27 Peer review. (a) Any compliance application shall include documentation of peer review that has... barrier evaluation as required in § 194.44. (b) Peer review processes required in paragraph (a) of this...
A prospective study on an innovative online forum for peer reviewing of surgical science.
Almquist, Martin; von Allmen, Regula S; Carradice, Dan; Oosterling, Steven J; McFarlane, Kirsty; Wijnhoven, Bas
2017-01-01
Peer review is important to the scientific process. However, the present system has been criticised and accused of bias, lack of transparency, failure to detect significant breakthrough and error. At the British Journal of Surgery (BJS), after surveying authors' and reviewers' opinions on peer review, we piloted an open online forum with the aim of improving the peer review process. In December 2014, a web-based survey assessing attitudes towards open online review was sent to reviewers with a BJS account in Scholar One. From April to June 2015, authors were invited to allow their manuscripts to undergo online peer review in addition to the standard peer review process. The quality of each review was evaluated by editors and editorial assistants using a validated instrument based on a Likert scale. The survey was sent to 6635 reviewers. In all, 1454 (21.9%) responded. Support for online peer review was strong, with only 10% stating that they would not subject their manuscripts to online peer review. The most prevalent concern was about intellectual property, being highlighted in 118 of 284 comments (41.5%). Out of 265 eligible manuscripts, 110 were included in the online peer review trial. Around 7000 potential reviewers were invited to review each manuscript. In all, 44 of 110 manuscripts (40%) received 100 reviews from 59 reviewers, alongside 115 conventional reviews. The quality of the open forum reviews was lower than for conventional reviews (2.13 (± 0.75) versus 2.84 (± 0.71), P<0.001). Open online peer review is feasible in this setting, but it attracts few reviews, of lower quality than conventional peer reviews.
A Scoping Review of Peer-led Education in Patient Safety Training
McLachlan, Andrew J.; Chen, Timothy F.
2018-01-01
Objective. To examine the literature pertaining to the use of peer-led education in patient safety. Findings. Four studies met the inclusion criteria: two were conducted in health care students and two in medical practitioners. Three studies used pre-post evaluation, with one containing a comparator group. One study a post-intervention evaluation only. All studies undertook Kirkpatrick Level 2 evaluations, showing significant improvements in attitudes and knowledge. One study undertook Level 3 and 4 evaluations, showing improvement in self-reported behaviors and engagement in quality improvement initiatives. Summary. There are few studies evaluating peer-led education in patient safety and formal and high-quality evaluations are lacking. PMID:29606704
A prospective study on an innovative online forum for peer reviewing of surgical science
von Allmen, Regula S.; Carradice, Dan; Oosterling, Steven J.; McFarlane, Kirsty; Wijnhoven, Bas
2017-01-01
Background Peer review is important to the scientific process. However, the present system has been criticised and accused of bias, lack of transparency, failure to detect significant breakthrough and error. At the British Journal of Surgery (BJS), after surveying authors’ and reviewers’ opinions on peer review, we piloted an open online forum with the aim of improving the peer review process. Methods In December 2014, a web-based survey assessing attitudes towards open online review was sent to reviewers with a BJS account in Scholar One. From April to June 2015, authors were invited to allow their manuscripts to undergo online peer review in addition to the standard peer review process. The quality of each review was evaluated by editors and editorial assistants using a validated instrument based on a Likert scale. Results The survey was sent to 6635 reviewers. In all, 1454 (21.9%) responded. Support for online peer review was strong, with only 10% stating that they would not subject their manuscripts to online peer review. The most prevalent concern was about intellectual property, being highlighted in 118 of 284 comments (41.5%). Out of 265 eligible manuscripts, 110 were included in the online peer review trial. Around 7000 potential reviewers were invited to review each manuscript. In all, 44 of 110 manuscripts (40%) received 100 reviews from 59 reviewers, alongside 115 conventional reviews. The quality of the open forum reviews was lower than for conventional reviews (2.13 (± 0.75) versus 2.84 (± 0.71), P<0.001). Conclusion Open online peer review is feasible in this setting, but it attracts few reviews, of lower quality than conventional peer reviews. PMID:28662046
Azziz, Ricardo; Carmina, Enrico; Dewailly, Didier; Diamanti-Kandarakis, Evanthia; Escobar-Morreale, Héctor F; Futterweit, Walter; Janssen, Onno E; Legro, Richard S; Norman, Robert J; Taylor, Ann E; Witchel, Selma F
2009-02-01
To review all available data and recommend a definition for polycystic ovary syndrome (PCOS) based on published peer-reviewed data, whether already in use or not, to guide clinical diagnosis and future research. Literature review and expert consensus. Professional society. None. None. A systematic review of the published peer-reviewed medical literature, by querying MEDLINE databases, to identify studies evaluating the epidemiology or phenotypic aspects of PCOS. The Task Force drafted the initial report, following a consensus process via electronic communication, which was then reviewed and critiqued by the Androgen Excess and PCOS (AE-PCOS) Society AE-PCOS Board of Directors. No section was finalized until all members were satisfied with the contents, and minority opinions noted. Statements were not included that were not supported by peer-reviewed evidence. Based on the available data, it is the view of the AE-PCOS Society Task Force that PCOS should be defined by the presence of hyperandrogenism (clinical and/or biochemical), ovarian dysfunction (oligo-anovulation and/or polycystic ovaries), and the exclusion of related disorders. However, a minority considered the possibility that there may be forms of PCOS without overt evidence of hyperandrogenism, but recognized that more data are required before validating this supposition. Finally, the Task Force recognized and fully expects that the definition of this syndrome will evolve over time to incorporate new research findings.
McGregor, Skye; Henderson, Klara J.; Kaldor, John M.
2014-01-01
Background Priority setting is increasingly recognised as essential for directing finite resources to support research that maximizes public health benefits and drives health equity. Priority setting processes have been undertaken in a number of low- and middle-income country (LMIC) settings, using a variety of methods. We undertook a critical review of reports of these processes. Methods and Findings We searched electronic databases and online for peer reviewed and non-peer reviewed literature. We found 91 initiatives that met inclusion criteria. The majority took place at the global level (46%). For regional or national initiatives, most focused on Sub Saharan Africa (49%), followed by East Asia and Pacific (20%) and Latin America and the Caribbean (18%). A quarter of initiatives aimed to cover all areas of health research, with a further 20% covering communicable diseases. The most frequently used process was a conference or workshop to determine priorities (24%), followed by the Child Health and Nutrition Initiative (CHNRI) method (18%). The majority were initiated by an international organization or collaboration (46%). Researchers and government were the most frequently represented stakeholders. There was limited evidence of any implementation or follow-up strategies. Challenges in priority setting included engagement with stakeholders, data availability, and capacity constraints. Conclusions Health research priority setting (HRPS) has been undertaken in a variety of LMIC settings. While not consistently used, the application of established methods provides a means of identifying health research priorities in a repeatable and transparent manner. In the absence of published information on implementation or evaluation, it is not possible to assess what the impact and effectiveness of health research priority setting may have been. PMID:25275315
Variability in Students' Evaluating Processes in Peer Assessment with Calibrated Peer Review
ERIC Educational Resources Information Center
Russell, J.; Van Horne, S.; Ward, A. S.; Bettis, E. A., III; Gikonyo, J.
2017-01-01
This study investigated students' evaluating process and their perceptions of peer assessment when they engaged in peer assessment using Calibrated Peer Review. Calibrated Peer Review is a web-based application that facilitates peer assessment of writing. One hundred and thirty-two students in an introductory environmental science course…
Peer Review as a Strategy for Improving Students' Writing Process
ERIC Educational Resources Information Center
Baker, Kimberly M.
2016-01-01
Peer review is an established strategy for improving the quality of students' writing. This study moves beyond the focus on outcomes to assess the peer-review process. In particular, this study focuses on the timing of the peer review, a highly structured feedback form, and student writers' revisions after engaging in peer review. This study draws…
Designing Peer Review for Pedagogical Success: What Can We Learn from Professional Science?
ERIC Educational Resources Information Center
Trautmann, Nancy M.
2009-01-01
This article compares peer review in professional versus education settings, summarizing key aspects of scientific peer review and reflecting on how these relate to the process as experienced by students. Consideration of professional peer review benefits educators in two ways. First, systems used for student peer review can employ some of the…
34 CFR 350.50 - What is the peer review process for this Program?
Code of Federal Regulations, 2010 CFR
2010-07-01
... 34 Education 2 2010-07-01 2010-07-01 false What is the peer review process for this Program? 350... peer review process for this Program? (a) The Secretary refers each application for a grant governed by those regulations in this part to a peer review panel established by the Secretary. (b) Peer review...
The Power of Peer Reviewing to Enhance Writing in Horticulture: Greenhouse Management
ERIC Educational Resources Information Center
Anderson, Neil O.; Flash, Pamela
2014-01-01
Peer review is not included in undergraduate horticultural curricula. Our research objectives in an 8- year study, which ranged from 2000 to 2007 in two sections (2000-2002 non-peer reviewed and 2003-2007 peer-reviewed) of Greenhouse Management students at the University of Minnesota were to determine whether iterative peer reviews would result in…
28 CFR 34.102 - Peer review procedures.
Code of Federal Regulations, 2011 CFR
2011-07-01
... 28 Judicial Administration 1 2011-07-01 2011-07-01 false Peer review procedures. 34.102 Section 34.102 Judicial Administration DEPARTMENT OF JUSTICE OJJDP COMPETITION AND PEER REVIEW PROCEDURES Peer... substantive and procedural matters related to the peer review process, the “Guideline” addresses such issues...
28 CFR 34.102 - Peer review procedures.
Code of Federal Regulations, 2014 CFR
2014-07-01
... 28 Judicial Administration 1 2014-07-01 2014-07-01 false Peer review procedures. 34.102 Section 34.102 Judicial Administration DEPARTMENT OF JUSTICE OJJDP COMPETITION AND PEER REVIEW PROCEDURES Peer... substantive and procedural matters related to the peer review process, the “Guideline” addresses such issues...
28 CFR 34.102 - Peer review procedures.
Code of Federal Regulations, 2012 CFR
2012-07-01
... 28 Judicial Administration 1 2012-07-01 2012-07-01 false Peer review procedures. 34.102 Section 34.102 Judicial Administration DEPARTMENT OF JUSTICE OJJDP COMPETITION AND PEER REVIEW PROCEDURES Peer... substantive and procedural matters related to the peer review process, the “Guideline” addresses such issues...
28 CFR 34.102 - Peer review procedures.
Code of Federal Regulations, 2013 CFR
2013-07-01
... 28 Judicial Administration 1 2013-07-01 2013-07-01 false Peer review procedures. 34.102 Section 34.102 Judicial Administration DEPARTMENT OF JUSTICE OJJDP COMPETITION AND PEER REVIEW PROCEDURES Peer... substantive and procedural matters related to the peer review process, the “Guideline” addresses such issues...
ERIC Educational Resources Information Center
Pollicino, Elizabeth B.; Hall, Clover W.
This paper reviews the literature on academic quality programs and examines issues faced at one institution in which two initiatives emphasizing student outcomes and faculty performance as indicators of quality are underway. In its review of the literature the paper focuses on concepts such as total quality management, peer or student evaluation…
Implementation and Outcomes of a Faculty-Based, Peer Review Manuscript Writing Workshop.
Kulage, Kristine M; Larson, Elaine L
2016-01-01
The publication of scholarly work and research findings is an important expectation for nursing faculty; however, academic writing is often neglected, leaving dissemination through manuscript writing an area of concern for the nursing profession. Writing initiatives have been utilized to promote scholarly dissemination in schools of nursing, but those described in the literature have been primarily non-United States based and student focused. This article describes a faculty-based manuscript writing workshop, assesses participants' impressions, and describes its impact on scholarly output. The workshop is a collaborative learning process utilizing peer review to improve manuscript quality and model behaviors for improving writing and peer-reviewing skills. Seventeen workshop participants including three predoctoral students, 6 postdoctoral fellows, and 8 faculty members completed an anonymous workshop survey (81% response rate). All but 1 of 17 manuscripts reviewed in the workshop are published, accepted, or in the review process. All participants indicated that the workshop was a valuable use of time and would recommend it to colleagues. The greatest reported workshop benefit was its function as an impetus to complete and submit manuscripts. We recommend the manuscript writing workshop model for other schools of nursing seeking ways to expand their scholarly output and create accountability for dissemination through manuscript writing. Copyright © 2016 Elsevier Inc. All rights reserved.
Xie, Yu-Han; Potměšil, Miloň; Peters, Brenda
2014-10-01
This review is conducted to describe how children who are deaf or hard of hearing (D/HH) interact with hearing peers in inclusive settings, illustrate the difficulties and challenges faced by them in interacting with peers, and identify effective interventions that promote their social interaction in inclusive education. A systematic search of databases and journals identified 21 papers that met the inclusion criteria. Two broad themes emerged from an analysis of the literatures, which included processes and outcomes of interactions with peers and intervention programs. The research indicates that children who are D/HH face great difficulties in communicating, initiating/entering, and maintaining interactions with hearing peers in inclusive settings. The co-enrollment and social skills training programs are considered to be effective interventions for their social interaction. Communication abilities and social skills of children who are D/HH, responses of children with normal hearing, and the effect of environment are highlighted as crucial aspects of social interactions. In addition, future research is needed to study the interaction between children who are D/HH and hearing peers in natural settings, at different stages of school life, as well as improving social interaction and establishing an inclusive classroom climate for children who are D/HH. © The Author 2014. Published by Oxford University Press. All rights reserved. For Permissions, please email: journals.permissions@oup.com.
28 CFR 34.108 - Selection of reviewers.
Code of Federal Regulations, 2010 CFR
2010-07-01
....108 Judicial Administration DEPARTMENT OF JUSTICE OJJDP COMPETITION AND PEER REVIEW PROCEDURES Peer Review § 34.108 Selection of reviewers. The Program Manager, through the Director of the OJJDP program... by the Administrator. The selection process for peer reviewers is detailed in the OJJDP “Peer Review...
7 CFR 3400.21 - Scientific peer review for research activities.
Code of Federal Regulations, 2011 CFR
2011-01-01
... 7 Agriculture 15 2011-01-01 2011-01-01 false Scientific peer review for research activities. 3400... § 3400.21 Scientific peer review for research activities. Scientific peer review is an evaluation of a... with the scientific knowledge and technical skills to conduct the proposed research work. Peer...
Impact of Cancer on Romantic Relationships Among Young Adults: A Systematic Review.
Rabin, Carolyn
2018-04-24
The aim of this review was to determine the impact of a cancer diagnosis and history on young adults' ability to initiate and maintain romantic relationships. MedLine and PsycInfo databases were used to identify articles that address dating, romantic relationships, or marriage among 18- to 45-year-old cancer survivors. Twenty-one relevant articles were identified. Findings indicate that young adult cancer survivors struggle with when/how to disclose their cancer history to potential partners, are delayed in initiating their first romantic relationships, have fewer romantic relationships than peers, and are less likely than peers to marry. Young survivors report that their cancer experience impacts their long-term relationships in both positive and negative ways. In summary, young survivors face significant barriers to establishing and maintaining romantic relationships. Those who have difficulty establishing romantic relationships may benefit from receiving additional support from other sources, including family members, friends, and (in some cases) mental health professionals.
Peer Review in Scientific Publications: Benefits, Critiques, & A Survival Guide
Kelly, Jacalyn; Sadeghieh, Tara
2014-01-01
Peer review has been defined as a process of subjecting an author’s scholarly work, research or ideas to the scrutiny of others who are experts in the same field. It functions to encourage authors to meet the accepted high standards of their discipline and to control the dissemination of research data to ensure that unwarranted claims, unacceptable interpretations or personal views are not published without prior expert review. Despite its wide-spread use by most journals, the peer review process has also been widely criticised due to the slowness of the process to publish new findings and due to perceived bias by the editors and/or reviewers. Within the scientific community, peer review has become an essential component of the academic writing process. It helps ensure that papers published in scientific journals answer meaningful research questions and draw accurate conclusions based on professionally executed experimentation. Submission of low quality manuscripts has become increasingly prevalent, and peer review acts as a filter to prevent this work from reaching the scientific community. The major advantage of a peer review process is that peer-reviewed articles provide a trusted form of scientific communication. Since scientific knowledge is cumulative and builds on itself, this trust is particularly important. Despite the positive impacts of peer review, critics argue that the peer review process stifles innovation in experimentation, and acts as a poor screen against plagiarism. Despite its downfalls, there has not yet been a foolproof system developed to take the place of peer review, however, researchers have been looking into electronic means of improving the peer review process. Unfortunately, the recent explosion in online only/electronic journals has led to mass publication of a large number of scientific articles with little or no peer review. This poses significant risk to advances in scientific knowledge and its future potential. The current article summarizes the peer review process, highlights the pros and cons associated with different types of peer review, and describes new methods for improving peer review. PMID:27683470
Random Versus Nonrandom Peer Review: A Case for More Meaningful Peer Review.
Itri, Jason N; Donithan, Adam; Patel, Sohil H
2018-05-10
Random peer review programs are not optimized to discover cases with diagnostic error and thus have inherent limitations with respect to educational and quality improvement value. Nonrandom peer review offers an alternative approach in which diagnostic error cases are targeted for collection during routine clinical practice. The objective of this study was to compare error cases identified through random and nonrandom peer review approaches at an academic center. During the 1-year study period, the number of discrepancy cases and score of discrepancy were determined from each approach. The nonrandom peer review process collected 190 cases, of which 60 were scored as 2 (minor discrepancy), 94 as 3 (significant discrepancy), and 36 as 4 (major discrepancy). In the random peer review process, 1,690 cases were reviewed, of which 1,646 were scored as 1 (no discrepancy), 44 were scored as 2 (minor discrepancy), and none were scored as 3 or 4. Several teaching lessons and quality improvement measures were developed as a result of analysis of error cases collected through the nonrandom peer review process. Our experience supports the implementation of nonrandom peer review as a replacement to random peer review, with nonrandom peer review serving as a more effective method for collecting diagnostic error cases with educational and quality improvement value. Copyright © 2018 American College of Radiology. Published by Elsevier Inc. All rights reserved.
Liaw, Lucy; Freedman, Jane E; Becker, Lance B; Mehta, Nehal N; Liscum, Laura
2017-08-04
The biomedical research enterprise depends on the fair and objective peer review of research grants, leading to the distribution of resources through efficient and robust competitive methods. In the United States, federal funding agencies and foundations collectively distribute billions of dollars annually to support biomedical research. For the American Heart Association, a Peer Review Subcommittee is charged with establishing the highest standards for peer review. This scientific statement reviews the current literature on peer review practices, describes the current American Heart Association peer review process and those of other agencies, analyzes the strengths and weaknesses of American Heart Association peer review practices, and recommends best practices for the future. © 2017 American Heart Association, Inc.
School Experiences of Siblings of Children with Chronic Illness: A Systematic Literature Review.
Gan, Lucy L; Lum, Alistair; Wakefield, Claire E; Nandakumar, Beeshman; Fardell, Joanna E
Siblings of children with chronic illness have unique experiences that can affect their school functioning, such that they may miss ongoing periods of school, experience difficulties with schoolwork or experience changes in their peer and teacher interactions. This review provides an overview of these siblings' school experiences. Six databases (Medline, PsychINFO, CINAHL, ERIC, Embase and The Cochrane Library) were systematically searched for studies examining the school experiences and peer relationships of siblings of children with chronic illness, as well as school-based interventions for these siblings. Studies were included if they were published in or after 2000 and were published in English. We identified 2137 articles upon initial search. From these, we identified 28 eligible studies examining the school experiences of >1470 siblings of children with chronic illness. Three key themes were identified throughout the reviewed articles. The literature described 1) the psychological impact on siblings at school; 2) decreases in school attendance and academic functioning, and; 3) changes or perceived differences in peer and teacher interactions. Siblings value teacher and peer support, and this support may contribute to better sibling school functioning. Many siblings are socially resilient, yet overlooked, members of the family who may present with psychological, academic and peer related difficulties at school following diagnosis of a brother or sister with chronic illness. Future research is needed to further delineate the sibling school experience to better facilitate the development of targeted sibling support interventions within the school environment. Copyright © 2016 Elsevier Inc. All rights reserved.
The Impact of Peer Review on Writing in a Psychology Course: Lessons Learned
ERIC Educational Resources Information Center
Bhullar, Naureen; Rose, Karen C.; Utell, Janine M.; Healey, Kathryn N.
2014-01-01
The authors assessed the impact of peer review on student writing in four sections of an undergraduate Developmental Psychology course. They hypothesized that peer review would result in better writing in the peer review group compared to the group with no peer review. Writing was rated independently by two instructors who were blind to the…
Code of Federal Regulations, 2010 CFR
2010-07-01
... Judicial Administration DEPARTMENT OF JUSTICE OJJDP COMPETITION AND PEER REVIEW PROCEDURES Peer Review § 34.111 Compensation. All peer reviewers will be eligible to be paid according to applicable regulations... provided in the OJJDP “Peer Review Guideline”. ...
Total Risk Integrated Methodology (TRIM) - Peer Review and Publications
Peer review: Consistent with Agency peer review policy, and the 1994 Agency Task Force on Environmental Regulatory Modeling, internal and external peer review has been an integral part of the TRIM development plan.
Scholarly publishing depends on peer reviewers.
Fernandez-Llimos, Fernando
2018-01-01
The peer-review crisis is posing a risk to the scholarly peer-reviewed journal system. Journals have to ask many potential peer reviewers to obtain a minimum acceptable number of peers accepting reviewing a manuscript. Several solutions have been suggested to overcome this shortage. From reimbursing for the job, to eliminating pre-publication reviews, one cannot predict which is more dangerous for the future of scholarly publishing. And, why not acknowledging their contribution to the final version of the article published? PubMed created two categories of contributors: authors [AU] and collaborators [IR]. Why not a third category for the peer-reviewer?
NASA Astrophysics Data System (ADS)
Bourqui, Michel; Bolduc, Cassandra; Paul, Charbonneau; Marie, Charrière; Daniel, Hill; Angelica, Lopez; Enrique, Loubet; Philippe, Roy; Barbara, Winter
2015-04-01
This talk introduces a scientists-initiated, new online platform whose aim is to contribute to making climate sciences become public knowledge. It takes a unique bottom-up approach, strictly founded on individual-based participation, high scientific standards and independence The main purpose is to build an open-access, multilingual and peer-reviewed journal publishing short climate articles in non-scientific language. The targeted public includes journalists, teachers, students, local politicians, economists, members of the agriculture sector, and any other citizens from around the world with an interest in climate sciences. This journal is meant to offer a simple and direct channel for scientists wishing to disseminate their research to the general public. A high standard of climate articles is ensured through: a) requiring that the main author is an active climate scientist, and b) an innovative peer-review process involving scientific and non-scientific referees with distinct roles. The platform fosters the direct participation of non-scientists through co-authoring, peer-reviewing, language translation. It furthermore engages the general public in the scientific inquiry by allowing non-scientists to invite manuscripts to be written on topics of their concern. The platform is currently being developed by a community of scientists and non-scientists. In this talk, I will present the basic ideas behind this new online platform, its current state and the plans for the next future. The beta version of the platform is available at: http://www.climateonline.bourquiconsulting.ch
Jernigan, David; Noel, Jonathan; Landon, Jane; Thornton, Nicole; Lobstein, Tim
2017-01-01
Youth alcohol consumption is a major global public health concern. Previous reviews have concluded that exposure to alcohol marketing was associated with earlier drinking initiation and higher alcohol consumption among youth. This review examined longitudinal studies published since those earlier reviews. Peer-reviewed papers were identified in medical, scientific and social science databases, supplemented by examination of reference lists. Non-peer-reviewed papers were included if they were published by organizations deemed to be authoritative, were fully referenced and contained primary data not available elsewhere. Papers were restricted to those that included measures of marketing exposure and alcohol consumption for at least 500 underage people. Multiple authors reviewed studies for inclusion and assessed their quality using the National Heart, Lung and Blood Institute's Quality Assessment Tool for Observation Cohort and Cross-Sectional Studies. Twelve studies (ranging in duration from 9 months to 8 years), following nine unique cohorts not reported on previously involving 35 219 participants from Europe, Asia and North America, met inclusion criteria. All 12 found evidence of a positive association between level of marketing exposure and level of youth alcohol consumption. Some found significant associations between youth exposure to alcohol marketing and initiation of alcohol use (odds ratios ranging from 1.00 to 1.69), and there were clear associations between exposure and subsequent binge or hazardous drinking (odds ratios ranging from 1.38 to 2.15). Mediators included marketing receptivity, brand recognition and alcohol expectancies. Levels of marketing exposure among younger adolescents were similar to those found among older adolescents and young adults. Young people who have greater exposure to alcohol marketing appear to be more likely subsequently to initiate alcohol use and engage in binge and hazardous drinking. © 2016 Society for the Study of Addiction.
Nguyen, Vivian M; Haddaway, Neal R; Gutowsky, Lee F G; Wilson, Alexander D M; Gallagher, Austin J; Donaldson, Michael R; Hammerschlag, Neil; Cooke, Steven J
2015-01-01
Delays in peer reviewed publication may have consequences for both assessment of scientific prowess in academics as well as communication of important information to the knowledge receptor community. We present an analysis on the perspectives of authors publishing in conservation biology journals regarding their opinions on the importance of speed in peer-review as well as how to improve review times. Authors were invited to take part in an online questionnaire, of which the data was subjected to both qualitative (open coding, categorizing) and quantitative analyses (generalized linear models). We received 637 responses to a total of 6,547 e-mail invitations sent. Peer-review speed was generally perceived as slow, with authors experiencing a typical turnaround time of 14 weeks while their perceived optimal review time is six weeks. Male and younger respondents seem to have higher expectations of review speed than females and older respondents. Majority of participants attributed lengthy review times to the 'stress' on the peer-review system (i.e., reviewer and editor fatigue), while editor persistence and journal prestige were believed to speed up the review process. Negative consequences of lengthy review times appear to be greater for early career researchers and can also have impact on author morale (e.g. motivation or frustration). Competition among colleagues were also of concern to respondents. Incentivizing peer review was among the top suggested alterations to the system along with training graduate students in peer review, increased editorial persistence, and changes to the norms of peer-review such as opening the peer-review process to the public. It is clear that authors surveyed in this study view the peer-review system as under stress and we encourage scientists and publishers to push the envelope for new peer review models.
The ethics of peer review in bioethics.
Wendler, David; Miller, Franklin
2014-10-01
A good deal has been written on the ethics of peer review, especially in the scientific and medical literatures. In contrast, we are unaware of any articles on the ethics of peer review in bioethics. Recognising this gap, we evaluate the extant proposals regarding ethical standards for peer review in general and consider how they apply to bioethics. We argue that scholars have an obligation to perform peer review based on the extent to which they personally benefit from the peer review process. We also argue, contrary to existing proposals and guidelines, that it can be appropriate for peer reviewers to benefit in their own scholarship from the manuscripts they review. With respect to bioethics in particular, we endorse double-blind review and suggest several ways in which the peer review process might be improved. Published by the BMJ Publishing Group Limited. For permission to use (where not already granted under a licence) please go to http://group.bmj.com/group/rights-licensing/permissions.
Medical journal peer review: process and bias.
Manchikanti, Laxmaiah; Kaye, Alan D; Boswell, Mark V; Hirsch, Joshua A
2015-01-01
Scientific peer review is pivotal in health care research in that it facilitates the evaluation of findings for competence, significance, and originality by qualified experts. While the origins of peer review can be traced to the societies of the eighteenth century, it became an institutionalized part of the scholarly process in the latter half of the twentieth century. This was a response to the growth of research and greater subject specialization. With the current increase in the number of specialty journals, the peer review process continues to evolve to meet the needs of patients, clinicians, and policy makers. The peer review process itself faces challenges. Unblinded peer review might suffer from positive or negative bias towards certain authors, specialties, and institutions. Peer review can also suffer when editors and/or reviewers might be unable to understand the contents of the submitted manuscript. This can result in an inability to detect major flaws, or revelations of major flaws after acceptance of publication by the editors. Other concerns include potentially long delays in publication and challenges uncovering plagiarism, duplication, corruption and scientific misconduct. Conversely, a multitude of these challenges have led to claims of scientific misconduct and an erosion of faith. These challenges have invited criticism of the peer review process itself. However, despite its imperfections, the peer review process enjoys widespread support in the scientific community. Peer review bias is one of the major focuses of today's scientific assessment of the literature. Various types of peer review bias include content-based bias, confirmation bias, bias due to conservatism, bias against interdisciplinary research, publication bias, and the bias of conflicts of interest. Consequently, peer review would benefit from various changes and improvements with appropriate training of reviewers to provide quality reviews to maintain the quality and integrity of research without bias. Thus, an appropriate, transparent peer review is not only ideal, but necessary for the future to facilitate scientific progress.
SU-E-T-211: Peer Review System for Ensuring Quality of Radiation Therapy Treatments.
Kapoor, R; Kapur, P; Kumar, S A; Alex, D; Ranka, S; Palta, J
2012-06-01
To demonstrate a Web-based electronic peer review system that has the potential to improve quality of care for radiation therapy patients. The system provides tools that allow radiation oncologists to seek peer review of target and critical structure delineation, treatment plans, and share clinical data with peers to optimize radiation therapy treatments. Peer review of radiation therapy treatment planning data prior to its initiation improves the quality of radiation therapy and clinical outcomes. Web-based access to radiation therapy treatment planning data and medical records mitigate existing geographical and temporal constraints. With internet access, the healthcare provider can access the data from any location and review it in an interactive and collaborative manner. Interoperability standard like DICOM-RT and IHE-RO compliant RT Systems have facilitated the design and implementation of PRS with Silverlight Web technology, .net Framework and SQL Server. Local DICOM-RT archive and cloud based services are deployed to facilitate remote peer reviews. To validate the PRS system, we tested the system for 100 patients with Philips Pinnacle v 9.0 and Varian Eclipse v 8.9 treatment planning system (TPS). We transmitted the DICOM RT data from the TPS to the cloud based services via the PRS local DICOM RT Archive. Various CT simulation based parameters such as orientation of CT, properties of RT structures etc. were compared between the TPS and PRS system. Data integrity of other parameters such as patient demographics (patient name, ID, attending physician etc.) and dose volume related parameters were also evaluated. Such rigorous testing allowed us to optimize the functionalities and clinical implementation of the PRS. We believe that the PRS will improve the quality and safety of a broad spectrum of radiation therapy patients treated in underserved areas while discouraging the overutilization of expensive radiation treatment modalities. This research and development project is supported by the James and Ester King Biomedical Research Program grant # RC1-09KW-09-26829. © 2012 American Association of Physicists in Medicine.
ERIC Educational Resources Information Center
Brennan, John; And Others
This report examines the practices of 19 peer review agencies in the United States, Britain, Denmark, Germany, France, the Netherlands, and Hong Kong to determine variations in peer review in the field of higher education. The report addresses: (1) the sources of authority for peer review; (2) the types and status of peer reviewers; (3) the…
ERIC Educational Resources Information Center
Flynn, Elizabeth A.
2011-01-01
In this article, the author revisits her essay, "Students as Readers of Their Classmates' Writing," by providing a review of the literature on peer review over the past three decades and comments on patterns she sees in waves of peer review research and theorizing. She describes her subsequent experience with peer review in her own classes, and…
Bringing climate sciences to the general public with the Climanosco initiative
NASA Astrophysics Data System (ADS)
Bourqui, Michel; Bolduc, Cassandra; Charbonneau, Paul; Charrière, Marie; Hill, Daniel; Lòpez Gladko, Angélica; Loubet, Enrique; Roy, Philippe; Winter, Barbara
2016-04-01
This paper presents the first months of operation of the scientists-initiated Climanosco.org platform. The goal of this initiative is to bridge climate sciences with the general public by building a network of climate scientists and citizens around the world, by stimulating the writing of quality climate science articles in non-scientific language, and by publishing these articles in an open-access, multilingual format. For the climate scientist, this platform will offer a simple and reliable channel to disseminate research results to the general public. High standards are enforced by: a) requiring that the main author is an active climate scientist, and b) an innovative peer-review process involving scientific and non-scientific referees with distinct roles. Direct participation of non-scientists is allowed through co-authoring, peer-reviewing, language translation. Furthermore, public engagement is stimulated by allowing non-scientists to invite manuscripts to be written by scientists on topics of their concern. The targeted public includes journalists, teachers, students, local politicians, economists, members of the agriculture sector, and any other citizens from around the world with an interest in climate sciences. The initiative is now several months into operations. In this paper, I will discuss what we have achieved so far and what we plan for the next future.
Levis, Alexander W; Leentjens, Albert F G; Levenson, James L; Lumley, Mark A; Thombs, Brett D
2015-12-01
Some peer reviewers may inappropriately, or coercively request that authors include references to the reviewers' own work. The objective of this study was to evaluate whether, compared to reviews for a journal with single-blind peer review, reviews for a journal with open peer review included (1) fewer self-citations; (2) a lower proportion of self-citations without a rationale; and (3) a lower ratio of proportions of citations without a rationale in self-citations versus citations to others' work. Peer reviews for published manuscripts submitted in 2012 to a single-blind peer review journal, the Journal of Psychosomatic Research, were previously evaluated (Thombs et al., 2015). These were compared to publically available peer reviews of manuscripts published in 2012 in an open review journal, BMC Psychiatry. Two investigators independently extracted data for both journals. There were no significant differences between journals in the proportion of all reviewer citations that were self-citations (Journal of Psychosomatic Research: 71/225, 32%; BMC Psychiatry: 90/315, 29%; p=.50), or in the proportion of self-citations without a rationale (Journal of Psychosomatic Research: 15/71, 21%; BMC Psychiatry: 12/90, 13%; p=.21). There was no significant difference between journals in the proportion of self-citations versus citations to others' work without a rationale (p=.31). Blind and open peer review methodologies have distinct advantages and disadvantages. The present study found that, in reasonably similar journals that use single-blind and open review, there were no substantive differences in the pattern of peer reviewer self-citations. Copyright © 2015 Elsevier Inc. All rights reserved.
Advancing Kinesiology through Improved Peer Review
ERIC Educational Resources Information Center
Knudson, Duane V.; Morrow, James R., Jr.; Thomas, Jerry R.
2014-01-01
Peer review of scholarship is essential to journal quality, evidence, knowledge advancement, and application of that knowledge in any field. This commentary summarizes recent literature on issues related to peer-review quality and current review practice in kinesiology and provides recommendations to improve peer review in kinesiology journals. We…
This is a transcript of a one hour roundtable hosted by the Editor-in-Chief of the journal Applied In Vitro Toxicology. This transcript was published as a roundtable discussion and was not peer reviewed.
Demystifying the peer-review process - workshop
Scientific writing and peer-review are integral parts of the publishing process. This workshop aims to demystify the peer-review process for early career scientists and provide insightful tips for streamlining the submission and peer review process for all researchers. Providing ...
Academic Primer Series: Key Papers About Peer Review.
Yarris, Lalena M; Gottlieb, Michael; Scott, Kevin; Sampson, Christopher; Rose, Emily; Chan, Teresa M; Ilgen, Jonathan
2017-06-01
Peer review, a cornerstone of academia, promotes rigor and relevance in scientific publishing. As educators are encouraged to adopt a more scholarly approach to medical education, peer review is becoming increasingly important. Junior educators both receive the reviews of their peers, and are also asked to participate as reviewers themselves. As such, it is imperative for junior clinician educators to be well-versed in the art of peer reviewing their colleagues' work. In this article, our goal was to identify and summarize key papers that may be helpful for faculty members interested in learning more about the peer-review process and how to improve their reviewing skills. The online discussions of the 2016-17 Academic Life in Emergency Medicine (ALiEM) Faculty Incubator program included a robust discussion about peer review, which highlighted a number of papers on that topic. We sought to augment this list with further suggestions by guest experts and by an open call on Twitter for other important papers. Via this process, we created a list of 24 total papers on the topic of peer review. After gathering these papers, our authorship group engaged in a consensus-building process incorporating Delphi methods to identify the papers that best described peer review, and also highlighted important tips for new reviewers. We found and reviewed 24 papers. In our results section, we present our authorship group's top five most highly rated papers on the topic of peer review. We also summarize these papers with respect to their relevance to junior faculty members and to faculty developers. We present five key papers on peer review that can be used for faculty development for novice writers and reviewers. These papers represent a mix of foundational and explanatory papers that may provide some basis from which junior faculty members might build upon as they both undergo the peer-review process and act as reviewers in turn.
Academic Primer Series: Key Papers About Peer Review
Yarris, Lalena M.; Gottlieb, Michael; Scott, Kevin; Sampson, Christopher; Rose, Emily; Chan, Teresa M.; Ilgen, Jonathan
2017-01-01
Introduction Peer review, a cornerstone of academia, promotes rigor and relevance in scientific publishing. As educators are encouraged to adopt a more scholarly approach to medical education, peer review is becoming increasingly important. Junior educators both receive the reviews of their peers, and are also asked to participate as reviewers themselves. As such, it is imperative for junior clinician educators to be well-versed in the art of peer reviewing their colleagues’ work. In this article, our goal was to identify and summarize key papers that may be helpful for faculty members interested in learning more about the peer-review process and how to improve their reviewing skills. Methods The online discussions of the 2016–17 Academic Life in Emergency Medicine (ALiEM) Faculty Incubator program included a robust discussion about peer review, which highlighted a number of papers on that topic. We sought to augment this list with further suggestions by guest experts and by an open call on Twitter for other important papers. Via this process, we created a list of 24 total papers on the topic of peer review. After gathering these papers, our authorship group engaged in a consensus-building process incorporating Delphi methods to identify the papers that best described peer review, and also highlighted important tips for new reviewers. Results We found and reviewed 24 papers. In our results section, we present our authorship group’s top five most highly rated papers on the topic of peer review. We also summarize these papers with respect to their relevance to junior faculty members and to faculty developers. Conclusion We present five key papers on peer review that can be used for faculty development for novice writers and reviewers. These papers represent a mix of foundational and explanatory papers that may provide some basis from which junior faculty members might build upon as they both undergo the peer-review process and act as reviewers in turn. PMID:28611894
Anderson, Claire; Blenkinsopp, Alison; Armstrong, Miriam
2004-01-01
Abstract Objective To systematically review feedback from pharmacy users on their perceptions and experiences of health‐related advice and services provided from community pharmacies. Methods The focus of the review was community pharmacy activities in relation to promoting health and well‐being, preventing ill‐health and maintaining health. Searches were conducted for peer‐reviewed (international) and non‐peer‐reviewed (UK) research. Electronic databases searched included MEDLINE, EMBASE, Cochrane Library and International Pharmaceutical Abstracts; hand searches of key journals and conference abstracts, key informants. Key informants in the UK were contacted to identify unpublished studies. The inclusion period was 1990 onwards. Data extraction and synthesis Data were abstracted into a matrix by one author with a sample checked by a second. The Health Development Agency's Evidence Base 2000 standards and the evidence categories used by the Department of Health in the National Service Frameworks were applied to each item. Main results Seven peer reviewed papers and 13 non‐peer reviewed reports were identified for inclusion in the review. Consumer usage of pharmacies is almost universal with prescription supplies and purchase of over the counter medicines predominating. Evidence shows that not only is usage low for general health advice, but that pharmacists are perceived as ‘drugs experts’ rather than experts on health and illness. Emergency hormonal contraception and head lice management schemes have been well received. There is a need to consider privacy and confidentiality surrounding advice giving. Conclusions Users of community pharmacy‐based health development initiatives express a high level of satisfaction. If community pharmacies are to be used to their full extent, then actions to extending the public's awareness and acceptance of the pharmacist's role in giving advice will be crucial. Further research will be needed to measure any change in premises development on the public's perception of the level of privacy in pharmacies. PMID:15327458
Impact of peer review audit on occupational health report quality.
Lalloo, D; Demou, E; Macdonald, E B
2015-08-01
In a previous report, we described the implementation of a formal process for peer review of occupational health (OH) reports and a method of assessment of the outcomes of this process. The initial audit identified that 27% of OH reports required modifications. To assess formally, following implementation of this process, if changes in practice had occurred, i.e. whether fewer deficiencies were being identified in reports. We repeated a prospective internal audit of all peer reviewed OH reports between September and November 2011. We used an abbreviated assessment form, based on questions 4-8 and 10-12 of the modified SAIL (Sheffield Assessment Instrument for Letters), with four possible outcomes: no action, no changes made to report following discussion with author, changes made without discussion with author and changes made following discussion with author. One hundred seventy-three reports by 10 clinicians were audited. The audit identified a 13% reduction in OH reports requiring modifications (from 27 to 14%) compared with the previous cycle. Where modifications were required, 8% of these were related to minor typographical, spelling and grammar errors and 6% were for more complex reasons. Implementation of this process also produced a reduction in clinical complaints about OH reports from customers, from three in the preceding year to none 2 years later. Peer review improved the standard of OH reports and was associated with a reduction in customer complaints about reports. © The Author 2015. Published by Oxford University Press on behalf of the Society of Occupational Medicine.
Paired peer review of university classroom teaching in a school of nursing and midwifery.
Bennett, Paul N; Parker, Steve; Smigiel, Heather
2012-08-01
Peer review of university classroom teaching can increase the quality of teaching but is not universally practiced in Australian universities. To report an evaluation of paired peer-review process using both paper and web based teaching evaluation tools. Twenty university teachers in one metropolitan Australian School of Nursing and Midwifery were randomly paired and then randomly assigned to a paper based or web-based peer review tool. Each teacher reviewed each other's classroom teaching as part of a peer review program. The participants then completed an 18 question survey evaluating the peer review tool and paired evaluation process. Responses were analyzed using frequencies and percentages. Regardless of the tool used, participants found this process of peer review positive (75%), collegial (78%), supportive (61%) and non-threatening (71%). Participants reported that the peer review will improve their own classroom delivery (61%), teaching evaluation (61%) and planning (53%). The web-based tool was found to be easier to use and allowed more space than the paper-based tool. Implementation of a web-based paired peer review system can be a positive method of peer review of university classroom teaching. Pairing of teachers to review each other's classroom teaching is a promising strategy and has the potential to improve teaching in teaching universities. Copyright © 2011 Elsevier Ltd. All rights reserved.
Brundage, Michael D; Hart, Margaret; O'Donnell, Jennifer; Reddeman, Lindsay; Gutierrez, Eric; Foxcroft, Sophie; Warde, Padraig
Peer review of radiation oncology treatment plans is increasingly recognized as an important component of quality assurance in radiation treatment planning and delivery. Peer review of treatment plans can directly improve the quality of those plans and can also have indirect effects on radiation treatment programs. We undertook a systematic, qualitative approach to describing the indirect benefits of peer review, factors that were seen to facilitate or act as barriers to the implementation of peer review, and strategies to address these barriers across a provincial jurisdiction of radiation oncology programs (ROPs). Semistructured qualitative interviews were held with radiation oncology department heads and radiation therapy managers (or delegates) in all 14 ROPs in Ontario, Canada. We used a theoretically guided phenomenological qualitative approach to design and analyze the interview content. Themes were recorded by 2 independent reviewers, and any discordance was resolved by consensus. A total of 28 interviews were completed with 32 interviewees. Twenty-two unique themes addressed perceived benefits of peer review, relating to either peer review structure (n = 3), process (n = 9), or outcome (n = 10). Of these 22 themes, 19 related to indirect benefits to ROPs. In addition, 18 themes related to factors that facilitated peer review activities and 30 themes related to key barriers to implementing peer review were identified. Findings were consistent with, and enhanced the understanding of, previous survey-based assessments of the benefits and challenges of implementing peer review programs. Although challenges and concerns regarding the implementation of peer review were evident, the indirect benefits to radiation programs are numerous, far outweigh the implementation challenges, and strongly complement the direct individual-patient benefits that result from peer review quality assurance of radiation treatment plans. Copyright © 2016. Published by Elsevier Inc.
The PSRO hospital review system.
Goran, M J; Roberts, J S; Kellogg, M A; Fielding, J; Jessee, W
1975-04-01
The 1972 Social Security amendments contained the landmark Professional Standards Review Organization (PSRO) provisions as well as several sections upgrading existing utilization review (UR) requirements under Medicare and Medicaid. With issuance of the PSRO Program Manual and the recent publication of the new UR regulations, HEW for the first time has brought Medicare and Medicaid hospital review requirements into conformity and made them compatible with and supportive of the PSRO program. This article defines the PSRO hospital review system, describes how the three major components-concurrent review, medical care evaluation studies, and profile analysis-interrelate and provides examples of each of these components. Under utilization review requirements or PSRO, hospitals will be required to implement an integrated system of review designed to assure appropriate utilization practices and improve the quality of care. These aims are to be accomplished through the application of concepts of peer review, the use of norms, criteria, and standards, the identification of deficiencies in the quality, administration, or appropriateness of health care services, and their correction through linkage with programs of continuing medical education. Although PSROs are initially responsible for review in hospitals, they will likely provide the locus for a community-wide system of peer review for all services provided under National Health Insurance.
Peer review versus editorial review and their role in innovative science.
Steinhauser, Georg; Adlassnig, Wolfram; Risch, Jesaka Ahau; Anderlini, Serena; Arguriou, Petros; Armendariz, Aaron Zolen; Bains, William; Baker, Clark; Barnes, Martin; Barnett, Jonathan; Baumgartner, Michael; Baumgartner, Thomas; Bendall, Charles A; Bender, Yvonne S; Bichler, Max; Biermann, Teresa; Bini, Ronaldo; Blanco, Eduardo; Bleau, John; Brink, Anthony; Brown, Darin; Burghuber, Christopher; Calne, Roy; Carter, Brian; Castaño, Cesar; Celec, Peter; Celis, Maria Eugenia; Clarke, Nicky; Cockrell, David; Collins, David; Coogan, Brian; Craig, Jennifer; Crilly, Cal; Crowe, David; Csoka, Antonei B; Darwich, Chaza; Del Kebos, Topiciprin; Derinaldi, Michele; Dlamini, Bongani; Drewa, Tomasz; Dwyer, Michael; Eder, Fabienne; de Palma, Raúl Ehrichs; Esmay, Dean; Rött, Catherine Evans; Exley, Christopher; Falkov, Robin; Farber, Celia Ingrid; Fearn, William; Felsmann, Sophie; Flensmark, Jarl; Fletcher, Andrew K; Foster, Michaela; Fountoulakis, Kostas N; Fouratt, Jim; Blanca, Jesus Garcia; Sotelo, Manuel Garrido; Gittler, Florian; Gittler, Georg; Gomez, Juan; Gomez, Juan F; Polar, Maria Grazia Gonzales; Gonzalez, Jossina; Gösselsberger, Christoph; Habermacher, Lynn; Hajek, Michael; Hakala, Faith; Haliburton, Mary-Sue; Hankins, John Robert; Hart, Jason; Hasslberger, Sepp; Hennessey, Donalyn; Herrmann, Andrea; Hersee, Mike; Howard, Connie; Humphries, Suzanne; Isharc, Laeeth; Ivanovski, Petar; Jenuth, Stephen; Jerndal, Jens; Johnson, Christine; Keleta, Yonas; Kenny, Anna; Kidd, Billie; Kohle, Fritz; Kolahi, Jafar; Koller-Peroutka, Marianne; Kostova, Lyubov; Kumar, Arunachalam; Kurosawa, Alejandro; Lance, Tony; Lechermann, Michael; Lendl, Bernhard; Leuchters, Michael; Lewis, Evan; Lieb, Edward; Lloyd, Gloria; Losek, Angelika; Lu, Yao; Maestracci, Saadia; Mangan, Dennis; Mares, Alberto W; Barnett, Juan Mazar; McClain, Valerie; McNair, John Sydney; Michael, Terry; Miller, Lloyd; Monzani, Partizia; Moran, Belen; Morris, Mike; Mößmer, Georg; Mountain, Johny; Phuthe, Onnie Mary Moyo; Muñoz, Marcos; Nakken, Sheri; Wambui, Anne Nduta; Neunteufl, Bettina; Nikolić, Dimitrije; Oberoi, Devesh V; Obmode, Gregory; Ogar, Laura; Ohara, Jo; Rybine, Naion Olej; Owen, Bryan; Owen, Kim Wilson; Parikh, Rakesh; Pearce, Nicholas J G; Pemmer, Bernhard; Piper, Chris; Prince, Ian; Reid, Terence; Rindermann, Heiner; Risch, Stefan; Robbins, Josh; Roberts, Seth; Romero, Ajeandro; Rothe, Michael Thaddäus; Ruiz, Sergio; Sacher, Juliane; Sackl, Wolfgang; Salletmaier, Markus; Sanand, Jairaj; Sauerzopf, Clemens; Schwarzgruber, Thomas; Scott, David; Seegers, Laura; Seppi, David; Shields, Kyle; Siller-Matula, Jolanta; Singh, Beldeu; Sithole, Sibusio; Six, Florian; Skoyles, John R; Slofstra, Jildou; Sole, Daphne Anne; Sommer, Werner F; Sonko, Mels; Starr-Casanova, Chrislie J; Steakley, Marjorie Elizabeth; Steinhauser, Wolfgang; Steinhoff, Konstantin; Sterba, Johannes H; Steppan, Martin; Stindl, Reinhard; Stokely, Joe; Stokely, Karri; St-Pierre, Gilles; Stratford, James; Streli, Christina; Stryg, Carl; Sullivan, Mike; Summhammer, Johann; Tadesse, Amhayes; Tavares, David; Thompson, Laura; Tomlinson, Alison; Tozer, Jack; Trevisanato, Siro I; Trimmel, Michaela; Turner, Nicole; Vahur, Paul; van der Byl, Jennie; van der Maas, Tine; Varela, Leo; Vega, Carlos A; Vermaak, Shiloh; Villasenor, Alex; Vogel, Matt; von Wintzigerode, Georg; Wagner, Christoph; Weinberger, Manuel; Weinberger, Peter; Wilson, Nick; Wolfe, Jennifer Finocchio; Woodley, Michael A; Young, Ian; Zuraw, Glenn; Zwiren, Nicole
2012-10-01
Peer review is a widely accepted instrument for raising the quality of science. Peer review limits the enormous unstructured influx of information and the sheer amount of dubious data, which in its absence would plunge science into chaos. In particular, peer review offers the benefit of eliminating papers that suffer from poor craftsmanship or methodological shortcomings, especially in the experimental sciences. However, we believe that peer review is not always appropriate for the evaluation of controversial hypothetical science. We argue that the process of peer review can be prone to bias towards ideas that affirm the prior convictions of reviewers and against innovation and radical new ideas. Innovative hypotheses are thus highly vulnerable to being "filtered out" or made to accord with conventional wisdom by the peer review process. Consequently, having introduced peer review, the Elsevier journal Medical Hypotheses may be unable to continue its tradition as a radical journal allowing discussion of improbable or unconventional ideas. Hence we conclude by asking the publisher to consider re-introducing the system of editorial review to Medical Hypotheses.
On the evolving open peer review culture for chemical information science.
Walters, W Patrick; Bajorath, Jürgen
2015-01-01
Compared to the traditional anonymous peer review process, open post-publication peer review provides additional opportunities -and challenges- for reviewers to judge scientific studies. In this editorial, we comment on the open peer review culture and provide some guidance for reviewers of manuscripts submitted to the Chemical Information Science channel of F1000Research.
A novel approach to quality improvement in a safety-net practice: concurrent peer review visits.
Fiscella, Kevin; Volpe, Ellen; Winters, Paul; Brown, Melissa; Idris, Amna; Harren, Tricia
2010-12-01
Concurrent peer review visits are structured office visits conducted by clinician peers of the primary care clinician that are specifically designed to reduce competing demands, clinical inertia, and bias. We assessed whether a single concurrent peer review visit reduced clinical inertia and improved control of hypertension, hyperlipidemia, and diabetes control among underserved patients. We conducted a randomized encouragement trial to evaluate concurrent peer review visits with a community health center. Seven hundred twenty-seven patients with hypertension, hyperlipidemia, and/or diabetes who were not at goal for systolic blood pressure (SBP), low-density lipoprotein cholesterol (LDL-C), and/or glycated hemoglobin (A1c) were randomly assigned to an invitation to participate in a concurrent peer review visit or to usual care. We compared change in these measures using mixed models and rates of therapeutic intensification during concurrent peer review visits with control visits. One hundred seventy-one patients completed a concurrent peer review visit. SBP improved significantly (p < .01) more among those completing concurrent peer review visits than among those who failed to respond to a concurrent peer review invitation or those randomized to usual care. There were no differences seen for changes in LDL-C or A1c. Concurrent peer review visits were associated with statistically significant greater clinician intensification of blood pressure (p < .001), lipid (p < .001), and diabetes (p < .005) treatment than either for control visits for patients in either the nonresponse group or usual care group. Concurrent peer review visits represent a promising strategy for improving blood pressure control and improving therapeutic intensification in community health centers.
Why Participate in Peer Review as a Journal Manuscript Reviewer: What's in It for You?
Pytynia, Kristen B
2017-06-01
The peer review process for scientific journals relies on the efforts of volunteer reviewers. Reviewers are selected due to their expertise in their fields. With so many demands on professional time, the benefits of participating in peer review may not be obvious. However, reviewers benefit by exposure to the latest developments in their fields, facilitating their keeping up-to-date with the latest publications. Tenure committees look favorably on participation in peer review, and invitations to review underscore that the reviewer is a respected subject matter expert. Contacts made during the peer review process can lead to long-lasting collaboration. Continuing medical education credit can be obtained through various mechanisms. Overall, participating in peer review is an important part of career development and should be viewed as a critical component of advancement.
48 CFR 215.270 - Peer Reviews.
Code of Federal Regulations, 2010 CFR
2010-10-01
... 48 Federal Acquisition Regulations System 3 2010-10-01 2010-10-01 false Peer Reviews. 215.270 Section 215.270 Federal Acquisition Regulations System DEFENSE ACQUISITION REGULATIONS SYSTEM, DEPARTMENT... of Proposals and Information 215.270 Peer Reviews. Agency officials shall conduct Peer Reviews in...
Peer teaching as an educational tool in Pharmacy schools; fruitful or futile.
Aburahma, Mona Hassan; Mohamed, Heba Moustafa
2017-11-01
In the past decade, various health care programs have implemented diverse types of peer-assisted learning (PAL) programs, in particularly peer teaching (PT), due to their reported benefits for students (both those undertaking teaching and those being taught), teachers, and educational institutes. Unfortunately, peer teaching is still under-recognized in pharmacy programs worldwide when compared to other health care programs. The aim of this review is to provide an overview of the published literature centered on formal PT programs that are implemented in pharmacy schools. In addition, this review focuses on the methodologies adopted for peer teacher recruitment and training as well as the benefits gained by students (both those undertaking teaching and those being taught). The rationales behind PT implementation are recapitulated as well. Finally, a simple scheme for successful implementation of PT activity is provided to serve as a groundwork for educators. Pre-defined key terms were used to search for experimental peer teaching activities in pharmacy schools between January 2000 and June 2016. Titles were selected based on pre-set eligibility criteria. Only complete research articles with clear design and evaluation sections were included in this review. Studies about inter-professional peer teaching activities between pharmacy students and other healthcare professions were also included. Six relevant educational research articles containing peer teaching activities were included. A lot of variety exists between different pharmacy courses implementing PT, the format/setting of PT, how peer teachers are selected, and how training and evaluation are implemented. The studies reviewed confirmed that PT was well received by most of the students and had a positive impact on their learning outcome. These findings cannot be generalized due to the insufficient number of studies published beside their methodological limitations and inadequate descriptions of the PT format. Though PT may be regarded as a feasible teaching strategy, care must be taken during implementation to ensure the fulfillment of the educational objectives. Proper validation of any PT initiative is required before incorporation into the pharmacy curriculum. More research using proper design and suitable sample sizes are recommended to determine the effect of PT activity on students' learning, skills development and confidence. Copyright © 2017 Elsevier Inc. All rights reserved.
Fisher, Edwin B; Boothroyd, Renée I; Elstad, Emily A; Hays, Laura; Henes, Amy; Maslow, Gary R; Velicer, Clayton
2017-01-01
Examine Peer Support (PS) for complex, sustained health behaviors in prevention or disease management with emphasis on diabetes prevention and management. PS was defined as emotional, motivational and practical assistance provided by nonprofessionals for complex health behaviors. Initial review examined 65 studies drawn from 1442 abstracts identified through PubMed, published 1/1/2000-7/15/2011. From this search, 24 reviews were also identified. Extension of the search in diabetes identified 30 studies published 1/1/2000-12/31/2015. In initial review, 54 of all 65 studies (83.1%) reported significant impacts of PS, 40 (61.5%) reporting between-group differences and another 14 (21.5%) reporting significant within-group changes. Across 19 of 24 reviews providing quantifiable findings, a median of 64.5% of studies reviewed reported significant effects of PS. In extended review of diabetes, 26 of all 30 studies (86.7%) reported significant impacts of PS, 17 (56.7%) reporting between-group differences and another nine (30.0%) reporting significant within-group changes. Among 19 of these 30 reporting HbA1c data, average reduction was 0.76 points. Studies that did not find effects of PS included other sources of support, implementation or methodological problems, lack of acceptance of interventions, poor fit to recipient needs, and possible harm of unmoderated PS. Across diverse settings, including under-resourced countries and health care systems, PS is effective in improving complex health behaviors in disease prevention and management including in diabetes.
Optimal strategies to consider when peer reviewing a systematic review and meta-analysis.
Moher, David
2015-11-02
Systematic reviews are popular. A recent estimate indicates that 11 new systematic reviews are published daily. Nevertheless, evidence indicates that the quality of reporting of systematic reviews is not optimal. One likely reason is that the authors' reports have received inadequate peer review. There are now many different types of systematic reviews and peer reviewing them can be enhanced by using a reporting guideline to supplement whatever template the journal editors have asked you, as a peer reviewer, to use. Additionally, keeping up with the current literature, whether as a content expert or being aware of advances in systematic review methods is likely be make for a more comprehensive and effective peer review. Providing a brief summary of what the systematic review has reported is an important first step in the peer review process (and not performed frequently enough). At its core, it provides the authors with some sense of what the peer reviewer believes was performed (Methods) and found (Results). Importantly, it also provides clarity regarding any potential problems in the methods, including statistical approaches for meta-analysis, results, and interpretation of the systematic review, for which the peer reviewer can seek explanations from the authors; these clarifications are best presented as questions to the authors.
Neural Correlates of Social Influence on Risk Taking and Substance Use in Adolescents.
Telzer, Eva H; Rogers, Christina R; Van Hoorn, Jorien
2017-09-01
Adolescents often engage in elevated levels of risk taking that gives rise to substance use. Family and peers constitute the primary contextual risk factors for adolescent substance use. This report reviews how families and peers influence adolescent neurocognitive development to inform their risk taking and subsequent substance use. Developmental neuroscience using functional magnetic resonance imaging (fMRI) has identified regions of the brain involved in social cognition, cognitive control, and reward processing that are integrally linked to social influence on adolescent risk taking. These neural mechanisms play a role in how peer and family influence (e.g., physical presence, relationship quality, rejection) translates into adolescent substance use. Peers and families can independently, and in tandem, contribute to adolescent substance use, for better or for worse. We propose that future work utilize fMRI to investigate the neural mechanisms involved in different aspects of peer and family influence, and how these contexts uniquely and interactively influence adolescent substance use initiation and escalation across development.
Miyamoto, Yuki; Sono, Tamaki
2012-01-01
We conducted a comprehensive narrative review and used a systematic search strategy to identify studies related to peer support among adults with mental health difficulties. The purposes of this review were to describe the principles, effects and benefits of peer support documented in the published literature, to discuss challenging aspects of peer support and to investigate lessons from peer support. Fifty-one studies, including 8 review articles and 19 qualitative studies, met the inclusion criteria for this review. Most of the challenges for peer support were related to “role” and “relationship” issues; that is, how peer support providers relate to people who receive peer support and how peer support providers are treated in the system. The knowledge gained from peer support relationships, such as mutual responsibility and interdependence, might be a clue toward redefining the helper-helper relationship as well as the concepts of help and support. PMID:22563347
Kowalczuk, Maria K; Dudbridge, Frank; Nanda, Shreeya; Harriman, Stephanie L; Patel, Jigisha; Moylan, Elizabeth C
2015-01-01
Objectives To assess whether reports from reviewers recommended by authors show a bias in quality and recommendation for editorial decision, compared with reviewers suggested by other parties, and whether reviewer reports for journals operating on open or single-blind peer review models differ with regard to report quality and reviewer recommendations. Design Retrospective analysis of the quality of reviewer reports using an established Review Quality Instrument, and analysis of reviewer recommendations and author satisfaction surveys. Setting BioMed Central biology and medical journals. BMC Infectious Diseases and BMC Microbiology are similar in size, rejection rates, impact factors and editorial processes, but the former uses open peer review while the latter uses single-blind peer review. The Journal of Inflammation has operated under both peer review models. Sample Two hundred reviewer reports submitted to BMC Infectious Diseases, 200 reviewer reports submitted to BMC Microbiology and 400 reviewer reports submitted to the Journal of Inflammation. Results For each journal, author-suggested reviewers provided reports of comparable quality to non-author-suggested reviewers, but were significantly more likely to recommend acceptance, irrespective of the peer review model (p<0.0001 for BMC Infectious Diseases, BMC Microbiology and the Journal of Inflammation). For BMC Infectious Diseases, the overall quality of reviewer reports measured by the Review Quality Instrument was 5% higher than for BMC Microbiology (p=0.042). For the Journal of Inflammation, the quality of reports was the same irrespective of the peer review model used. Conclusions Reviewers suggested by authors provide reports of comparable quality to non-author-suggested reviewers, but are significantly more likely to recommend acceptance. Open peer review reports for BMC Infectious Diseases were of higher quality than single-blind reports for BMC Microbiology. There was no difference in quality of peer review in the Journal of Inflammation under open peer review compared with single blind. PMID:26423855
Code of Federal Regulations, 2010 CFR
2010-10-01
... 42 Public Health 1 2010-10-01 2010-10-01 false Peer review. 24.5 Section 24.5 Public Health PUBLIC....5 Peer review. An individual may not be considered for appointment into the SBRS unless his/her qualifications have been reviewed by a PHS peer review committee and the committee has recommended appointment to...
Rethinking Feedback Practices in Higher Education: A Peer Review Perspective
ERIC Educational Resources Information Center
Nicol, David; Thomson, Avril; Breslin, Caroline
2014-01-01
Peer review is a reciprocal process whereby students produce feedback reviews on the work of peers and receive feedback reviews from peers on their own work. Prior research has primarily examined the learning benefits that result from the receipt of feedback reviews, with few studies specifically exploring the merits of producing feedback reviews…
What is open peer review? A systematic review.
Ross-Hellauer, Tony
2017-01-01
Background : "Open peer review" (OPR), despite being a major pillar of Open Science, has neither a standardized definition nor an agreed schema of its features and implementations. The literature reflects this, with numerous overlapping and contradictory definitions. While for some the term refers to peer review where the identities of both author and reviewer are disclosed to each other, for others it signifies systems where reviewer reports are published alongside articles. For others it signifies both of these conditions, and for yet others it describes systems where not only "invited experts" are able to comment. For still others, it includes a variety of combinations of these and other novel methods. Methods : Recognising the absence of a consensus view on what open peer review is, this article undertakes a systematic review of definitions of "open peer review" or "open review", to create a corpus of 122 definitions. These definitions are systematically analysed to build a coherent typology of the various innovations in peer review signified by the term, and hence provide the precise technical definition currently lacking. Results : This quantifiable data yields rich information on the range and extent of differing definitions over time and by broad subject area. Quantifying definitions in this way allows us to accurately portray exactly how ambiguously the phrase "open peer review" has been used thus far, for the literature offers 22 distinct configurations of seven traits, effectively meaning that there are 22 different definitions of OPR in the literature reviewed. Conclusions : I propose a pragmatic definition of open peer review as an umbrella term for a number of overlapping ways that peer review models can be adapted in line with the aims of Open Science, including making reviewer and author identities open, publishing review reports and enabling greater participation in the peer review process.
Wicherts, Jelte M
2016-01-01
Recent controversies highlighting substandard peer review in Open Access (OA) and traditional (subscription) journals have increased the need for authors, funders, publishers, and institutions to assure quality of peer-review in academic journals. I propose that transparency of the peer-review process may be seen as an indicator of the quality of peer-review, and develop and validate a tool enabling different stakeholders to assess transparency of the peer-review process. Based on editorial guidelines and best practices, I developed a 14-item tool to rate transparency of the peer-review process on the basis of journals' websites. In Study 1, a random sample of 231 authors of papers in 92 subscription journals in different fields rated transparency of the journals that published their work. Authors' ratings of the transparency were positively associated with quality of the peer-review process but unrelated to journal's impact factors. In Study 2, 20 experts on OA publishing assessed the transparency of established (non-OA) journals, OA journals categorized as being published by potential predatory publishers, and journals from the Directory of Open Access Journals (DOAJ). Results show high reliability across items (α = .91) and sufficient reliability across raters. Ratings differentiated the three types of journals well. In Study 3, academic librarians rated a random sample of 140 DOAJ journals and another 54 journals that had received a hoax paper written by Bohannon to test peer-review quality. Journals with higher transparency ratings were less likely to accept the flawed paper and showed higher impact as measured by the h5 index from Google Scholar. The tool to assess transparency of the peer-review process at academic journals shows promising reliability and validity. The transparency of the peer-review process can be seen as an indicator of peer-review quality allowing the tool to be used to predict academic quality in new journals.
Wicherts, Jelte M.
2016-01-01
Background Recent controversies highlighting substandard peer review in Open Access (OA) and traditional (subscription) journals have increased the need for authors, funders, publishers, and institutions to assure quality of peer-review in academic journals. I propose that transparency of the peer-review process may be seen as an indicator of the quality of peer-review, and develop and validate a tool enabling different stakeholders to assess transparency of the peer-review process. Methods and Findings Based on editorial guidelines and best practices, I developed a 14-item tool to rate transparency of the peer-review process on the basis of journals’ websites. In Study 1, a random sample of 231 authors of papers in 92 subscription journals in different fields rated transparency of the journals that published their work. Authors’ ratings of the transparency were positively associated with quality of the peer-review process but unrelated to journal’s impact factors. In Study 2, 20 experts on OA publishing assessed the transparency of established (non-OA) journals, OA journals categorized as being published by potential predatory publishers, and journals from the Directory of Open Access Journals (DOAJ). Results show high reliability across items (α = .91) and sufficient reliability across raters. Ratings differentiated the three types of journals well. In Study 3, academic librarians rated a random sample of 140 DOAJ journals and another 54 journals that had received a hoax paper written by Bohannon to test peer-review quality. Journals with higher transparency ratings were less likely to accept the flawed paper and showed higher impact as measured by the h5 index from Google Scholar. Conclusions The tool to assess transparency of the peer-review process at academic journals shows promising reliability and validity. The transparency of the peer-review process can be seen as an indicator of peer-review quality allowing the tool to be used to predict academic quality in new journals. PMID:26824759
Overcoming Student Resistance to a Teaching Innovation
ERIC Educational Resources Information Center
Keeney-Kennicutt, Wendy; Baris Gunersel, Adalet; Simpson, Nancy
2008-01-01
This mixed-methods study investigated student perceptions of an innovative educational tool and the instructor strategies that helped change initial student resistance into acceptance and engagement. The educational tool in this study is Calibrated Peer Review (CPR)™, a web-based program that uses writing as a learning and assessment tool.…
Empowering African Americans to Achieve Academic Success.
ERIC Educational Resources Information Center
Gary, Lawrence E.; Booker, Christopher B.
1992-01-01
This article reviews pertinent factors, such as the need to encourage a positive home environment, transform peer group influences, establish goals early in life, foster racial pride and awareness, use African-American culture to foster achievement, encourage a sense of self-control, initiate and expand mentor programs, and cultivate academic…
Undergraduate Research in the Human Sciences: Three Models
ERIC Educational Resources Information Center
Collins, Nina; Mitstifer, Dorothy I.; Nelson Goff, Briana S.; Hymon-Parker, Shirley
2009-01-01
Undergraduate research in the sciences has been shown by numerous studies to enhance the educational experience. The Undergraduate Research Community (URC) founded in 2001 supports several initiatives that promote research in human sciences/family and consumer sciences including an online peer-reviewed journal specifically for undergraduate work,…
Comprehensive Thematic T-matrix Reference Database: a 2013-2014 Update
NASA Technical Reports Server (NTRS)
Mishchenko, Michael I.; Zakharova, Nadezhda T.; Khlebtsov, Nikolai G.; Wriedt, Thomas; Videen, Gorden
2014-01-01
This paper is the sixth update to the comprehensive thematic database of peer-reviewedT-matrix publications initiated by us in 2004 and includes relevant publications that have appeared since 2013. It also lists several earlier publications not incorporated in the original database and previous updates.
Academic Planning through Program Review: Can It Work?
ERIC Educational Resources Information Center
Fernandez, Thomas V.; Raab, Marjorie K.
Nassau Community College (NCC) is currently working with a program evaluation model in which faculty from one department serve as peer evaluation consultants to direct the self-evaluations of other departments. The four functional objectives initially motivating the development of NCC's plan directed that: real decisions about academic programs…
42 CFR 476.98 - Reviewer qualifications and participation.
Code of Federal Regulations, 2010 CFR
2010-10-01
... services furnished or proposed to be furnished by a licensed doctor of medicine or osteopathy or by a doctor of dentistry must be respectively another licensed doctor of medicine or osteopathy or of... that peers are not available to make initial denial determinations, a doctor of medicine or osteopathy...
Detailed prospective peer review in a community radiation oncology clinic.
Mitchell, James D; Chesnut, Thomas J; Eastham, David V; Demandante, Carlo N; Hoopes, David J
In 2012, we instituted detailed prospective peer review of new cases. We present the outcomes of peer review on patient management and time required for peer review. Peer review rounds were held 3 to 4 days weekly and required 2 physicians to review pertinent information from the electronic medical record and treatment planning system. Eight aspects were reviewed for each case: 1) workup and staging; 2) treatment intent and prescription; 3) position, immobilization, and simulation; 4) motion assessment and management; 5) target contours; 6) normal tissue contours; 7) target dosimetry; and 8) normal tissue dosimetry. Cases were marked as, "Meets standard of care," "Variation," or "Major deviation." Changes in treatment plan were noted. As our process evolved, we recorded the time spent reviewing each case. From 2012 to 2014, we collected peer review data on 442 of 465 (95%) radiation therapy patients treated in our hospital-based clinic. Overall, 91 (20.6%) of the cases were marked as having a variation, and 3 (0.7%) as major deviation. Forty-two (9.5%) of the cases were altered after peer review. An overall peer review score of "Variation" or "Major deviation" was highly associated with a change in treatment plan (P < .01). Changes in target contours were recommended in 10% of cases. Gastrointestinal cases were significantly associated with a change in treatment plan after peer review. Indicators on position, immobilization, simulation, target contours, target dosimetry, motion management, normal tissue contours, and normal tissue dosimetry were significantly associated with a change in treatment plan. The mean time spent on each case was 7 minutes. Prospective peer review is feasible in a community radiation oncology practice. Our process led to changes in 9.5% of cases. Peer review should focus on technical factors such as target contours and dosimetry. Peer review required 7 minutes per case. Published by Elsevier Inc.
A scoping review of Indigenous suicide prevention in circumpolar regions.
Redvers, Jennifer; Bjerregaard, Peter; Eriksen, Heidi; Fanian, Sahar; Healey, Gwen; Hiratsuka, Vanessa; Jong, Michael; Larsen, Christina Viskum Lytken; Linton, Janice; Pollock, Nathaniel; Silviken, Anne; Stoor, Petter; Chatwood, Susan
2015-01-01
Suicide is a serious public health challenge in circumpolar regions, especially among Indigenous youth. Indigenous communities, government agencies and health care providers are making concerted efforts to reduce the burden of suicide and strengthen protective factors for individuals, families and communities. The persistence of suicide has made it clear that more needs to be done. Our aim was to undertake a scoping review of the peer-reviewed literature on suicide prevention and interventions in Indigenous communities across the circumpolar north. Our objective was to determine the extent and types of interventions that have been reported during past decade. We want to use this knowledge to support community initiative and inform intervention development and evaluation. We conducted a scoping review of online databases to identify studies published between 2004 and 2014. We included articles that described interventions in differentiated circumpolar Indigenous populations and provided evaluation data. We retained grey literature publications for comparative reference. Our search identified 95 articles that focused on suicide in distinct circumpolar Indigenous populations; 19 articles discussed specific suicide-related interventions and 7 of these described program evaluation methods and results in detail. The majority of publications on specific interventions were found in North American countries. The majority of prevention or intervention documentation was found in supporting grey literature sources. Despite widespread concern about suicide in the circumpolar world and active community efforts to promote resilience and mental well-being, we found few recorded programs or initiatives documented in the peer-reviewed literature, and even fewer focusing specifically on youth intervention. The interventions described in the studies we found had diverse program designs and content, and used varied evaluation methods and outcomes. The studies we included consistently reported that it was important to use community-based and culturally guided interventions and evaluations. This article summarizes the current climate of Indigenous circumpolar suicide research in the context of intervention and highlights how intervention-based outcomes have largely remained outside of peer-reviewed sources in this region of the world.
Nguyen, Vivian M.; Haddaway, Neal R.; Gutowsky, Lee F. G.; Wilson, Alexander D. M.; Gallagher, Austin J.; Donaldson, Michael R.; Hammerschlag, Neil; Cooke, Steven J.
2015-01-01
Delays in peer reviewed publication may have consequences for both assessment of scientific prowess in academia as well as communication of important information to the knowledge receptor community. We present an analysis on the perspectives of authors publishing in conservation biology journals regarding their opinions on the importance of speed in peer-review as well as how to improve review times. Authors were invited to take part in an online questionnaire, of which the data was subjected to both qualitative (open coding, categorizing) and quantitative analyses (generalized linear models). We received 637 responses to 6,547 e-mail invitations sent. Peer-review speed was generally perceived as slow, with authors experiencing a typical turnaround time of 14 weeks while their perceived optimal review time was six weeks. Male and younger respondents seem to have higher expectations of review speed than females and older respondents. The majority of participants attributed lengthy review times to reviewer and editor fatigue, while editor persistence and journal prestige were believed to speed up the review process. Negative consequences of lengthy review times were perceived to be greater for early career researchers and to have impact on author morale (e.g. motivation or frustration). Competition among colleagues was also of concern to respondents. Incentivizing peer-review was among the top suggested alterations to the system along with training graduate students in peer-review, increased editorial persistence, and changes to the norms of peer-review such as opening the peer-review process to the public. It is clear that authors surveyed in this study viewed the peer-review system as under stress and we encourage scientists and publishers to push the envelope for new peer-review models. PMID:26267491
Peer-supported review of teaching: making the grade in midwifery and nursing education.
Murphy Tighe, Sylvia; Bradshaw, Carmel
2013-11-01
This paper outlines the value of peer-supported review of teaching for nurse and midwifery educators in an academic environment. Reflection and continuing professional development are important tenets of an educators' practice and can be addressed via peer observation. Definitions and models of peer observation are presented. The strengths and challenges associated with peer-supported review of teaching are discussed. The reasons why peer observation is underutilised are explored with some suggestions on how to overcome these challenges. Recent developments in relation to peer observation and peer-supported review are outlined. The need for tangible evidence of development and enhancement of existing teaching expertise is very pronounced in the current economic climate, it is concluded that peer-supported review of teaching can provide such evidence. Copyright © 2012 Elsevier Ltd. All rights reserved.
Peer review in hematopoietic cell transplantation: are we doing our fair share?
Giralt, S; Korngold, R; Lazarus, H M
2016-09-01
Peer review is believed to be important in maintaining the quality and integrity of research in academic endeavors. Recently, the value of the current peer review process, which is more than 100 years old has come into question. In the field of hematopoietic cell transplantation (HCT), peer review was unable to prevent the publication of the largest and most notorious scientific fraud in our field. In order to assess how the HCT community views and how engaged it is with the peer review process, the American Society of Blood and Marrow Transplantation conducted a survey of all of its members in 2014. The survey was sent to all active members through multiple email communications in August and September 2014. Of a total of 1183 members, 149 responded. Almost all of the respondents had participated in the peer review process, with few respondents declining ever to review manuscripts. The most common cause for declining review requests was lack of time. Most respondents (68%) thought that the current peer review process was relatively fair and unbiased, whereas only 9% of the respondents stated that they did not believe in the peer review process. In conclusion, among the respondents of this survey most felt the peer review process to be valuable and fair, however, the lack of response suggests that further study into improving the peer review process in the field of HCT is warranted in the era of electronic publishing and communication.
Cycling with an amputation: A systematic review.
Dyer, Bryce
2016-10-01
Cycling with any form of limb amputation has progressed from an activity of leisure or rehabilitation to elite level competition as part of the Paralympic Games programme. While it is often proposed that research into sport with an amputation can be extremely limited, this study intended to identify the volume, type and historical strategy in this area. This study comprises a documented systematic literature review of cycling undertaken with any form of limb amputation. This study used four online search engines to identify relevant peer-reviewed literature. These included SPORTDiscus, CINAHL, Scopus and MEDLINE. Google Scholar was also used as a secondary source. The initial results were then subjected to a set of pre-defined inclusion criteria. The resulting publications were then analysed for content and thematic commonality. The review identified 20 articles which met pre-defined inclusion criteria. The identified peer-reviewed publications were dated from the period 2004 to 2014. Three clear themes emerged from the historical research. There was both a paucity of peer-reviewed literature with respect to cycling with an amputation and the design of adaptive or assistive technology to replace limb loss. However, publications have been rising substantially over the last 5 years. This review study established the historical strategy and content of cycling with an amputation and identified the existing research themes. This will assist in summarising the current level of knowledge and help signpost such work in the future. © The International Society for Prosthetics and Orthotics 2015.
ERIC Educational Resources Information Center
Johnson, Susan Moore; Fiarman, Sarah E.
2012-01-01
Peer review of teachers is controversial for several reasons. Some say peer reviewers encroach on the rightful domain of the principal as instructional leader. Others argue that, because peer evaluators are fellow teachers, they may be biased or unwilling to make hard decisions. Many teachers find the prospect of peer evaluation unsettling because…
28 CFR 34.105 - Peer review methods.
Code of Federal Regulations, 2010 CFR
2010-07-01
... 28 Judicial Administration 1 2010-07-01 2010-07-01 false Peer review methods. 34.105 Section 34... Review § 34.105 Peer review methods. (a) For both competitive and noncompetitive applications, peer... announcement or otherwise established by the Administrator, together with the assignment of numerical values...
7 CFR 3400.21 - Scientific peer review for research activities.
Code of Federal Regulations, 2010 CFR
2010-01-01
... 7 Agriculture 15 2010-01-01 2010-01-01 false Scientific peer review for research activities. 3400... STATE RESEARCH, EDUCATION, AND EXTENSION SERVICE, DEPARTMENT OF AGRICULTURE SPECIAL RESEARCH GRANTS PROGRAM Peer and Merit Review Arranged by Grantees § 3400.21 Scientific peer review for research...
28 CFR 34.109 - Qualifications of peer reviewers.
Code of Federal Regulations, 2014 CFR
2014-07-01
... be used in the selection of peer reviewers are: (a) Generalized knowledge of juvenile justice or... 28 Judicial Administration 1 2014-07-01 2014-07-01 false Qualifications of peer reviewers. 34.109 Section 34.109 Judicial Administration DEPARTMENT OF JUSTICE OJJDP COMPETITION AND PEER REVIEW PROCEDURES...
28 CFR 34.109 - Qualifications of peer reviewers.
Code of Federal Regulations, 2013 CFR
2013-07-01
... be used in the selection of peer reviewers are: (a) Generalized knowledge of juvenile justice or... 28 Judicial Administration 1 2013-07-01 2013-07-01 false Qualifications of peer reviewers. 34.109 Section 34.109 Judicial Administration DEPARTMENT OF JUSTICE OJJDP COMPETITION AND PEER REVIEW PROCEDURES...
28 CFR 34.109 - Qualifications of peer reviewers.
Code of Federal Regulations, 2012 CFR
2012-07-01
... be used in the selection of peer reviewers are: (a) Generalized knowledge of juvenile justice or... 28 Judicial Administration 1 2012-07-01 2012-07-01 false Qualifications of peer reviewers. 34.109 Section 34.109 Judicial Administration DEPARTMENT OF JUSTICE OJJDP COMPETITION AND PEER REVIEW PROCEDURES...
28 CFR 34.109 - Qualifications of peer reviewers.
Code of Federal Regulations, 2011 CFR
2011-07-01
... be used in the selection of peer reviewers are: (a) Generalized knowledge of juvenile justice or... 28 Judicial Administration 1 2011-07-01 2011-07-01 false Qualifications of peer reviewers. 34.109 Section 34.109 Judicial Administration DEPARTMENT OF JUSTICE OJJDP COMPETITION AND PEER REVIEW PROCEDURES...
Adolescent peer group identification and characteristics: A review of the literature
Sussman, Steve; Pokhrel, Pallav; Ashmore, Richard D.; Brown, B. Bradford
2011-01-01
This study provides an exhaustive review of 44 peer-reviewed quantitative or qualitative data-based peer-reviewed studies completed on adolescent peer group identification. Adolescent peer group identification is one’s self-perceived or other-perceived membership in discrete teenage peer groups. The studies reviewed suggest that adolescent peer groups consist of five general categories differentiable by lifestyle characteristics: Elites, Athletes, Academics, Deviants, and Others. We found that the Deviant adolescent group category reported relatively greater participation in drug use and other problem behaviors across studies, whereas Academics and Athletes exhibited the least participation in these problem behaviors. Additional research is needed in this arena to better understand the operation of adolescent group labels. PMID:17188815
28 CFR 34.104 - Use of peer review.
Code of Federal Regulations, 2010 CFR
2010-07-01
... 28 Judicial Administration 1 2010-07-01 2010-07-01 false Use of peer review. 34.104 Section 34.104 Judicial Administration DEPARTMENT OF JUSTICE OJJDP COMPETITION AND PEER REVIEW PROCEDURES Peer Review § 34... programs for which a large number of applications is expected, preapplications (concept papers) may be...
The Potential of Dual-Language Cross-Cultural Peer Review
ERIC Educational Resources Information Center
Ruecker, Todd
2011-01-01
This article explores the potential of dual-language cross-cultural peer review and how it improves on traditional monolingual and monocultural peer review. Drawing on scholarship related to international exchange programmes, peer review, and two-way immersion programmes in the United States as well as data collected while facilitating the…
Code of Federal Regulations, 2010 CFR
2010-01-01
... 7 Agriculture 6 2010-01-01 2010-01-01 false Peer review. 550.17 Section 550.17 Agriculture... § 550.17 Peer review. Upon request of the REE Agency, cooperators may be requested to provide documentation in support of peer review activities and cooperator personnel may be requested to participate in...
Toward the Integration of Peer Reviewing and Computational Linguistics Approaches
ERIC Educational Resources Information Center
Park, Juhwa; Cho, Kwangsu
2017-01-01
Previous research has shown the effectiveness of peer reviewing on the improvement of writing quality. However, the fact that students themselves, arguably novices, judged the improvement leads to concerns about the validity of peer reviewing. We measured writing quality before and after peer reviewing using Coh-Metrix, which computationally…
Landsbergis, Paul; Zoeckler, Jeanette; Kashem, Zerin; Rivera, Bianca; Alexander, Darryl; Bahruth, Amy
2018-02-01
We examine strategies, programs, and policies that educators have developed to reduce work stressors and thus health risks. First, we review twenty-seven empirical studies and review papers on organizational programs and policies in K-12 education published from 1990 to 2015 and find some evidence that mentoring, induction, and Peer Assistance and Review programs can increase support, skill development, decision-making authority, and perhaps job security, for teachers-and thus have the potential to reduce job stressors. Second, we describe efforts to reduce workplace violence in Oregon, especially in special education, including legislation, collective bargaining, research, and public awareness. We conclude that to reduce workplace violence, adequate resources are needed for staffing, training, equipment, injury/assault reporting, and investigation. Third, we discuss collective bargaining initiatives that led to mentoring and Peer Assistance and Review and state legislation on prevention of bullying and harassment of school staff. Finally, we present a research agenda on these issues.
Paediatric empyema: a case report and literature review.
Parsons, S J; Fenton, E; Williams, M
2005-06-01
To present a case of bilateral parapneumonic effusions in a child with Pneumococcal pneumonia and bacteraemia managed aggressively with early thoracotomies. The literature from peer reviewed journals is summarized and the different management strategies are discussed. Articles and reviews from peer reviewed journals on the management of empyema in children and adults. Staging of parapneumonic pleural effusions is difficult to assess clinically and radiologically. Most cases can be successfully managed with simple chest tube drainage, plus appropriate antibiotic therapy. However, based on the available evidence for children, thoracotomy with decortication and direct drainage may provide the most effective treatment in terms of length of hospital stay and duration of chest tube insertion, when compared with video assisted thoracoscopic surgery (VATS) or chest tube drainage, with or without intrapleural fibrinolytic therapy. More conservative approaches to treatment of empyema may be appropriate initially to avoid the cosmetic and other disadvantages of thoracotomy. However, delayed surgical drainage increases morbidity and may potentially increase mortality.
Collaborative Learning through Formative Peer Review: Pedagogy, Programs and Potential
ERIC Educational Resources Information Center
Sondergaard, Harald; Mulder, Raoul A.
2012-01-01
We examine student peer review, with an emphasis on formative practice and collaborative learning, rather than peer grading. Opportunities to engage students in such formative peer assessment are growing, as a range of online tools become available to manage and simplify the process of administering student peer review. We consider whether…
Writing to Learn: An Evaluation of the Calibrated Peer Review™ Program in Two Neuroscience Courses
Prichard, J. Roxanne
2005-01-01
Although the majority of scientific information is communicated in written form, and peer review is the primary process by which it is validated, undergraduate students may receive little direct training in science writing or peer review. Here, I describe the use of Calibrated Peer Review™ (CPR), a free, web-based writing and peer review program designed to alleviate instructor workload, in two undergraduate neuroscience courses: an upper- level sensation and perception course (41 students, three assignments) and an introductory neuroscience course (50 students; two assignments). Using CPR online, students reviewed primary research articles on assigned ‘hot’ topics, wrote short essays in response to specific guiding questions, reviewed standard ‘calibration’ essays, and provided anonymous quantitative and qualitative peer reviews. An automated grading system calculated the final scores based on a student’s essay quality (as determined by the average of three peer reviews) and his or her accuracy in evaluating 1) three standard calibration essays, 2) three anonymous peer reviews, and 3) his or her self review. Thus, students were assessed not only on their skill at constructing logical, evidence-based arguments, but also on their ability to accurately evaluate their peers’ writing. According to both student self-reports and instructor observation, students’ writing and peer review skills improved over the course of the semester. Student evaluation of the CPR program was mixed; while some students felt like the peer review process enhanced their understanding of the material and improved their writing, others felt as though the process was biased and required too much time. Despite student critiques of the program, I still recommend the CPR program as an excellent and free resource for incorporating more writing, peer review, and critical thinking into an undergraduate neuroscience curriculum. PMID:23493247
Kovanis, Michail; Trinquart, Ludovic; Ravaud, Philippe; Porcher, Raphaël
2017-01-01
The debate on whether the peer-review system is in crisis has been heated recently. A variety of alternative systems have been proposed to improve the system and make it sustainable. However, we lack sufficient evidence and data related to these issues. Here we used a previously developed agent-based model of the scientific publication and peer-review system calibrated with empirical data to compare the efficiency of five alternative peer-review systems with the conventional system. We modelled two systems of immediate publication, with and without online reviews (crowdsourcing), a system with only one round of reviews and revisions allowed (re-review opt-out) and two review-sharing systems in which rejected manuscripts are resubmitted along with their past reviews to any other journal (portable) or to only those of the same publisher but of lower impact factor (cascade). The review-sharing systems outperformed or matched the performance of the conventional one in all peer-review efficiency, reviewer effort and scientific dissemination metrics we used. The systems especially showed a large decrease in total time of the peer-review process and total time devoted by reviewers to complete all reports in a year. The two systems with immediate publication released more scientific information than the conventional one but provided almost no other benefit. Re-review opt-out decreased the time reviewers devoted to peer review but had lower performance on screening papers that should not be published and relative increase in intrinsic quality of papers due to peer review than the conventional system. Sensitivity analyses showed consistent findings to those from our main simulations. We recommend prioritizing a system of review-sharing to create a sustainable scientific publication and peer-review system.
d'Othée, Bertrand Janne; Haskal, Ziv J
2013-10-01
Existing diagnostic radiology peer-review systems do not address the specificities of interventional radiology (IR) practice. The purpose of this study was to assess the feasibility of a specifically developed interventional peer review method, IR Peer. Retrospective review of a prospectively encoded pilot database aimed at demonstrating the feasibility of IR Peer in a multiphysician practice was performed. This scoring system used morning peer review of selected IR cases from the previous day in the form of a five-item questionnaire and an ordinal answer scale that grades reviewers' agreement with imaging findings, procedural/technical management, early outcomes, and follow-up plan. Patient lists from IR Peer and morbidity and mortality (M&M) conferences were compared to evaluate the amount of overlap and capability of IR Peer to help detect adverse events (AEs). A total of 417 consecutive reviews of IR attending physician cases by peers were performed in 163 consecutive patients over 18 months, and 94% of cases were reviewed by two or three IR attending physicians. Each question was answered 99%-100% of the time. Answers showed disagreement in 10% of cases (2% by a single reviewer, 8% by several), most related to procedural technique. Overall AE incidence was 1.8%. IR Peer contributed 10.7% of cases to the M&M list. IR Peer is feasible, relevant, and easy to implement in a multiphysician IR practice. When used along with other quality-assurance processes, it might help in the detection of AEs for M&M; the latter will require further confirmatory research. © SIR, 2013.
Ferreira, Catarina; Bastille-Rousseau, Guillaume; Bennett, Amanda M; Ellington, E Hance; Terwissen, Christine; Austin, Cayla; Borlestean, Adrian; Boudreau, Melanie R; Chan, Kevin; Forsythe, Adrian; Hossie, Thomas J; Landolt, Kristen; Longhi, Jessica; Otis, Josée-Anne; Peers, Michael J L; Rae, Jason; Seguin, Jacob; Watt, Cristen; Wehtje, Morgan; Murray, Dennis L
2016-08-01
Peer review is pivotal to science and academia, as it represents a widely accepted strategy for ensuring quality control in scientific research. Yet, the peer-review system is poorly adapted to recent changes in the discipline and current societal needs. We provide historical context for the cultural lag that governs peer review that has eventually led to the system's current structural weaknesses (voluntary review, unstandardized review criteria, decentralized process). We argue that some current attempts to upgrade or otherwise modify the peer-review system are merely sticking-plaster solutions to these fundamental flaws, and therefore are unlikely to resolve them in the long term. We claim that for peer review to be relevant, effective, and contemporary with today's publishing demands across scientific disciplines, its main components need to be redesigned. We propose directional changes that are likely to improve the quality, rigour, and timeliness of peer review, and thereby ensure that this critical process serves the community it was created for. © 2015 Cambridge Philosophical Society.
Implementing Head and Neck Contouring Peer Review without Pathway Delay: The On-demand Approach.
Fong, C; Sanghera, P; Good, J; Nightingale, P; Hartley, A
2017-12-01
Peer review of contour volume is a priority in the radiotherapy treatment quality assurance process for head and neck cancer. It is essential that incorporation of peer review activity does not introduce additional delays. An on-demand peer review process was piloted to assess the feasibility and efficiency of this approach, as compared with a historic scheduled weekly approach. Between November 2016 and April 2017 four head and neck clinicians in one centre took part in an on-demand peer review process. Cases were of radical or adjuvant intent of any histology and submitted on a voluntary basis. The outcome of contour peer review would be one of unchanged (UC), unchanged with variation or discretion noted (UV), minor change (M) or significant change (S). The time difference between the completion of the on-demand peer review was compared with the time difference to a hypothetical next Monday or Tuesday weekly peer review meeting. The time taken to review each case was also documented in the latter period of the pilot project. In total, 62 cases underwent peer review. Peer review on-demand provided dosimetrists with an average of an extra two working days available per case to meet treatment start dates. The proportion of cases with outcomes UC, UV, M and S were 45%, 16%, 26% and 13%, respectively. The mean peer review time spent per case was 17 min (12 cases). The main reason for S was discrepancy in imaging interpretation (4/8 cases). A lower proportion of oropharyngeal cases were submitted and had S outcomes. A higher proportion of complex cases, e.g. sinonasal/nasopharynx location or previous downstaging chemotherapy had S outcomes. The distribution of S outcomes appears to be similar regardless of clinician experience. The level of peer review activity among individuals differed by workload and job timetable. On-demand peer review of the head and neck contour volume is feasible, reduces delay to the start of dosimetry planning and bypasses the logistical barriers of weekly meetings. An audit of participation will be required to ensure successful implementation. Copyright © 2017 The Royal College of Radiologists. Published by Elsevier Ltd. All rights reserved.
Ancient texts to PubMed: a brief history of the peer-review process.
Farrell, P R; Magida Farrell, L; Farrell, M K
2017-01-01
The formal evaluation of scientific literature by invited referees (peer reviewers) is a relatively recent phenomenon and now is considered a cornerstone of modern science. However, its roots can be traced back to antiquity. As the speed and complexity of scientific information and publishing increases in the digital age, peer review must continue to evolve. To understand the future direction of peer review, we must understand its past. Here, we briefly explore the history of scientific peer review. This may help us predict and design appropriate peer review for the new era. This work was originally presented at the Pediatric Academic Societies Annual Meeting in Baltimore, Maryland in the Spring of 2016.
Peer review in forensic science.
Ballantyne, Kaye N; Edmond, Gary; Found, Bryan
2017-08-01
Peer review features prominently in the forensic sciences. Drawing on recent research and studies, this article examines different types of peer review, specifically: editorial peer review; peer review by the scientific community; technical and administrative review; and verification (and replication). The article reviews the different meanings of these quite disparate activities and their utility in relation to enhancing performance and reducing error. It explains how forensic practitioners should approach and use peer review, as well as how it should be described in expert reports and oral testimony. While peer review has considerable potential, and is a key component of modern quality management systems, its actual value in most forensic science settings has yet to be determined. In consequence, forensic practitioners should reflect on why they use specific review procedures and endeavour to make their actual practices and their potential value transparent to consumers; whether investigators, lawyers, jurors or judges. Claims that review increases the validity of a scientific technique or accuracy of opinions within a particular case should be avoided until empirical evidence is available to support such assertions. Copyright © 2017 Elsevier B.V. All rights reserved.
Final Report from the External Peer Review of the IRIS ...
This document is the final report for the 2004 external peer review for the EPA IRIS Reassessment of the Inhalation Carcinogenicity of Naphthalene, prepared by the Office of Research and Development's National Center for Environmental Assessment (NCEA), for the Integrated Risk Information System (IRIS) Database. A panel of external peer reviewers met to discuss the IRIS report and their responses to the charge questions on July 30, 2004. This document contains the final written comments of the external peer reviewers. This document is the final report for the 2004 external peer review for the IRIS Reassessment of the Inhalation Carcinogenicity of Naphthalene, prepared by the U.S. Environmental Protection Agency (EPA), National Center for Environmental Assessment (NCEA), for the Integrated Risk Information System (IRIS). A panel of external peer reviewers met to discuss their responses to the charge questions on July 30, 2004. This document contains the final written comments of the external peer reviewers.
Technology-Enhanced Peer Review: Benefits and Implications of Providing Multiple Reviews
ERIC Educational Resources Information Center
Papadopoulos, Pantelis M.; Lagkas, Thomas D.; Demetriadis, Stavros N.
2017-01-01
This study analyses the impact of self and peer feedback in technology-enhanced peer review settings. The impact of receiving peer comments ("receiver" perspective) is compared to that of reaching own insights by reviewing others' work ("giver" perspective). In this study, 38 sophomore students were randomly assigned in two…
Undergraduate Essay Writing: Online and Face-to-Face Peer Reviews
ERIC Educational Resources Information Center
Chong, Mike R.; Goff, Lori; Dej, Kimberly
2012-01-01
We implemented two different approaches of using peer review to support undergraduate essay assignments for students taking large second-year courses in life sciences and biology: a web-based online peer review (OPR) approach and a more traditional face-to-face peer review (FPR) approach that was conducted in tutorial settings. The essays…
7 CFR 3401.12 - Establishment and operation of peer review groups.
Code of Federal Regulations, 2010 CFR
2010-01-01
... 7 Agriculture 15 2010-01-01 2010-01-01 false Establishment and operation of peer review groups... GRANTS PROGRAM Scientific Peer Review of Research Applications for Funding § 3401.12 Establishment and operation of peer review groups. Subject to § 3401.7, the Administrator will adopt procedures for the...
The Importance of Peer Review: Thoughts on Knudson, Morrow, and Thomas (2014)
ERIC Educational Resources Information Center
Fischman, Mark G.
2014-01-01
Knudson, Morrow, and Thomas (2014) recently summarized a number of important issues related to the quality of peer review and current peer-review practice in kinesiology. This writer endorses their six recommendations for improving peer review in kinesiology journals. The purpose of this commentary is to further highlight the importance of…
Focusing on Content: Discourse in L2 Peer Review Groups
ERIC Educational Resources Information Center
Vorobel, Oksana; Kim, Deoksoon
2014-01-01
Recent studies on peer review groups in second language classes have focused on various topics, including collaboration (Carr, 2008) and the effect of peer review versus teacher feedback on students' writing (Zhang, 1995). One area that has received little attention is the content of students' speech during peer review. This longitudinal case…
Peer Reviewers Learn from Giving Comments
ERIC Educational Resources Information Center
Cho, Young Hoan; Cho, Kwangsu
2011-01-01
Research on peer reviewing has revealed that comments received from peer reviewers are helpful when it comes to making revisions in an individual's writing, but the role of providing comments to peer writers has been little explored despite the potential value of such research. In this study, we explored how student reviewers learn by reviewing…
Analysis of Peer Review Comments: QM Recommendations and Feedback Intervention Theory
ERIC Educational Resources Information Center
Schwegler, Andria F.; Altman, Barbara W.
2015-01-01
Because feedback is a critical component of the continuous improvement cycle of the Quality Matters (QM) peer review process, the present research analyzed the feedback that peer reviewers provided to course developers after a voluntary, nonofficial QM peer review of online courses. Previous research reveals that the effects of feedback on…
Pre-University Chemistry Students in a Mimicked Scholarly Peer Review
ERIC Educational Resources Information Center
van Rens, Lisette; Hermarij, Philip; Pilot, Albert; Beishuizen, Jos; Hofman, Herman; Wal, Marjolein
2014-01-01
Peer review is a significant component in scientific research. Introducing peer review into inquiry processes may be regarded as an aim to develop student understanding regarding quality in inquiries. This study examines student understanding in inquiry peer reviews among pre-university chemistry students, aged 16-17, when they enact a design of a…
Assessing RN-to-RN peer review on clinical units.
Pfeiffer, Judith A; Wickline, Mary A; Deetz, Jill; Berry, Elise S
2012-04-01
The primary purpose of this study was to measure informal registered nurse (RN)-to-RN peer review (defined as collegial communication about the quality of nursing care) at the work-unit level. Survey design with cluster sampling of 28 hospital or ambulatory care units (n = 541 respondents). Results were compared with existing patient safety and satisfaction data. A chi-squared test was used to compare responses against nurse characteristics. Nurses agreed that RN-to-RN peer review takes place on their units, but no correlation with patient safety and satisfaction data was found. Misunderstandings about the meaning of peer review were evident. Open-ended comments revealed barriers to peer review: fear of retribution, language barriers and lack of professionalism. Nurses need clarification of peer review. Issues with common language in a professional environment need to be addressed and nurses can learn collaboration from each other's cultures. Managers should support RN-to-RN peer review on clinical units. Methods used here may be useful to assess current departmental nurse peer review. © 2011 Blackwell Publishing Ltd.
Peer Review in Radiology: A Resident and Fellow Perspective.
Grenville, Jeffrey; Doucette-Preville, David; Vlachou, Paraskevi A; Mnatzakanian, Gevork N; Raikhlin, Antony; Colak, Errol
2016-02-01
The purpose of this study was to explore Canadian radiology residents' and fellows' understanding, attitudes, opinions, and preferences toward peer review. An Internet-based anonymous questionnaire designed to understand one's familiarity, attitudes, opinions, and preferences toward peer review was distributed to radiology residents and fellows across Canada. Data were analyzed using descriptive statistics, and answers were stratified by level of training. A total of 136 trainees responded to the survey with 92 completed survey responses available for descriptive statistics. Approximately half of respondents are familiar with peer review (49%), and 39% of trainees are involved in peer review. Most respondents (92%) expressed an interest in learning more about peer review; believe that it should be incorporated into the residency training curriculum (86%), be mandatory (72%), and that current participation will increase odds of future participation (91%). Most trainees (80%) are comfortable advising one another about errors, but less comfortable advising staff (21%). Residents and fellows welcome the opportunity to learn more about peer review and believe it should be incorporated into the residency training curriculum. Understanding the attitudes and perceptions held by trainees regarding peer review is important, as a means to optimize education and maximize current and future participation in peer review. Copyright © 2016 American College of Radiology. Published by Elsevier Inc. All rights reserved.
Kowalczuk, Maria K; Dudbridge, Frank; Nanda, Shreeya; Harriman, Stephanie L; Patel, Jigisha; Moylan, Elizabeth C
2015-09-29
To assess whether reports from reviewers recommended by authors show a bias in quality and recommendation for editorial decision, compared with reviewers suggested by other parties, and whether reviewer reports for journals operating on open or single-blind peer review models differ with regard to report quality and reviewer recommendations. Retrospective analysis of the quality of reviewer reports using an established Review Quality Instrument, and analysis of reviewer recommendations and author satisfaction surveys. BioMed Central biology and medical journals. BMC Infectious Diseases and BMC Microbiology are similar in size, rejection rates, impact factors and editorial processes, but the former uses open peer review while the latter uses single-blind peer review. The Journal of Inflammation has operated under both peer review models. Two hundred reviewer reports submitted to BMC Infectious Diseases, 200 reviewer reports submitted to BMC Microbiology and 400 reviewer reports submitted to the Journal of Inflammation. For each journal, author-suggested reviewers provided reports of comparable quality to non-author-suggested reviewers, but were significantly more likely to recommend acceptance, irrespective of the peer review model (p<0.0001 for BMC Infectious Diseases, BMC Microbiology and the Journal of Inflammation). For BMC Infectious Diseases, the overall quality of reviewer reports measured by the Review Quality Instrument was 5% higher than for BMC Microbiology (p=0.042). For the Journal of Inflammation, the quality of reports was the same irrespective of the peer review model used. Reviewers suggested by authors provide reports of comparable quality to non-author-suggested reviewers, but are significantly more likely to recommend acceptance. Open peer review reports for BMC Infectious Diseases were of higher quality than single-blind reports for BMC Microbiology. There was no difference in quality of peer review in the Journal of Inflammation under open peer review compared with single blind. Published by the BMJ Publishing Group Limited. For permission to use (where not already granted under a licence) please go to http://group.bmj.com/group/rights-licensing/permissions.
Peer Portal: Quality Enhancement in Thesis Writing Using Self-Managed Peer Review on a Mass Scale
ERIC Educational Resources Information Center
Aghaee, Naghmeh; Hansson, Henrik
2013-01-01
This paper describes a specially developed online peer-review system, the Peer Portal, and the first results of its use for quality enhancement of bachelor's and master's thesis manuscripts. The peer-review system is completely student driven and therefore saves time for supervisors and creates a direct interaction between students without…
Kapur, Ajay; Goode, Gina; Riehl, Catherine; Zuvic, Petrina; Joseph, Sherin; Adair, Nilda; Interrante, Michael; Bloom, Beatrice; Lee, Lucille; Sharma, Rajiv; Sharma, Anurag; Antone, Jeffrey; Riegel, Adam; Vijeh, Lili; Zhang, Honglai; Cao, Yijian; Morgenstern, Carol; Montchal, Elaine; Cox, Brett; Potters, Louis
2013-01-01
By combining incident learning and process failure-mode-and-effects-analysis (FMEA) in a structure-process-outcome framework we have created a risk profile for our radiation medicine practice and implemented evidence-based risk-mitigation initiatives focused on patient safety. Based on reactive reviews of incidents reported in our departmental incident-reporting system and proactive FMEA, high safety-risk procedures in our paperless radiation medicine process and latent risk factors were identified. Six initiatives aimed at the mitigation of associated severity, likelihood-of-occurrence, and detectability risks were implemented. These were the standardization of care pathways and toxicity grading, pre-treatment-planning peer review, a policy to thwart delay-rushed processes, an electronic whiteboard to enhance coordination, and the use of six sigma metrics to monitor operational efficiencies. The effectiveness of these initiatives over a 3-years period was assessed using process and outcome specific metrics within the framework of the department structure. There has been a 47% increase in incident-reporting, with no increase in adverse events. Care pathways have been used with greater than 97% clinical compliance rate. The implementation of peer review prior to treatment-planning and use of the whiteboard have provided opportunities for proactive detection and correction of errors. There has been a twofold drop in the occurrence of high-risk procedural delays. Patient treatment start delays are routinely enforced on cases that would have historically been rushed. Z-scores for high-risk procedures have steadily improved from 1.78 to 2.35. The initiatives resulted in sustained reductions of failure-mode risks as measured by a set of evidence-based metrics over a 3-years period. These augment or incorporate many of the published recommendations for patient safety in radiation medicine by translating them to clinical practice. PMID:24380074
Gender bias in scholarly peer review.
Helmer, Markus; Schottdorf, Manuel; Neef, Andreas; Battaglia, Demian
2017-03-21
Peer review is the cornerstone of scholarly publishing and it is essential that peer reviewers are appointed on the basis of their expertise alone. However, it is difficult to check for any bias in the peer-review process because the identity of peer reviewers generally remains confidential. Here, using public information about the identities of 9000 editors and 43000 reviewers from the Frontiers series of journals, we show that women are underrepresented in the peer-review process, that editors of both genders operate with substantial same-gender preference (homophily), and that the mechanisms of this homophily are gender-dependent. We also show that homophily will persist even if numerical parity between genders is reached, highlighting the need for increased efforts to combat subtler forms of gender bias in scholarly publishing.
Meaningful Peer Review in Radiology: A Review of Current Practices and Potential Future Directions.
Moriarity, Andrew K; Hawkins, C Matthew; Geis, J Raymond; Dreyer, Keith J; Kamer, Aaron P; Khandheria, Paras; Morey, Jose; Whitfill, James; Wiggins, Richard H; Itri, Jason N
2016-12-01
The current practice of peer review within radiology is well developed and widely implemented compared with other medical specialties. However, there are many factors that limit current peer review practices from reducing diagnostic errors and improving patient care. The development of "meaningful peer review" requires a transition away from compliance toward quality improvement, whereby the information and insights gained facilitate education and drive systematic improvements that reduce the frequency and impact of diagnostic error. The next generation of peer review requires significant improvements in IT functionality and integration, enabling features such as anonymization, adjudication by multiple specialists, categorization and analysis of errors, tracking, feedback, and easy export into teaching files and other media that require strong partnerships with vendors. In this article, the authors assess various peer review practices, with focused discussion on current limitations and future needs for meaningful peer review in radiology. Copyright © 2016 American College of Radiology. Published by Elsevier Inc. All rights reserved.
Reiner, Bruce I
2018-02-01
One method for addressing existing peer review limitations is the assignment of peer review cases on a completely blinded basis, in which the peer reviewer would create an independent report which can then be cross-referenced with the primary reader report of record. By leveraging existing computerized data mining techniques, one could in theory automate and objectify the process of report data extraction, classification, and analysis, while reducing time and resource requirements intrinsic to manual peer review report analysis. Once inter-report analysis has been performed, resulting inter-report discrepancies can be presented to the radiologist of record for review, along with the option to directly communicate with the peer reviewer through an electronic data reconciliation tool aimed at collaboratively resolving inter-report discrepancies and improving report accuracy. All associated report and reconciled data could in turn be recorded in a referenceable peer review database, which provides opportunity for context and user-specific education and decision support.
On the Nature and Role of Peer Review in Mathematics.
Andersen, Line Edslev
2017-01-01
For the past three decades, peer review practices have received much attention in the literature. But although this literature covers many research fields, only one previous systematic study has been devoted to the practice of peer review in mathematics, namely a study by Geist, Löwe, and Van Kerkhove from 2010. This lack of attention may be due to a view that peer review in mathematics is more reliable, and therefore less interesting as an object of study, than peer review in other fields. In fact, Geist, Löwe, and Van Kerkhove argue that peer review in mathematics is relatively reliable. At the same time, peer review in mathematics differs from peer review in most, if not all, other fields in that papers submitted to mathematical journals are usually only reviewed by a single referee. Furthermore, recent empirical studies indicate that the referees do not check the papers line by line. I argue that, in spite of this, mathematical practice in general and refereeing practices in particular are such that the common practice of mathematical journals of using just one referee is justified from the point of view of proof validity assessment. The argument is based on interviews I conducted with seven mathematicians.
Pear Ester – from discovery to delivery, new tools to manage Codling Moth
USDA-ARS?s Scientific Manuscript database
The chemical ecology of codling moth, Cydia pomonella (L.), has been the subject of a world-wide research effort resulting in hundreds of publications in peer-reviewed journals. The initial focus of this work was characterization of the sexual behavior of the moth and identification of its sex phero...
Laboratory Directed Research and Development Program Assessment for FY 2015
DOE Office of Scientific and Technical Information (OSTI.GOV)
Hatton, Diane; Barkigia, K.; Giacalone, P.
2016-03-01
This report provides an overview of the BNL LDRD program and a summary of the management processes, project peer review, a financial overview, and the relation of the portfolio of LDRD projects to BNL's mission, initiatives, and strategic plan. Also included are a summary of success indicators and a self-assessment.
The Picture Exchange Communication System (PECS): What Do the Data Say?
ERIC Educational Resources Information Center
Sulzer-Azaroff, Beth; Hoffman, Anne O.; Horton, Catherine B.; Bondy, Andrew; Frost, Lori
2009-01-01
Originally designed to enable young children with autism lacking functional communication to initiate requests and to describe what they observed, the Picture Exchange Communication System (PECS) has been the subject of an ever-expanding body of research and development. Thirty-four peer-reviewed published reports on PECS are analyzed in this…
Developing Careers, Building a Profession: The Rochester Career in Teaching Plan.
ERIC Educational Resources Information Center
Koppich, Julia; Asher, Carla; Kerchner, Charles
This book surveys the Career in Teaching (CIT) initiative launched in Rochester, New York, looking at its impact on the district since 1987. CIT incorporates support for new teachers, provides opportunities for highly accomplished teachers to share their skills, and offers peer review and assistance to teachers experiencing problems in their…
Cooperation between referees and authors increases peer review accuracy.
Leek, Jeffrey T; Taub, Margaret A; Pineda, Fernando J
2011-01-01
Peer review is fundamentally a cooperative process between scientists in a community who agree to review each other's work in an unbiased fashion. Peer review is the foundation for decisions concerning publication in journals, awarding of grants, and academic promotion. Here we perform a laboratory study of open and closed peer review based on an online game. We show that when reviewer behavior was made public under open review, reviewers were rewarded for refereeing and formed significantly more cooperative interactions (13% increase in cooperation, P = 0.018). We also show that referees and authors who participated in cooperative interactions had an 11% higher reviewing accuracy rate (P = 0.016). Our results suggest that increasing cooperation in the peer review process can lead to a decreased risk of reviewing errors.
How Does Student Peer Review Influence Perceptions, Engagement and Academic Outcomes? A Case Study
ERIC Educational Resources Information Center
Mulder, Raoul; Baik, Chi; Naylor, Ryan; Pearce, Jon
2014-01-01
Involving students in peer review has many pedagogical benefits, but few studies have explicitly investigated relationships between the content of peer reviews, student perceptions and assessment outcomes. We conducted a case study of peer review within a third-year undergraduate subject at a research-intensive Australian university, in which we…
Do Peer Reviews Help Improve Student Writing Abilities in an EFL High School Classroom?
ERIC Educational Resources Information Center
Kurihara, Noriko
2017-01-01
Several studies have reported the benefits of peer reviews in English as a second language (ESL) and English as a foreign language (EFL) writing classrooms. However, there has been little empirical research on whether such peer reviews improve students' writing abilities. The current study investigated the effects of peer review on the development…
ERIC Educational Resources Information Center
White, Kiri; Boehm, Emilia; Chester, Andrea
2014-01-01
Peer review of teaching is a collegial process designed to help academics reflect on and improve their teaching practice. Considerable research supports the value of peer review of teaching. However, uptake of voluntary programs is typically low. Few studies have examined the predictors of engagement in voluntary peer review. This study surveyed…
LeaD-In: A Cultural Change Model for Peer Review of Teaching in Higher Education
ERIC Educational Resources Information Center
Barnard, A.; Nash, R.; McEvoy, K.; Shannon, S.; Waters, C.; Rochester, S.; Bolt, S.
2015-01-01
Peer review of teaching is recognized increasingly as one strategy for academic development even though historically peer review of teaching is often unsupported by policy, action and culture in many Australian universities. Higher education leaders report that academics generally do not engage with peer review of teaching in a systematic or…
34 CFR 359.30 - How is peer review conducted under this program?
Code of Federal Regulations, 2010 CFR
2010-07-01
... 34 Education 2 2010-07-01 2010-07-01 false How is peer review conducted under this program? 359.30 Section 359.30 Education Regulations of the Offices of the Department of Education (Continued) OFFICE OF...? § 359.30 How is peer review conducted under this program? Peer review is conducted under this program in...
Don't Tell It Like It Is: Preserving Collegiality in the Summative Peer Review of Teaching
ERIC Educational Resources Information Center
Iqbal, Isabeau A.
2014-01-01
While much literature has considered feedback and professional growth in formative peer reviews of teaching, there has been little empirical research conducted on these issues in the context of summative peer reviews. This article explores faculty members' perceptions of feedback practices in the summative peer review of teaching and reports on…
Federal Register 2010, 2011, 2012, 2013, 2014
2010-05-05
... Peer Review of ARS Research Projects AGENCY: Agricultural Research Service (ARS), USDA. ACTION: Notice... scientific peer reviews of all research activities conducted by the USDA. The Office manages the ARS peer review system by centrally planning peer panel reviews for ARS research projects on a five-year cycle...
Students' Collaborative Peer Reviewing in an Online Writing Environment
ERIC Educational Resources Information Center
Bradley, Linda; Thouësny, Sylvie
2017-01-01
Peer review is applied as a powerful tool to enhance student collaboration online writing. The purpose of this paper is to analyse learners' mechanisms of peer reviewing in the nature of student interventions and interactions in written online peer reviewing and how categorization of student comments can be used as a means for analysing student…
Adapting Peer Review to an Online Course: An Exploratory Case Study
ERIC Educational Resources Information Center
Knight, Linda V.; Steinbach, Theresa A.
2011-01-01
With demonstrated benefits to higher level learning, peer review in the classroom has been well researched and popular since at least the 1990s. However, little or no prior studies exist into the peer review process for online courses. Further, we found no prior research specifically addressing the operational aspects of online peer review. This…
Evaluation of the Inhalation Carcinogenicity of Ethylene Oxide ...
EPA is seeking peer review of the scientific basis supporting the human health hazard and dose-response assessment of ethylene oxide (cancer) that will appear in the Integrated Risk Information System (IRIS) database. EPA seeks external peer review on how the Agency responded to the SAB panel recommendations, the exposure-response modeling of epidemiologic data, including new analyses since the 2007 external peer review, and on the adequacy, transparency, and clarity of the revised draft. The peer review will include an opportunity for the public to address the peer reviewers.
2015-11-02
External Peer Review Report on the Defense Contract Management Agency Office of Independent Assessment Internal Review Team N O V E M B E R 2 , 2 0 1 5... MANAGEMENT AGENCY SUBJECT: External Peer Review Report on the Defense Contract Management Agency Office of Independent Assessment Internal Review Team...Report No. DODIG-2016-007) Attached is the External Peer Review Report on the Defense Contract Management Agency Office of Independent Assessment
AQUATOX Release 2 underwent an external peer review in early 2003, and Release 3 underwent an external peer review in late 2008. Reviewers stated model enhancements have made AQUATOX one of the most exciting tools in aquatic ecosystem management.
Peer Feedback in Anonymous Peer Review in an EFL Writing Class in Spain
ERIC Educational Resources Information Center
Coté, Robert A.
2014-01-01
The present study reports the results of a process of peer feedback through anonymous peer review in an EFL writing class. Numerous studies have reported on the benefits of peer review (PR) in the ESL/EFL writing classroom. However, the literature also identifies social issues that can negatively affect the outcome of face-to-face PR. In this…
McEvoy, Fintan J; Shen, Nicholas W; Nielsen, Dorte H; Buelund, Lene E; Holm, Peter
2017-02-01
Communicating radiological reports to peers has pedagogical value. Students may be uneasy with the process due to a lack of communication and peer review skills or to their failure to see value in the process. We describe a communication exercise with peer review in an undergraduate veterinary radiology course. The computer code used to manage the course and deliver images online is reported, and we provide links to the executable files. We tested to see if undergraduate peer review of radiological reports has validity and describe student impressions of the learning process. Peer review scores for student-generated radiological reports were compared to scores obtained in the summative multiple choice (MCQ) examination for the course. Student satisfaction was measured using a bespoke questionnaire. There was a weak positive correlation (Pearson correlation coefficient = 0.32, p < 0.01) between peer review scores students received and the student scores obtained in the MCQ examination. The difference in peer review scores received by students grouped according to their level of course performance (high vs. low) was statistically significant (p < 0.05). No correlation was found between peer review scores awarded by the students and the scores they obtained in the MCQ examination (Pearson correlation coefficient = 0.17, p = 0.14). In conclusion, we have created a realistic radiology imaging exercise with readily available software. The peer review scores are valid in that to a limited degree they reflect student future performance in an examination. Students valued the process of learning to communicate radiological findings but do not fully appreciated the value of peer review.
ERIC Educational Resources Information Center
Bountress, Kaitlin; Chassin, Laurie; Presson, Clark C.; Jackson, Corrie
2016-01-01
Using participants from an 1-and-1/2-year longitudinal study of smoking socialization (N = 709), we examined peer smoking, and implicit and explicit attitudes on smoking initiation among initial nonsmoking adolescents. We also tested whether implicit and explicit attitudes mediated the effect of peer smoking on smoking initiation, and whether…
Evaluating the Pros and Cons of Different Peer Review Policies via Simulation.
Zhu, Jia; Fung, Gabriel; Wong, Wai Hung; Li, Zhixu; Xu, Chuanhua
2016-08-01
In the academic world, peer review is one of the major processes in evaluating a scholars contribution. In this study, we are interested in quantifying the merits of different policies in a peer review process, such as single-blind review, double-blind review, and obtaining authors feedback. Currently, insufficient work has been undertaken to evaluate the benefits of different peer review policies. One of the major reasons for this situation is the inability to conduct any empirical study because data are presently unavailable. In this case, a computer simulation is one of the best ways to conduct a study. We perform a series of simulations to study the effects of different policies on a peer review process. In this study, we focus on the peer review process of a typical computer science conference. Our results point to the crucial role of program chairs in determining the quality and diversity of the articles to be accepted for publication. We demonstrate the importance of discussion among reviewers, suggest circumstances in which the double-blind review policy should be adopted, and question the credibility of the authors feedback mechanism. Finally, we stress that randomness plays an important role in the peer review process, and this role cannot be eliminated. Although our model may not capture every component of a peer review process, it covers some of the most essential elements. Thus, even the simulation results clearly cannot be taken as literal descriptions of an actual peer review process. However, we can at least still use them to identify alternative directions for future study.
7 CFR 3400.14 - Proposal review.
Code of Federal Regulations, 2010 CFR
2010-01-01
... SERVICE, DEPARTMENT OF AGRICULTURE SPECIAL RESEARCH GRANTS PROGRAM Scientific Peer Review of Research... employees of the Department, the respective peer review group, and ad hoc reviewers, as required. Written...-depth discussions will be provided by peer review group members prior to recommending applications for...
How peer-review constrains cognition: on the frontline in the knowledge sector.
Cowley, Stephen J
2015-01-01
Peer-review is neither reliable, fair, nor a valid basis for predicting 'impact': as quality control, peer-review is not fit for purpose. Endorsing the consensus, I offer a reframing: while a normative social process, peer-review also shapes the writing of a scientific paper. In so far as 'cognition' describes enabling conditions for flexible behavior, the practices of peer-review thus constrain knowledge-making. To pursue cognitive functions of peer-review, however, manuscripts must be seen as 'symbolizations', replicable patterns that use technologically enabled activity. On this bio-cognitive view, peer-review constrains knowledge-making by writers, editors, reviewers. Authors are prompted to recursively re-aggregate symbolizations to present what are deemed acceptable knowledge claims. How, then, can recursive re-embodiment be explored? In illustration, I sketch how the paper's own content came to be re-aggregated: agonistic review drove reformatting of argument structure, changes in rhetorical ploys and careful choice of wordings. For this reason, the paper's knowledge-claims can be traced to human activity that occurs in distributed cognitive systems. Peer-review is on the frontline in the knowledge sector in that it delimits what can count as knowing. Its systemic nature is therefore crucial to not only discipline-centered 'real' science but also its 'post-academic' counterparts.
Real-Time Peer Review: An Innovative Feature to an Evidence-Based Practice Conference
Eldredge, Jonathan D.; Phillips, Holly E.; Kroth, Philip J.
2013-01-01
Many health sciences librarians as well as other professionals attend conferences on a regular basis. This study sought to link an innovative peer review process of presented research papers to long-term conference outcomes in the peer-reviewed professional journal literature. An evidence-based conference included a proof-of-concept study to gauge the long-term outcomes from research papers presented during the program. Real-time peer review recommendations from the conference were linked to final versions of articles published in the peer-reviewed literature. The real-time peer review feedback served as the basis for further mentoring to guide prospective authors toward publishing their research results. These efforts resulted in the publication of two of the four research papers in the peer-viewed literature. A third presented paper appeared in a blog because the authors wanted to disseminate their findings more quickly than through the journal literature. The presenters of the fourth paper never published their study. Real-time peer review from this study can be adapted to other professional conferences that include presented research papers. PMID:24180649
Peer Review for EPA's Biologically Based Dose-Response ...
EPA is developing a regulation for perchlorate in drinking water. As part the regulatory process EPA must develop a Maximum Contaminant Level Goal (MCLG). FDA and EPA scientists developed a biologically based dose-response (BBDR) model to assist in deriving the MCLG. This model is designed to determine under what conditions of iodine nutrition and exposure to perchlorate across sensitive lifestages would result in low serum free and total thyroxine (hypothyroxinemia). EPA is undertaking a peer review to provide a focused, objective independent peer evaluation of the draft model and its model results report. EPA is undertaking a peer review to provide a focused, objective independent peer evaluation of the draft model and its model results report. Peer review is an important component of the scientific process. The criticism, suggestions, and new ideas provided by the peer reviewers stimulate creative thought, strengthen the interpretation of the reviewed material, and confer credibility on the product. The peer review objective is to provide advice to EPA on steps that will yield a highly credible scientific product that is supported by the scientific community and a defensible perchlorate MCLG.
Navigating manuscript assessment: The new practitioner's guide to primary literature peer review.
Smith, Devlin V; Stokes, Laura B; Marx, Kayleigh; Aitken, Samuel L
2018-01-01
For pharmacists, the first years after graduation are spent developing their knowledge base, advancing as a practitioner, and honing their abilities as healthcare providers and drug information experts. New practitioners encounter many challenges during this time, which for many include publishing original research or reviewing manuscripts for colleagues and medical journals. Inexperience navigating the publication process, from submission to receipt of (and response to) peer review commentary, is often cited as a major barrier to timely publication of resident and new practitioner research. Serving as a peer reviewer in turn provides the new practitioner with insight on this process and can be an enlightening experience used to garner confidence in subsequently submitting their own formal manuscripts. A number of publications describing steps for peer review are available, however, many of these articles address more experienced reviewers or critique the peer review process itself. No definitive resource exists for new pharmacy practitioners interested in developing their peer review skills. The information presented in this summative guide should be used in conjunction with practice opportunities to help new practitioners develop proficiency at peer review.
Tobacco industry denormalisation as a tobacco control intervention: a review
Malone, Ruth E; Grundy, Quinn; Bero, Lisa A
2012-01-01
Objective To conduct a review of research examining the effects of tobacco industry denormalisation (TID) on smoking-related and attitude-related outcomes. Methods The authors searched Pubmed and Scopus databases for articles published through December 2010 (see figure 1). We included all peer-reviewed TID studies we could locate that measured smoking-related outcomes and attitudes toward the tobacco industry. Exclusion criteria included: non-English language, focus on tobacco use rather than TID, perceived ad efficacy as sole outcome, complex program interventions without a separately analysable TID component and non peer-reviewed literature. We analysed the literature qualitatively and summarised findings by outcome measured. Results After excluding articles not meeting the search criteria, the authors reviewed 60 studies examining TID and 9 smoking-related outcomes, including smoking prevalence, smoking initiation, intention to smoke and intention to quit. The authors also reviewed studies of attitudes towards the tobacco industry and its regulation. The majority of studies suggest that TID is effective in reducing smoking prevalence and initiation and increasing intentions to quit. Evidence is mixed for some other outcomes, but some of the divergent findings may be explained by study designs. Conclusions A robust body of evidence suggests that TID is an effective tobacco control intervention at the population level that has a clear exposure–response effect. TID may also contribute to other tobacco control outcomes not explored in this review (including efforts to ‘directly erode industry power’), and thus may enhance public support and political will for structural reforms to end the tobacco epidemic. PMID:22345240
Process modeling and bottleneck mining in online peer-review systems.
Premchaiswadi, Wichian; Porouhan, Parham
2015-01-01
This paper is divided into three main parts. In the first part of the study, we captured, collected and formatted an event log describing the handling of reviews for proceedings of an international conference in Thailand. In the second part, we used several process mining techniques in order to discover process models, social, organizational, and hierarchical structures from the proceeding's event log. In the third part, we detected the deviations and bottlenecks of the peer review process by comparing the observed events (i.e., authentic dataset) with a pre-defined model (i.e., master map). Finally, we investigated the performance information as well as the total waiting time in order to improve the effectiveness and efficiency of the online submission and peer review system for the prospective conferences and seminars. Consequently, the main goals of the study were as follows: (1) to convert the collected event log into the appropriate format supported by process mining analysis tools, (2) to discover process models and to construct social networks based on the collected event log, and (3) to find deviations, discrepancies and bottlenecks between the collected event log and the master pre-defined model. The results showed that although each paper was initially sent to three different reviewers; it was not always possible to make a decision after the first round of reviewing; therefore, additional reviewers were invited. In total, all the accepted and rejected manuscripts were reviewed by an average of 3.9 and 3.2 expert reviewers, respectively. Moreover, obvious violations of the rules and regulations relating to careless or inappropriate peer review of a manuscript-committed by the editorial board and other staff-were identified. Nine blocks of activity in the authentic dataset were not completely compatible with the activities defined in the master model. Also, five of the activity traces were not correctly enabled, and seven activities were missed within the online submission system. On the other hand, dealing with the feedback (comments) received from the first and the third reviewers; the conference committee members and the organizers did not attend to those feedback/comments in a timely manner.
The effect of peer review on mortality rates.
Krahwinkel, W; Schuler, E; Liebetrau, M; Meier-Hellmann, A; Zacher, J; Kuhlen, R
2016-10-01
Lowering of mortality rates in hospitals with mortality rates higher than accepted reference values for acute myocardial infarction (AMI), congestive heart failure (CHF), pneumonia, stroke, mechanical ventilation (MV) and colorectal surgery by using an external peer review process that identifies areas requiring rectification and implements protocols directed at improving these areas. Retrospective, observational, quality management study using administrative data to compare in-hospital mortality rates (pre and post an external peer review process that included adoption of improvement protocols) with reference values. German general hospitals of a large, private group. Hospitals with mortality rates higher than reference values. Peer review of medical records by experienced, outside physicians triggered by in-hospital mortality rates higher than expected. Inadequacies were identified, improvement protocols enforced and mortality rates subsequently re-examined. Mortality rates 1 year before and 1 year after peer review and protocol use. For AMI, CHF, pneumonia, stroke, MV and colorectal surgery, the mortality rates 1 year post-peer review were significantly decreased as compared to pre-peer review mortality rates. The standardized mortality ratio for all of the above diagnoses was 1.45, 1 year before peer review, and 0.97, 1 year after peer review. The absolute risk reduction of 7.3% translates into 710 deaths in this population which could have been prevented. Peer review triggered and conducted in the manner described here is associated with a significant lowering of in-hospital mortality rates in hospitals that previously had higher than expected mortality rates. © The Author 2016. Published by Oxford University Press in association with the International Society for Quality in Health Care.
Examining the Predictive Validity of NIH Peer Review Scores
Lindner, Mark D.; Nakamura, Richard K.
2015-01-01
The predictive validity of peer review at the National Institutes of Health (NIH) has not yet been demonstrated empirically. It might be assumed that the most efficient and expedient test of the predictive validity of NIH peer review would be an examination of the correlation between percentile scores from peer review and bibliometric indices of the publications produced from funded projects. The present study used a large dataset to examine the rationale for such a study, to determine if it would satisfy the requirements for a test of predictive validity. The results show significant restriction of range in the applications selected for funding. Furthermore, those few applications that are funded with slightly worse peer review scores are not selected at random or representative of other applications in the same range. The funding institutes also negotiate with applicants to address issues identified during peer review. Therefore, the peer review scores assigned to the submitted applications, especially for those few funded applications with slightly worse peer review scores, do not reflect the changed and improved projects that are eventually funded. In addition, citation metrics by themselves are not valid or appropriate measures of scientific impact. The use of bibliometric indices on their own to measure scientific impact would likely increase the inefficiencies and problems with replicability already largely attributed to the current over-emphasis on bibliometric indices. Therefore, retrospective analyses of the correlation between percentile scores from peer review and bibliometric indices of the publications resulting from funded grant applications are not valid tests of the predictive validity of peer review at the NIH. PMID:26039440
Federal Register 2010, 2011, 2012, 2013, 2014
2012-03-30
... Federal Acquisition Regulation Supplement: New Threshold for Peer Reviews of Noncompetitive Contracts... Regulation Supplement (DFARS) to modify the threshold for noncompetitive contract peer reviews. DATES...-6088. SUPPLEMENTARY INFORMATION: I. Background This final rule reduces the threshold for DoD peer...
Kovanis, Michail; Porcher, Raphaël; Ravaud, Philippe; Trinquart, Ludovic
2016-01-01
The growth in scientific production may threaten the capacity for the scientific community to handle the ever-increasing demand for peer review of scientific publications. There is little evidence regarding the sustainability of the peer-review system and how the scientific community copes with the burden it poses. We used mathematical modeling to estimate the overall quantitative annual demand for peer review and the supply in biomedical research. The modeling was informed by empirical data from various sources in the biomedical domain, including all articles indexed at MEDLINE. We found that for 2015, across a range of scenarios, the supply exceeded by 15% to 249% the demand for reviewers and reviews. However, 20% of the researchers performed 69% to 94% of the reviews. Among researchers actually contributing to peer review, 70% dedicated 1% or less of their research work-time to peer review while 5% dedicated 13% or more of it. An estimated 63.4 million hours were devoted to peer review in 2015, among which 18.9 million hours were provided by the top 5% contributing reviewers. Our results support that the system is sustainable in terms of volume but emphasizes a considerable imbalance in the distribution of the peer-review effort across the scientific community. Finally, various individual interactions between authors, editors and reviewers may reduce to some extent the number of reviewers who are available to editors at any point.
Porcher, Raphaël; Ravaud, Philippe; Trinquart, Ludovic
2016-01-01
The growth in scientific production may threaten the capacity for the scientific community to handle the ever-increasing demand for peer review of scientific publications. There is little evidence regarding the sustainability of the peer-review system and how the scientific community copes with the burden it poses. We used mathematical modeling to estimate the overall quantitative annual demand for peer review and the supply in biomedical research. The modeling was informed by empirical data from various sources in the biomedical domain, including all articles indexed at MEDLINE. We found that for 2015, across a range of scenarios, the supply exceeded by 15% to 249% the demand for reviewers and reviews. However, 20% of the researchers performed 69% to 94% of the reviews. Among researchers actually contributing to peer review, 70% dedicated 1% or less of their research work-time to peer review while 5% dedicated 13% or more of it. An estimated 63.4 million hours were devoted to peer review in 2015, among which 18.9 million hours were provided by the top 5% contributing reviewers. Our results support that the system is sustainable in terms of volume but emphasizes a considerable imbalance in the distribution of the peer-review effort across the scientific community. Finally, various individual interactions between authors, editors and reviewers may reduce to some extent the number of reviewers who are available to editors at any point. PMID:27832157
Gender bias in scholarly peer review
Helmer, Markus; Schottdorf, Manuel; Neef, Andreas; Battaglia, Demian
2017-01-01
Peer review is the cornerstone of scholarly publishing and it is essential that peer reviewers are appointed on the basis of their expertise alone. However, it is difficult to check for any bias in the peer-review process because the identity of peer reviewers generally remains confidential. Here, using public information about the identities of 9000 editors and 43000 reviewers from the Frontiers series of journals, we show that women are underrepresented in the peer-review process, that editors of both genders operate with substantial same-gender preference (homophily), and that the mechanisms of this homophily are gender-dependent. We also show that homophily will persist even if numerical parity between genders is reached, highlighting the need for increased efforts to combat subtler forms of gender bias in scholarly publishing. DOI: http://dx.doi.org/10.7554/eLife.21718.001 PMID:28322725
Quality assurance in radiology: peer review and peer feedback.
Strickland, N H
2015-11-01
Peer review in radiology means an assessment of the accuracy of a report issued by another radiologist. Inevitably, this involves a judgement opinion from the reviewing radiologist. Peer feedback is the means by which any form of peer review is communicated back to the original author of the report. This article defines terms, discusses the current status, identifies problems, and provides some recommendations as to the way forward, concentrating upon the software requirements for efficient peer review and peer feedback of reported imaging studies. Radiologists undertake routine peer review in their everyday clinical practice, particularly when reporting and preparing for multidisciplinary team meetings. More formal peer review of reported imaging studies has been advocated as a quality assurance measure to promote good clinical practice. It is also a way of assessing the competency of reporting radiologists referred for investigation to bodies such as the General Medical Council (GMC). The literature shows, firstly, that there is a very wide reported range of discrepancy rates in many studies, which have used a variety of non-comparable methodologies; and secondly, that applying scoring systems in formal peer review is often meaningless, unhelpful, and can even be detrimental. There is currently a lack of electronic peer feedback system software on the market to inform radiologists of any review of their work that has occurred or to provide them with clinical outcome information on cases they have previously reported. Learning opportunities are therefore missed. Radiologists should actively engage with the medical informatics industry to design optimal peer review and feedback software with features to meet their needs. Such a system should be easy to use, be fully integrated with the radiological information and picture archiving systems used clinically, and contain a free-text comment box, without a numerical scoring system. It should form a temporary record that cannot be permanently archived. It must provide automated feedback to the original author. Peer feedback, as part of everyday reporting, should enhance daily learning for radiologists. Software requirements for everyday peer feedback differ from those needed for a formal peer review process, which might only be necessary in the setting of a formal GMC enquiry into a particular radiologist's reporting competence, for example. Copyright © 2015 The Royal College of Radiologists. Published by Elsevier Ltd. All rights reserved.
Doing Peer Review: Reflections from an International Group of Postdoctoral Fellows
ERIC Educational Resources Information Center
Merry, Lisa; Jarvis, Kimberly; Kupoluyi, Joseph; Lual, Jomama One Jomama
2017-01-01
There is very little written regarding developing the skills of doing peer reviews. In this piece we use our own experience as postdoctoral fellows to offer our reflections on how to get the most out of doing peer reviews as a trainee researcher. We touch upon the variety and complexity of peer reviews, the debates concerning the nature and…
A proposal for an 'equal peer-review' statement.
Moustafa, Khaled
2015-08-01
To make the peer-review process as objective as possible, I suggest the introduction of an 'equal peer-review' statement that preserves author anonymity across the board, thus removing any potential bias related to nominal or institutional 'prestige'; this would guarantee an equal peer-review process for all authors and grant applicants. Copyright © 2015 Elsevier Ltd. All rights reserved.
Peer Review in Class: Metrics and Variations in a Senior Course
ERIC Educational Resources Information Center
Yankulov, Krassimir; Couto, Richard
2012-01-01
Peer reviews are the generally accepted mode of quality assessment in scholarly communities; however, they are rarely used for evaluation at college levels. Over a period of 5 years, we have performed a peer review simulation at a senior level course in molecular genetics at the University of Guelph and have accumulated 393 student peer reviews.…
DOE Office of Scientific and Technical Information (OSTI.GOV)
Not Available
Environmental studies were conducted to provide data that could be used by the Commissioner of Health for the State of New York in determining whether the Emergency Declaration Area surrounding the Love Canal hazardous-waste site is habitable. These volumes (II through IV) were reviewed by a peer-review panel of expert scientists. The scientists concluded that each of the three environmental studies was well planned and well executed. Volume V summarizes the peer review and gives additional information or clarifications as requested during the peer review. Volume V also provides additional supplemental statistical analyses requested by the peer reviewer panel.
The Myth of Peer Influence in Adolescent Smoking Initiation
ERIC Educational Resources Information Center
Arnett, Jeffrey Jensen
2007-01-01
The widespread belief that peer influence is the primary cause of adolescent smoking initiation is examined and called into question. Correlational and longitudinal studies purporting to demonstrate peer influence are analyzed, and their limitations described. Qualitative interview studies of adolescent smoking initiation are presented as…
Roberts, C M; Stone, R A; Buckingham, R J; Pursey, N A; Harrison, B D W; Lowe, D; Potter, J M
2010-06-01
Peer review has been widely employed within the NHS to facilitate health quality improvement but has not been rigorously evaluated. This article reports the largest randomised trial of peer review ever conducted in the UK. The peer review intervention was a reciprocal supportive exercise that included clinicians, hospital management, commissioners and patients which focused on the quality of the provision of four specific evidence-based aspects of chronic obstructive pulmonary disease care. Follow up at 12 months demonstrated few quantitative differences in the number or quality of services offered in the two groups. Qualitative data in contrast suggested many benefits of peer review in most but not all intervention units and some control teams. Findings suggest peer review in this format is a positive experience for most participants but is ineffective in some situations. Its longer term benefits and cost effectiveness require further study. The generic findings of this study have potential implications for the application of peer review throughout the NHS.
Koegel, Lynn Kern; Vernon, Ty; Koegel, Robert L.; Koegel, Brittany L.; Paullin, Anne W.
2013-01-01
Children with Asperger’s Disorder often have difficulty with peer relationships and socialization. The current study assessed whether peer social interactions would improve in school settings if an intervention was designed that incorporated the children with Asperger’s interests. Three children who were fully-included in regular education classes but did not interact with peers prior to intervention participated in this research. Social lunch clubs, open to both the study participants and their typical peers, were implemented twice weekly during regular lunchtime periods. Results showed that all three children increased their time engaged with peers as a result of the clubs. While their initiations greatly improved over baseline levels and approximated their peers, they were often initiating below the level of most of their peers. Implications for improving peer social interactions for children with Asperger’s Disorder are discussed. PMID:25328380
Mentored peer reviewing for PhD faculty and students.
Xu, Jiayun; Kim, Kyounghae; Kurtz, Melissa; Nolan, Marie T
2016-02-01
There is a need for scholars to be prepared as peer reviewers in order to ensure the continual publication of quality science. However, developing the skills to craft a constructive critique can be difficult. In this commentary, we discuss the use of a group peer review mentoring model for PhD students to gain experience in peer review from a faculty member who is experienced in peer review. Central to this model, was the opportunity for each student and faculty mentor to openly discuss their critique of the manuscript. Through this enriching experience, novice researchers were able to learn the elements of a good peer review, better determine a manuscript's substantive contribution to science, and advance the quality of their own manuscript writing. Copyright © 2015 Elsevier Ltd. All rights reserved.
McCoy, Marcia Burton; Geppert, Joni; Dech, Linda; Richardson, Michaela
2018-01-01
Background Peer counseling (PC) has been associated with increased breastfeeding initiation and duration, but few analyses have examined the Special Supplemental Nutrition Program for Women, Infants, and Children (WIC) model for peer counseling or the continuation of breastfeeding from birth through 12 months postpartum. Objectives Identify associations between Minnesota WIC Peer Breastfeeding Support Program services and breastfeeding initiation and continuation. Methods Retrospective analysis of observational data from the Minnesota WIC program's administrative database of women who gave birth in 2012 and accepted a PC program referral prenatally (n = 2219). Multivariate logistic regression and Cox regression models examined associations between peer services and breastfeeding initiation and continuation of any breastfeeding. Results Among women who accepted referral into a PC program, odds of initiation were significantly higher among those who received peer services (Odds Ratio (OR): 1.66; 95% CI 1.19-2.32), after adjusting for confounders. Women who received peer services had a significantly lower hazard of breastfeeding discontinuation from birth through 12 months postpartum than women who did not receive services. (Hazard Ratio (HR) month one: 0.45; 95% CI 0.33-0.61; months two through twelve: 0.33; 95% CI 0.18-0.60). The effect of peer counseling did not differ significantly by race and ethnicity, taking into account mother's country of origin. Conclusion for practice Receipt of peer services was positively associated with breastfeeding initiation and continued breastfeeding from birth through 12 months postpartum. Making peer services available to more women, especially in communities with low initiation and duration, could improve maternal and child health in Minnesota.
The effects of an editor serving as one of the reviewers during the peer-review process.
Giordan, Marco; Csikasz-Nagy, Attila; Collings, Andrew M; Vaggi, Federico
2016-01-01
Background Publishing in scientific journals is one of the most important ways in which scientists disseminate research to their peers and to the wider public. Pre-publication peer review underpins this process, but peer review is subject to various criticisms and is under pressure from growth in the number of scientific publications. Methods Here we examine an element of the editorial process at eLife , in which the Reviewing Editor usually serves as one of the referees, to see what effect this has on decision times, decision type, and the number of citations. We analysed a dataset of 8,905 research submissions to eLife since June 2012, of which 2,747 were sent for peer review. This subset of 2747 papers was then analysed in detail. Results The Reviewing Editor serving as one of the peer reviewers results in faster decision times on average, with the time to final decision ten days faster for accepted submissions (n=1,405) and five days faster for papers that were rejected after peer review (n=1,099). Moreover, editors acting as reviewers had no effect on whether submissions were accepted or rejected, and a very small (but significant) effect on citation rates. Conclusions An important aspect of eLife 's peer-review process is shown to be effective, given that decision times are faster when the Reviewing Editor serves as a reviewer. Other journals hoping to improve decision times could consider adopting a similar approach.
What is open peer review? A systematic review
Ross-Hellauer, Tony
2017-01-01
Background: “Open peer review” (OPR), despite being a major pillar of Open Science, has neither a standardized definition nor an agreed schema of its features and implementations. The literature reflects this, with numerous overlapping and contradictory definitions. While for some the term refers to peer review where the identities of both author and reviewer are disclosed to each other, for others it signifies systems where reviewer reports are published alongside articles. For others it signifies both of these conditions, and for yet others it describes systems where not only “invited experts” are able to comment. For still others, it includes a variety of combinations of these and other novel methods. Methods: Recognising the absence of a consensus view on what open peer review is, this article undertakes a systematic review of definitions of “open peer review” or “open review”, to create a corpus of 122 definitions. These definitions are systematically analysed to build a coherent typology of the various innovations in peer review signified by the term, and hence provide the precise technical definition currently lacking. Results: This quantifiable data yields rich information on the range and extent of differing definitions over time and by broad subject area. Quantifying definitions in this way allows us to accurately portray exactly how ambiguously the phrase “open peer review” has been used thus far, for the literature offers 22 distinct configurations of seven traits, effectively meaning that there are 22 different definitions of OPR in the literature reviewed. Conclusions: I propose a pragmatic definition of open peer review as an umbrella term for a number of overlapping ways that peer review models can be adapted in line with the aims of Open Science, including making reviewer and author identities open, publishing review reports and enabling greater participation in the peer review process. PMID:28580134
Neural Correlates of Social Influence Among Cannabis Users.
Gilman, Jodi M
2017-06-01
Although peer influence is an important factor in the initiation and maintenance of cannabis use, few studies have investigated the neural correlates of peer influence among cannabis users. The current review summarizes research on the neuroscience of social influence in cannabis users, with the goal of highlighting gaps in the literature and the need for future research. Brain regions underlying peer influence may function differently in cannabis users. Compared to non-using controls, regions of the brain underlying reward, such as the striatum, show greater connectivity with frontal regions, and also show hyperactivity when participants are presented with peer information. Other subcortical regions, such as the insula, show hypoactivation during social exclusion in cannabis users, indicating that neural responses to peer interactions may be altered in cannabis users. Although neuroscience is increasingly being used to study social behavior, few studies have specifically focused on cannabis use, and therefore it is difficult to draw conclusions about social mechanisms that may differentiate cannabis users and controls. This area of research may be a promising avenue in which to explore a critical factor underlying cannabis use and addiction.
Code of Federal Regulations, 2014 CFR
2014-10-01
... PROGRAM THE UNIVERSITY AFFILIATED PROGRAMS § 1388.9 Peer review. (a) The purpose of the peer review..., including on-site visits or inspections as necessary. (b) Applications for funding opportunities under part...
Code of Federal Regulations, 2013 CFR
2013-10-01
... PROGRAM THE UNIVERSITY AFFILIATED PROGRAMS § 1388.9 Peer review. (a) The purpose of the peer review..., including on-site visits or inspections as necessary. (b) Applications for funding opportunities under part...
Code of Federal Regulations, 2011 CFR
2011-10-01
... PROGRAM THE UNIVERSITY AFFILIATED PROGRAMS § 1388.9 Peer review. (a) The purpose of the peer review..., including on-site visits or inspections as necessary. (b) Applications for funding opportunities under part...
Code of Federal Regulations, 2012 CFR
2012-10-01
... PROGRAM THE UNIVERSITY AFFILIATED PROGRAMS § 1388.9 Peer review. (a) The purpose of the peer review..., including on-site visits or inspections as necessary. (b) Applications for funding opportunities under part...
Gebhardt, Brian J; Heron, Dwight E; Beriwal, Sushil
Clinical pathways are patient management plans that standardize evidence-based practices to ensure high-quality and cost-effective medical care. Implementation of a pathway is a collaborative process in our network, requiring the active involvement of physicians. This approach promotes acceptance of pathway recommendations, although a peer review process is necessary to ensure compliance and to capture and approve off-pathway selections. We investigated the peer review process and factors associated with time to completion of peer review. Our cancer center implemented radiation oncology pathways for every disease site throughout a large, integrated network. Recommendations are written based upon national guidelines, published literature, and institutional experience with evidence evaluated hierarchically in order of efficacy, toxicity, and then cost. Physicians enter decisions into an online, menu-driven decision support tool that integrates with medical records. Data were collected from the support tool and included the rate of on- and off-pathway selections, peer review decisions performed by disease site directors, and time to complete peer review. A total of 6965 treatment decisions were entered in 2015, and 605 (8.7%) were made off-pathway and were subject to peer review. The median time to peer review decision was 2 days (interquartile range, 0.2-6.8). Factors associated with time to peer review decision >48 hours on univariate analysis include disease site (P < .0001) with a trend toward significance (P = .066) for radiation therapy modality. There was no difference between recurrent and non-recurrent disease (P = .267). Multivariable analysis revealed disease site was associated with time to peer review (P < .001), with lymphoma and skin/sarcoma most strongly influencing decision time >48 hours. Clinical pathways are an integral tool for standardizing evidence-based care throughout our large, integrated network, with 91.3% of all treatment decisions being made as per pathway. The peer review process was feasible, with <1% selections ultimately rejected, suggesting that awareness of peer review of treatment decisions encourages compliance with clinical pathway recommendations. Copyright © 2017 American Society for Radiation Oncology. Published by Elsevier Inc. All rights reserved.
How peer-review constrains cognition: on the frontline in the knowledge sector
Cowley, Stephen J.
2015-01-01
Peer-review is neither reliable, fair, nor a valid basis for predicting ‘impact’: as quality control, peer-review is not fit for purpose. Endorsing the consensus, I offer a reframing: while a normative social process, peer-review also shapes the writing of a scientific paper. In so far as ‘cognition’ describes enabling conditions for flexible behavior, the practices of peer-review thus constrain knowledge-making. To pursue cognitive functions of peer-review, however, manuscripts must be seen as ‘symbolizations’, replicable patterns that use technologically enabled activity. On this bio-cognitive view, peer-review constrains knowledge-making by writers, editors, reviewers. Authors are prompted to recursively re-aggregate symbolizations to present what are deemed acceptable knowledge claims. How, then, can recursive re-embodiment be explored? In illustration, I sketch how the paper’s own content came to be re-aggregated: agonistic review drove reformatting of argument structure, changes in rhetorical ploys and careful choice of wordings. For this reason, the paper’s knowledge-claims can be traced to human activity that occurs in distributed cognitive systems. Peer-review is on the frontline in the knowledge sector in that it delimits what can count as knowing. Its systemic nature is therefore crucial to not only discipline-centered ‘real’ science but also its ‘post-academic’ counterparts. PMID:26579064
Development of a peer-review framework for cancer multidisciplinary meetings.
Johnson, Claire E; Slavova-Azmanova, Neli; Saunders, Christobel
2017-05-01
There is no mechanism in place for monitoring or quality improvement of cancer multidisciplinary meetings (MDM) in Australia. To develop a peer-review process for quality improvement of MDM. This project involved three phases: (i) development of a draft peer-review framework, supporting documents and peer-review process; (ii) consultation with key stakeholders; (iii) refinement of the framework, documents and processes following a pilot study with three MDM. Feedback indicated that specific standards included in the framework needed to allow the peer reviewers to be flexible relative to the circumstances of the individual MDM. Conversely, feedback identified the need for clear, evidence-based clinical practice guidelines for the conduct of MDM, with accepted standards and objective measures of performance. MDM members were divided about the need to employ peer reviewers from the tumour stream of the MDM under review but agreed that closer involvement of the team under review to support the implementation of recommendations is warranted. We developed an adaptable peer-review framework and process using the current available evidence and guidance. While further research is needed to establish what constitutes best practice in MDM and which processes contribute to improved patient outcomes, the structured peer-review process we describe, when modified using the disease-relevant evidence, could be utilised more broadly as a quality improvement tool. © 2017 Royal Australasian College of Physicians.
Peer Review: Promoting Efficient School District Operations
ERIC Educational Resources Information Center
Hale, Jason S.
2010-01-01
Many professions recognize the benefits of peer reviews to assess processes and operations because peers can more easily identify one another's inefficiencies and provide some kind of intervention. Generally, the goal of the peer review process is to verify whether the work satisfies the standards set by the industry. A number of states have begun…
Using Calibrated Peer Review to Teach Basic Research Skills
ERIC Educational Resources Information Center
Bracke, Marianne S.; Graveel, John G.
2014-01-01
Calibrated Peer Review (CPR) is an online tool being used in the class Introduction to Agriculture and Purdue University (AGR 10100) to integrate a writing and research component (http://cpr.molsci.ucla.edu/Home.aspx). Calibrated Peer Review combines the ability to create writing intensive assignments with an introduction to the peer-review…
Acknowledging Students' Collaborations through Peer Review: A Footnoting Practice
ERIC Educational Resources Information Center
Poe, Shelli M.; Gravett, Emily O.
2016-01-01
Student-to-student peer review or peer feedback is commonly used in student-centered or active-learning classrooms. In this article, we describe a footnoting exercise that we implemented in two of our undergraduate courses as one way to encourage students to acknowledge collaborations and contributions made during peer-review processes. This…
A Method for Improving the Integrity of Peer Review.
Dadkhah, Mehdi; Kahani, Mohsen; Borchardt, Glenn
2017-08-15
Peer review is the most important aspect of reputable journals. Without it, we would be unsure about whether the material published was as valid and reliable as is possible. However, with the advent of the Internet, scientific literature has now become subject to a relatively new phenomenon: fake peer reviews. Some dishonest researchers have been manipulating the peer review process to publish what are often inferior papers. There are even papers that explain how to do it. This paper discusses one of those methods and how editors can defeat it by using a special review ID. This method is easy to understand and can be added to current peer review systems easily.
Measuring the effectiveness of scientific gatekeeping.
Siler, Kyle; Lee, Kirby; Bero, Lisa
2015-01-13
Peer review is the main institution responsible for the evaluation and gestation of scientific research. Although peer review is widely seen as vital to scientific evaluation, anecdotal evidence abounds of gatekeeping mistakes in leading journals, such as rejecting seminal contributions or accepting mediocre submissions. Systematic evidence regarding the effectiveness--or lack thereof--of scientific gatekeeping is scant, largely because access to rejected manuscripts from journals is rarely available. Using a dataset of 1,008 manuscripts submitted to three elite medical journals, we show differences in citation outcomes for articles that received different appraisals from editors and peer reviewers. Among rejected articles, desk-rejected manuscripts, deemed as unworthy of peer review by editors, received fewer citations than those sent for peer review. Among both rejected and accepted articles, manuscripts with lower scores from peer reviewers received relatively fewer citations when they were eventually published. However, hindsight reveals numerous questionable gatekeeping decisions. Of the 808 eventually published articles in our dataset, our three focal journals rejected many highly cited manuscripts, including the 14 most popular; roughly the top 2 percent. Of those 14 articles, 12 were desk-rejected. This finding raises concerns regarding whether peer review is ill--suited to recognize and gestate the most impactful ideas and research. Despite this finding, results show that in our case studies, on the whole, there was value added in peer review. Editors and peer reviewers generally--but not always-made good decisions regarding the identification and promotion of quality in scientific manuscripts.
ERIC Educational Resources Information Center
Chadwell, Faye A.; Fisher, Dianna M.
2016-01-01
This article presents Oregon State University's experience launching an innovative Open Textbook initiative in spring 2014. The partners, Open Oregon State and the Oregon State University Libraries and Press, aimed to reduce the cost of course materials for students while ensuring the content created was peer-reviewed and employed multimedia…
Context-Aware Reviewer Assignment for Trust Enhanced Peer Review
Li, Lei; Wang, Yan; Liu, Guanfeng; Wang, Meng; Wu, Xindong
2015-01-01
Reviewer assignment is critical to peer review systems, such as peer-reviewed research conferences or peer-reviewed funding applications, and its effectiveness is a deep concern of all academics. However, there are some problems in existing peer review systems during reviewer assignment. For example, some of the reviewers are much more stringent than others, leading to an unfair final decision, i.e., some submissions (i.e., papers or applications) with better quality are rejected. In this paper, we propose a context-aware reviewer assignment for trust enhanced peer review. More specifically, in our approach, we first consider the research area specific expertise of reviewers, and the institution relevance and co-authorship between reviewers and authors, so that reviewers with the right expertise are assigned to the corresponding submissions without potential conflict of interest. In addition, we propose a novel cross-assignment paradigm, and reviewers are cross-assigned in order to avoid assigning a group of stringent reviewers or a group of lenient reviewers to the same submission. More importantly, on top of them, we propose an academic CONtext-aware expertise relevanCe oriEnted Reviewer cross-assignmenT approach (CONCERT), which aims to effectively estimate the “true” ratings of submissions based on the ratings from all reviewers, even though no prior knowledge exists about the distribution of stringent reviewers and lenient reviewers. The experiments illustrate that compared with existing approaches, our proposed CONCERT approach can less likely assign more than one stringent reviewers or lenient reviewers to a submission simultaneously and significantly reduce the influence of ratings from stringent reviewers and lenient reviewers, leading to trust enhanced peer review and selection, no matter what kind of distributions of stringent reviewers and lenient reviewers are. PMID:26090849
International Conference in Computational Cell Biology: From the Past to the Future
2016-09-12
24061 -0001 ABSTRACT Number of Papers published in peer -reviewed journals: Number of Papers published in non peer -reviewed journals: Final Report...present their latest research and discussed challenges in computational cell biology research and education. (a) Papers published in peer -reviewed...List the papers, including journal references, in the following categories: (b) Papers published in non- peer -reviewed journals (N/A for none) (c
Friends: The Role of Peer Influence across Adolescent Risk Behaviors.
ERIC Educational Resources Information Center
Maxwell, Kimberly A.
2002-01-01
Examined peer influence for 1,969 adolescents across 5 risk behaviors: smoking, alcohol consumption, marijuana use, tobacco chewing, and sexual debut. Results show that a random same-sex peer predicts a teen's risk behavior initiation through influence to initiate cigarette and marijuana use, and influence to initiate and stop alcohol and chewing…
Huo, M; Gorayski, P; Poulsen, M; Thompson, K; Pinkham, M B
2017-10-01
Technological advances in radiation therapy permit steep dose gradients from the target to spare normal tissue, but increase the risk of geographic miss. Suboptimal target delineation adversely affects clinical outcomes. Prospective peer review is a method for quality assurance of oncologists' radiotherapy plans. Published surveys suggest it is widely implemented. However, it may not be feasible to review every case before commencement of radiation therapy in all departments. The rate of plan changes following peer review of cases without a specific subsite or modality is typically around 10%. Stereotactic body radiation therapy, head and neck, gynaecological, gastrointestinal, haematological and lung cases are associated with higher rates of change of around 25%. These cases could thus be prioritised for peer review. Other factors may limit peer review efficacy including organisational culture, time constraints and the physical environment in which sessions are held. Recommendations for peer review endorsed by the American Society for Radiation Oncology were made available in 2013, but a number of relevant studies have been published since. Here we review and update the literature, and provide an updated suggestion for the implementation of peer review to serve as an adjunct to published guidelines. This may help practitioners evaluate their current processes and maximise the utility and effectiveness of peer review sessions. Copyright © 2017 The Royal College of Radiologists. Published by Elsevier Ltd. All rights reserved.
Improving your journal article using feedback from peer review.
Price, Bob
2014-09-30
While preparation of a journal article for submission may often include informal review by colleagues, an article is not accepted for publication until it has been formally peer reviewed. Peer review is the process whereby journal editors ask expert reviewers to examine the work submitted and prepare a report on its suitability for publication. Two or more revisions of the article may be required following peer review, with the author reworking the article in the light of feedback received on each occasion. This can be challenging for some authors, but used well, it offers a chance to improve the work to the required standard of the journal, and help the author present a more precise and coherent account of the arguments. The extent to which the author responds to the critical commentary of peer reviewers is important, because this may determine whether or not the article is published. This article explores the aims of peer reviewers and recommends ways in which authors can respond to the feedback provided.
Peer Collaboration: Improving Teaching through Comprehensive Peer Review
ERIC Educational Resources Information Center
Smith, Shelley L.
2014-01-01
This article includes a brief rationale and review of the literature on peer review of teaching (PRT). Based on that literature review, it offers a proposal for an optimal formative review process that results in a teaching portfolio that would reflect a faculty member's efforts and successes in a critically reflective PRT process, and contributes…
42 CFR 52h.9 - What matters must be reviewed for unsolicited contract proposals?
Code of Federal Regulations, 2010 CFR
2010-10-01
... SERVICES GRANTS SCIENTIFIC PEER REVIEW OF RESEARCH GRANT APPLICATIONS AND RESEARCH AND DEVELOPMENT CONTRACT... covered by this part unless the proposal has been reviewed by a peer review group in accordance with the... proposal. (b) Except to the extent otherwise provided by law, peer review group recommendations are...
Twaij, H; Oussedik, S; Hoffmeyer, P
2014-04-01
The maintenance of quality and integrity in clinical and basic science research depends upon peer review. This process has stood the test of time and has evolved to meet increasing work loads, and ways of detecting fraud in the scientific community. However, in the 21st century, the emphasis on evidence-based medicine and good science has placed pressure on the ways in which the peer review system is used by most journals. This paper reviews the peer review system and the problems it faces in the digital age, and proposes possible solutions.
The preprint debate: What are the issues?
da Silva, Jaime A Teixeira
2018-04-01
The debate surrounding preprints is increasing. Preprint proponents claim that preprints are a way to shore up trust in academic publishing, that they provide an additional 'quality' screen prior to traditional peer review, that they can assist with the replication crisis plaguing science in part by making negative or contradictory results public, and that they speed up the publishing process because fundamental results can be presented early, serving as timely reports for the purposes of tenure or grant funding. Preprint skeptics and critics claim that preprints may represent a risk and a danger to quality-based academic publishing because they are documents that have not been carefully and thoroughly vetted prior to their release into the public domain. Thus, academics who cite invalid, poorly vetted, or false facts could cause harm, not unlike the unscholarly 'predatory' open access movement. Feedback on work from lesser-known groups, or on less glamorous topics, may be null or worse than from traditional peer review, annulling an initial key objective of preprints. Although there is no widespread empirical evidence or data yet regarding some of these issues, academics should be aware of the ideological, financial, and political tug-of-war taking place before deciding if they wish to publish their important findings as a preprint prior or simultaneous to submitting to a regular journal for peer review.
7 CFR 3400.10 - Establishment and operation of peer review groups.
Code of Federal Regulations, 2011 CFR
2011-01-01
... INSTITUTE OF FOOD AND AGRICULTURE SPECIAL RESEARCH GRANTS PROGRAM Scientific Peer Review of Research Grant Applications § 3400.10 Establishment and operation of peer review groups. Subject to § 3400.5, the...
28 CFR 34.104 - Use of peer review.
Code of Federal Regulations, 2013 CFR
2013-07-01
... the peer review process. (c) Ratings will be in the form of numerical scores assigned by individual... results of peer review for a noncompetitive new or continuation project will be in the form of numerical...
28 CFR 34.104 - Use of peer review.
Code of Federal Regulations, 2014 CFR
2014-07-01
... the peer review process. (c) Ratings will be in the form of numerical scores assigned by individual... results of peer review for a noncompetitive new or continuation project will be in the form of numerical...
28 CFR 34.104 - Use of peer review.
Code of Federal Regulations, 2011 CFR
2011-07-01
... the peer review process. (c) Ratings will be in the form of numerical scores assigned by individual... results of peer review for a noncompetitive new or continuation project will be in the form of numerical...
28 CFR 34.104 - Use of peer review.
Code of Federal Regulations, 2012 CFR
2012-07-01
... the peer review process. (c) Ratings will be in the form of numerical scores assigned by individual... results of peer review for a noncompetitive new or continuation project will be in the form of numerical...
Wheeler, Steven; Acord-Vira, Amanda; Davis, Diana
2016-01-01
This systematic review evaluates the effectiveness of interventions to improve occupational performance for people with psychosocial, behavioral, or emotional impairments after traumatic brain injury (TBI). Medline, PsycINFO, CINAHL, OTseeker, and the Cochrane Database of Systematic Reviews were searched. Of the 1,512 articles initially identified, 35 met the inclusion criteria. Six types of interventions were identified: (1) education, (2) peer mentoring, (3) goal-directed therapy, (4) physical activity, (5) skills training, and (6) cognitive-behavioral therapy (CBT). Strong evidence from well-conducted research supports the use of CBT in individual and group settings. Moderate evidence supports goal-directed interventions, aquatic exercise, and functional skills training. Limited evidence supports peer mentoring, aerobic exercise, educational interventions, and various skills training. An increasing body of evidence supports specific interventions to improve occupational performance and participation for people with psychosocial, behavioral, or emotional impairments after TBI. Copyright © 2016 by the American Occupational Therapy Association, Inc.
Classen, Sherrilene; Winter, Sandra M.; Velozo, Craig A.; Bédard, Michel; Lanford, Desiree N.; Brumback, Babette; Lutz, Barbara J.
2010-01-01
OBJECTIVE We report on item development and validity testing of a self-report older adult safe driving behaviors measure (SDBM). METHOD On the basis of theoretical frameworks (Precede–Proceed Model of Health Promotion, Haddon’s matrix, and Michon’s model), existing driving measures, and previous research and guided by measurement theory, we developed items capturing safe driving behavior. Item development was further informed by focus groups. We established face validity using peer reviewers and content validity using expert raters. RESULTS Peer review indicated acceptable face validity. Initial expert rater review yielded a scale content validity index (CVI) rating of 0.78, with 44 of 60 items rated ≥0.75. Sixteen unacceptable items (≤0.5) required major revision or deletion. The next CVI scale average was 0.84, indicating acceptable content validity. CONCLUSION The SDBM has relevance as a self-report to rate older drivers. Future pilot testing of the SDBM comparing results with on-road testing will define criterion validity. PMID:20437917
Ribera, Josep M; Cardellach, Francesc; Selva, Albert
2005-12-01
The decision-making process includes a series of activities undertaken in biomedical journals from the moment a manuscript is received until it is accepted or rejected. Firstly, the manuscript is evaluated by the members of the Editorial Board, who analyze both its suitability for the journal and its scientific quality. After this initial evaluation, the article is evaluated by peer reviewers, an essential process to guarantee its scientific validity. Both the Editorial Board and the peer reviewers usually use checklists which are of enormous help in this task. Once the biomedical article has been accepted, the publication process is started, which in turn includes a series of steps, beginning with technical and medical review of the article's contents and ending with the article's publication in the journal. The present article provides a detailed description of the main technical and ethical issues involved in the processes of decision-making and publication of biomedical articles.
Eyes wide open: reader and author responsibility in understanding the limits of peer review.
Benson, P J
2015-10-01
'Medical science can only flourish in a free society and dies under totalitarian repression.' (1) Peer review post-publication is relatively easy to define: when the world decides the importance of publication. Peer review pre-publication is what the scientific community frequently means when using the term 'peer review'. But what it is it? Few will agree on an exact definition; generally speaking, it refers to an independent, third party scrutiny of a manuscript by scientific experts (called peers) who advise on its suitability for publication. Peer review is expensive; although reviewers are unpaid, the cost in time is enormous and it is slow. There is often little agreement among reviewers about whether an article should be published and peer review can be a lottery. Often referred to as a quality assurance process, there are many examples of when peer review failed. Many will be aware of Woo-Suk Hwang's shocking stem cell research misconduct at Seoul National University. (2) Science famously published two breakthrough articles that were found subsequently to be completely fabricated and this happened in spite of peer review. Science is not unique in making this error. However, love it or hate it, peer review, for the present time at least, is here to stay. In this article, Philippa Benson, Managing Editor of Science Advances (the first open access journal of the American Association for the Advancement of Science), discusses the merits of peer review. Dr Benson has extensive experience in the publishing world and was Executive Director of PJB Consulting, a not-for-profit organisation supporting clients on issues related to converting to full electronic publishing workflows as well as challenges working with international authors and publishers. Her clients included the Public Library of Science journals, the American Society for Nutrition and the de Beaumont Foundation. She recently co-authored a book, What Editors Want: An Author's Guide to Scientific Journal Publishing (University of Chicago Press), which helps readers understand and navigate the publishing process in high impact science and technical journals. Her master's and doctorate degrees are from Carnegie Mellon University. JYOTI SHAH Commissioning Editor References 1. Eaton KK . Editorial: when is a peer review journal not a peer review journal? J Nutr Environ Med 1997 ; 7 : 139 - 144 . 2. van der Heyden MA , van de Ven T , Opthof T . Fraud and misconduct in science: the stem cell seduction . Neth Heart J 2009 ; 17 : 25 - 29 .
Pre-university Chemistry Students in a Mimicked Scholarly Peer Review
NASA Astrophysics Data System (ADS)
van Rens, Lisette; Hermarij, Philip; Pilot, Albert; Beishuizen, Jos; Hofman, Herman; Wal, Marjolein
2014-10-01
Peer review is a significant component in scientific research. Introducing peer review into inquiry processes may be regarded as an aim to develop student understanding regarding quality in inquiries. This study examines student understanding in inquiry peer reviews among pre-university chemistry students, aged 16-17, when they enact a design of a mimicked scholarly peer review. This design is based on a model of a human activity system. Twenty-five different schools in Brazil, Germany, Poland and The Netherlands participated. The students (n = 880) conducted in small groups (n = 428) open inquiries on fermentation. All groups prepared an inquiry report for peer review. These reports were published on a website. Groups were randomly paired in an internet symposium, where they posted review comments to their peers. These responses were qualitatively analyzed on small groups' level of understanding regarding seven categories: inquiry question, hypothesis, management of control variables, accurate measurement, presenting results, reliability of results, discussion and conclusion. The mimicked scholarly review prompted a collective practice. Student understanding was significantly well on presenting results, discussion and conclusion, and significantly less on inquiry question and reliability of results. An enacted design, based on a model of a human activity system, created student understanding of quality in inquiries as well as an insight in a peer-reviewing practice. To what extent this model can be applied in a broader context of design research in science education needs further study.
Shepherd, Jonathan; Frampton, Geoff K; Pickett, Karen; Wyatt, Jeremy C
2018-01-01
To investigate methods and processes for timely, efficient and good quality peer review of research funding proposals in health. A two-stage evidence synthesis: (1) a systematic map to describe the key characteristics of the evidence base, followed by (2) a systematic review of the studies stakeholders prioritised as relevant from the map on the effectiveness and efficiency of peer review 'innovations'. Standard processes included literature searching, duplicate inclusion criteria screening, study keyword coding, data extraction, critical appraisal and study synthesis. A total of 83 studies from 15 countries were included in the systematic map. The evidence base is diverse, investigating many aspects of the systems for, and processes of, peer review. The systematic review included eight studies from Australia, Canada, and the USA, evaluating a broad range of peer review innovations. These studies showed that simplifying the process by shortening proposal forms, using smaller reviewer panels, or expediting processes can speed up the review process and reduce costs, but this might come at the expense of peer review quality, a key aspect that has not been assessed. Virtual peer review using videoconferencing or teleconferencing appears promising for reducing costs by avoiding the need for reviewers to travel, but again any consequences for quality have not been adequately assessed. There is increasing international research activity into the peer review of health research funding. The studies reviewed had methodological limitations and variable generalisability to research funders. Given these limitations it is not currently possible to recommend immediate implementation of these innovations. However, many appear promising based on existing evidence, and could be adapted as necessary by funders and evaluated. Where feasible, experimental evaluation, including randomised controlled trials, should be conducted, evaluating impact on effectiveness, efficiency and quality.
The Effectiveness of Peer Review of Teaching When Performed between Early-Career Academics
ERIC Educational Resources Information Center
Woodman, Richard J.; Parappilly, Maria B.
2015-01-01
The success of peer review of teaching (PRT) in shaping teaching practice during an academic's formative years may depend on the peers' teaching experience and the frequency of evaluation. Two Australian early-career University lecturers with no previous experience of peer review performed a single PRT on one another following a one week academic…
Peer Exclusion During the Pubertal Transition: The Role of Social Competence.
Carter, Rona; Halawah, Amira; Trinh, Sarah L
2018-01-01
For some youth, early puberty is accompanied by peer exclusion. Yet early developers may experience less peer exclusion if they have social competence, which would bolster their ability to develop and maintain positive relationships with their peers. Accordingly, the present study tests whether pubertal timing and tempo predicts decrements in children's social competence and whether decrements in social competence account for associations between puberty (timing and tempo) and peer exclusion over time. Longitudinal data were drawn from 1364 families (48% female; 76% White; M = 9.32 years, SD = .48, at Wave 3) who participated in Waves 3-5 (i.e., grades 4-6) of Phase III of the NICHD-SECCYD. The results from latent growth curve models indicated that earlier pubertal timing and more rapid pubertal tempo among girls were associated with high initial levels of peer exclusion. Moreover, mediation analyses revealed that early developers' susceptibility to peer exclusion was associated with their initial level of social competence. In boys, pubertal timing and tempo were not directly associated with peer exclusion; instead, indirect effects of pubertal timing on peer exclusion (intercept, slope) occurred through initial levels of social competence. On average, early developers' who had low levels of social competence also had high initial levels of peer exclusion but experienced decrements in peer exclusion over time. The association between the intercepts for puberty and peer exclusion and the slopes for social competence and peer exclusion were stronger for boys than girls. Overall, our findings suggest that early developers' susceptibility to and experiences of peer exclusion are associated with their development of social competence.
Pöschl, Ulrich
2012-01-01
The traditional forms of scientific publishing and peer review do not live up to all demands of efficient communication and quality assurance in today’s highly diverse and rapidly evolving world of science. They need to be advanced and complemented by interactive and transparent forms of review, publication, and discussion that are open to the scientific community and to the public. The advantages of open access, public peer review, and interactive discussion can be efficiently and flexibly combined with the strengths of traditional scientific peer review. Since 2001 the benefits and viability of this approach are clearly demonstrated by the highly successful interactive open access journal Atmospheric Chemistry and Physics (ACP, www.atmos-chem-phys.net) and a growing number of sister journals launched and operated by the European Geosciences Union (EGU, www.egu.eu) and the open access publisher Copernicus (www.copernicus.org). The interactive open access journals are practicing an integrative multi-stage process of publication and peer review combined with interactive public discussion, which effectively resolves the dilemma between rapid scientific exchange and thorough quality assurance. Key features and achievements of this approach are: top quality and impact, efficient self-regulation and low rejection rates, high attractivity and rapid growth, low costs, and financial sustainability. In fact, ACP and the EGU interactive open access sister journals are by most if not all standards more successful than comparable scientific journals with traditional or alternative forms of peer review (editorial statistics, publication statistics, citation statistics, economic costs, and sustainability). The high efficiency and predictive validity of multi-stage open peer review have been confirmed in a series of dedicated studies by evaluation experts from the social sciences, and the same or similar concepts have recently also been adopted in other disciplines, including the life sciences and economics. Multi-stage open peer review can be flexibly adjusted to the needs and peculiarities of different scientific communities. Due to the flexibility and compatibility with traditional structures of scientific publishing and peer review, the multi-stage open peer review concept enables efficient evolution in scientific communication and quality assurance. It has the potential for swift replacement of hidden peer review as the standard of scientific quality assurance, and it provides a basis for open evaluation in science. PMID:22783183
Content and communication: How can peer review provide helpful feedback about the writing?
Shashok, Karen
2008-01-01
Background Peer review is assumed to improve the quality of research reports as tools for scientific communication, yet strong evidence that this outcome is obtained consistently has been elusive. Failure to distinguish between aspects of discipline-specific content and aspects of the writing or use of language may account for some deficiencies in current peer review processes. Discussion The process and outcomes of peer review may be analyzed along two dimensions: 1) identifying scientific or technical content that is useful to other researchers (i.e., its "screening" function), and 2) improving research articles as tools for communication (i.e., its "improving" function). However, editors and reviewers do not always distinguish clearly between content criteria and writing criteria. When peer reviewers confuse content and writing, their feedback can be misunderstood by authors, who may modify texts in ways that do not make the readers' job easier. When researchers in peer review confuse the two dimensions, this can lead to content validity problems that foil attempts to define informative variables and outcome measures, and thus prevent clear trends from emerging. Research on writing, revising and editing suggests some reasons why peer review is not always as effective as it might be in improving what is written. Summary Peer review could be improved if stakeholders were more aware of variations in gatekeepers' (reviewers' and editors') ability to provide feedback about the content or the writing. Gatekeepers, academic literacy researchers, and wordface professionals (author's editors, medical writers and translators) could work together to discover the types of feedback authors find most useful. I offer suggestions to help editologists design better studies of peer review which could make the process an even stronger tool for manuscript improvement than it is now. PMID:18237378
Content and communication: how can peer review provide helpful feedback about the writing?
Shashok, Karen
2008-01-31
Peer review is assumed to improve the quality of research reports as tools for scientific communication, yet strong evidence that this outcome is obtained consistently has been elusive. Failure to distinguish between aspects of discipline-specific content and aspects of the writing or use of language may account for some deficiencies in current peer review processes. The process and outcomes of peer review may be analyzed along two dimensions: 1) identifying scientific or technical content that is useful to other researchers (i.e., its "screening" function), and 2) improving research articles as tools for communication (i.e., its "improving" function). However, editors and reviewers do not always distinguish clearly between content criteria and writing criteria. When peer reviewers confuse content and writing, their feedback can be misunderstood by authors, who may modify texts in ways that do not make the readers' job easier. When researchers in peer review confuse the two dimensions, this can lead to content validity problems that foil attempts to define informative variables and outcome measures, and thus prevent clear trends from emerging. Research on writing, revising and editing suggests some reasons why peer review is not always as effective as it might be in improving what is written. Peer review could be improved if stakeholders were more aware of variations in gatekeepers' (reviewers' and editors') ability to provide feedback about the content or the writing. Gatekeepers, academic literacy researchers, and wordface professionals (author's editors, medical writers and translators) could work together to discover the types of feedback authors find most useful. I offer suggestions to help editologists design better studies of peer review which could make the process an even stronger tool for manuscript improvement than it is now.
Applications of the Schur Basis to Quantum Algorithms
2011-01-10
superpolynomial speedups based on quantum circuits. (a) Papers published in peer -reviewed journals (N/A for none) 1. D.A.Bacon, I.L. Chuang, A.W...reporting period. List the papers, including journal references, in the following categories: (b) Papers published in non- peer -reviewed journals or in...MIT, Department of EECS, 2008 7.00Number of Papers published in peer -reviewed journals: Number of Papers published in non peer -reviewed journals: (c
Reiner, Bruce I
2017-10-01
Conventional peer review practice is compromised by a number of well-documented biases, which in turn limit standard of care analysis, which is fundamental to determination of medical malpractice. In addition to these intrinsic biases, other existing deficiencies exist in current peer review including the lack of standardization, objectivity, retrospective practice, and automation. An alternative model to address these deficiencies would be one which is completely blinded to the peer reviewer, requires independent reporting from both parties, utilizes automated data mining techniques for neutral and objective report analysis, and provides data reconciliation for resolution of finding-specific report differences. If properly implemented, this peer review model could result in creation of a standardized referenceable peer review database which could further assist in customizable education, technology refinement, and implementation of real-time context and user-specific decision support.
The mechanisms underpinning peer support: a literature review.
Watson, Emma
2017-12-20
The employment of Peer Support Workers, who themselves have experience of significant emotional distress, can promote recovery at an individual and organisational level. While research examining the benefits of peer support within mental health services continues to grow, an understanding of how, and through what processes, these benefits are reached remains under-developed. To review the published research literature relating to the process of peer support and its underpinning mechanisms to better understand how and why it works. A scoping review of published literature identified studies relating to peer support mechanisms, processes and relationships. Studies were summarised and findings analysed. Five mechanisms were found to underpin peer support relationships (lived experience, love labour, the liminal position of the peer worker, strengths-focussed social and practical support, and the helper role). The identified mechanisms can underpin both the success and difficulties associated with peer support relationships. Further research should review a broader range of literature and clarify how these mechanisms contribute to peer support in different contexts.
A scoping review of Indigenous suicide prevention in circumpolar regions
Redvers, Jennifer; Bjerregaard, Peter; Eriksen, Heidi; Fanian, Sahar; Healey, Gwen; Hiratsuka, Vanessa; Jong, Michael; Larsen, Christina Viskum Lytken; Linton, Janice; Pollock, Nathaniel; Silviken, Anne; Stoor, Petter; Chatwood, Susan
2015-01-01
Background Suicide is a serious public health challenge in circumpolar regions, especially among Indigenous youth. Indigenous communities, government agencies and health care providers are making concerted efforts to reduce the burden of suicide and strengthen protective factors for individuals, families and communities. The persistence of suicide has made it clear that more needs to be done. Objective Our aim was to undertake a scoping review of the peer-reviewed literature on suicide prevention and interventions in Indigenous communities across the circumpolar north. Our objective was to determine the extent and types of interventions that have been reported during past decade. We want to use this knowledge to support community initiative and inform intervention development and evaluation. Design We conducted a scoping review of online databases to identify studies published between 2004 and 2014. We included articles that described interventions in differentiated circumpolar Indigenous populations and provided evaluation data. We retained grey literature publications for comparative reference. Results Our search identified 95 articles that focused on suicide in distinct circumpolar Indigenous populations; 19 articles discussed specific suicide-related interventions and 7 of these described program evaluation methods and results in detail. The majority of publications on specific interventions were found in North American countries. The majority of prevention or intervention documentation was found in supporting grey literature sources. Conclusion Despite widespread concern about suicide in the circumpolar world and active community efforts to promote resilience and mental well-being, we found few recorded programs or initiatives documented in the peer-reviewed literature, and even fewer focusing specifically on youth intervention. The interventions described in the studies we found had diverse program designs and content, and used varied evaluation methods and outcomes. The studies we included consistently reported that it was important to use community-based and culturally guided interventions and evaluations. This article summarizes the current climate of Indigenous circumpolar suicide research in the context of intervention and highlights how intervention-based outcomes have largely remained outside of peer-reviewed sources in this region of the world. PMID:25742882
Effectiveness of Guided Peer Review of Student Essays in a Large Undergraduate Biology Course
ERIC Educational Resources Information Center
Kelly, Lauren
2015-01-01
Instructors and researchers often consider peer review an integral part of the writing process, providing myriad benefits for both writers and reviewers. Few empirical studies, however, directly address the relationship between specific methodological changes and peer review effectiveness, especially outside the composition classroom. To…
42 CFR 52h.6 - Availability of information.
Code of Federal Regulations, 2010 CFR
2010-10-01
... a peer review group will be available for public inspection and copying to the extent provided by... regulations (45 CFR parts 5, 5b). (b) Meetings of peer review groups reviewing grant applications or contract... by peer review groups that contain trade secrets or commercial or financial information obtained from...
Methodologies of Peer and Editorial Review: Changing Practices
ERIC Educational Resources Information Center
Selfe, Cynthia; Hawisher, Gail
2012-01-01
The authors--drawing on their varied experiences as authors and publishers of a journal and several book series--provide a historical review and consideration of peer review in publishing. They find that scholarly peer review, from the question of signed reviews to the practices of digital publications, is in the midst of change, but that at the…
42 CFR 52h.7 - What matters must be reviewed for grants?
Code of Federal Regulations, 2010 CFR
2010-10-01
... SCIENTIFIC PEER REVIEW OF RESEARCH GRANT APPLICATIONS AND RESEARCH AND DEVELOPMENT CONTRACT PROJECTS § 52h.7... reviewed by a peer review group in accordance with the provisions of this part and the group has made... appropriate peer review group, in accordance with the provisions of this part, and the group has made...
Comparing Peer Review and Self-Review as Ways to Improve College Students' Writing
ERIC Educational Resources Information Center
Covill, Amy E.
2010-01-01
The effect of three approaches to revision instruction on 61 college students' revision behavior and writing quality was investigated for this article. Students wrote three 5-page papers and received one of three instructional approaches: Formal Peer Review (n = 19), Formal Self-Review (n = 20), or No Formal Review (n = 22). Formal Peer Review…
Biomass Program 2007 Program Peer Review - Full Report
DOE Office of Scientific and Technical Information (OSTI.GOV)
none,
This document summarizes the comments provided by the peer reviewers at the U.S. Department of Energy (DOE) Biomass Program’s Peer Review meeting, held on November 14-15, 2007 in Baltimore, MD and Platform Reviews conducted over the summer of 2007. The Platform Reviews provide evaluations of the Program’s projects in applied research, development, and demonstration.
DOE Office of Scientific and Technical Information (OSTI.GOV)
Jagsi, Reshma, E-mail: rjagsi@med.umich.edu; Bennett, Katherine Egan; Griffith, Kent A.
Purpose: Peer reviewers' knowledge of author identity may influence review content, quality, and recommendations. Therefore, the International Journal of Radiation Oncology, Biology, Physics (“Red Journal”) implemented double-blinded peer review in 2011. Given the relatively small size of the specialty and the high frequency of preliminary abstract presentations, we sought to evaluate attitudes, the efficacy of blinding, and the potential impact on the disposition of submissions. Methods and Materials: In May through August 2012, all Red Journal reviewers and 1 author per manuscript completed questionnaires regarding demographics, attitudes, and perceptions of success of blinding. We also evaluated correlates of the outcomesmore » of peer review. Results: Questionnaires were received from 408 authors and 519 reviewers (100%). The majority of respondents favored double blinding; 6% of authors and 13% of reviewers disagreed that double blinding should continue in the Red Journal. In all, 50% of the reviewers did not suspect the identity of the author of the paper that they reviewed; 19% of reviewers believed that they could identify the author(s), and 31% suspected that they could. Similarly, 23% believed that they knew the institution(s) from which the paper originated, and 34% suspected that they did. Among those who at least suspected author identity, 42% indicated that prior presentations served as a clue, and 57% indicated that literature referenced did so. Of those who at least suspected origin and provided details (n=133), 13% were entirely incorrect. Rejection was more common in 2012 than 2011, and submissions from last authors with higher H-indices (>21) were more likely to survive initial review, without evidence of interactions between submission year and author gender or H-index. Conclusions: In a relatively small specialty in which preliminary research presentations are common and occur in a limited number of venues, reviewers are often familiar with research findings and suspect author identity even when manuscript review is blinded. Nevertheless, blinding appears to be effective in many cases, and support for continuing blinding was strong.« less
Regan, Pamela; Cachelin, Fary M; Minnick, Alyssa M
2017-03-01
The objective of this study is to provide a comprehensive review of empirical research exploring barriers to and facilitators of initial treatment seeking ("first contact") from professional health care providers by adults and young adults with eating disorders (EDs). A search of databases PsycINFO and MEDLINE using the terms "treatment" and "eating disorder*" yielded 9,468 peer-reviewed articles published from January 1945 to June 2016. Screening identified 31 articles meeting the following criteria: (1) participants were 16 or older and presented with a self-reported or clinically diagnosed ED; (2) studies focused on (a) initial treatment seeking (b) for an ED (c) from professional health care providers; (3) articles were empirical, and (4) peer reviewed. Quantitative studies revealed few consistent correlates of treatment seeking, perhaps because most variables were examined in only one or two investigations. Variables with some degree of predictive utility (i.e., produced significant results in multiple studies) were age (older), ethnicity (nonethnic minority), ED type (anorexia, purging BN), specific ED-related behaviors (i.e., purging), and time spent on a treatment waitlist following referral (less). Although BMI was one of the most investigated variables, it did not predict treatment seeking. Qualitative studies revealed the following perceived barriers: (1) personal feelings of shame/fear, (2) ED-related beliefs/perceptions, (3) lack of access/availability, and (4) aspects of the treatment process. Perceived facilitators included (1) health-related concerns, (2) emotional distress, and (3) social support. Implications for clinical practice and areas for further research are discussed. Results highlight the need for shared definitions and methodologies across studies of treatment seeking. © 2017 Wiley Periodicals, Inc.
2013-01-01
Background Peer review is the major method used by biomedical journals for making the decision of publishing an article. This cross-sectional survey assesses views concerning the review system of biomedical journals among academics globally. Methods A total of 28,009 biomedical academics from high-ranking universities listed by the 2009 Times Higher Education Quacquarelli Symonds (THE-QS) World University Rankings were contacted by email between March 2010 and August 2010. 1,340 completed an online survey which focused on their academic background, negative experiences and views on biomedical journal peer review and the results were compared among basic scientists, clinicians and clinician scientists. Results Fewer than half of the respondents agreed that the peer review systems of biomedical journals were fair (48.4%), scientific (47.5%), or transparent (25.1%). Nevertheless, 58.2% of the respondents agreed that authors should remain anonymous and 64.4% agreed that reviewers should not be disclosed. Most, (67.7%) agreed to the establishment of an appeal system. The proportion of native English-speaking respondents who agreed that the “peer review system is fair” was significantly higher than for non-native respondents (p = 0.02). Similarly, the proportion of clinicians stating that the “peer review system is fair” was significantly higher than that for basic scientists and clinician-scientists (p = 0.004). For females, (β = −0.1, p = 0.03), the frequency of encountering personal attacks in reviewers’ comments (β = −0.1, p = 0.002) and the frequency of imposition of unnecessary references by reviewers (β = −0.06, p = 0.04) were independently and inversely associated with agreement that “the peer review system is fair”. Conclusion Academics are divided on the issue of whether the biomedical journal peer review system is fair, scientific and transparent. A majority of academics agreed with the double-blind peer review and to the establishment of an appeal system. Female academics, experience of personal attacks and imposition of unnecessary references by reviewers were related to disagreement about fairness of the peer review system of biomedical journals. PMID:23758823
Four peer reviews in support of the Tier 3 rulemaking ...
Peer review of ERG's KenCaryl (CO) estimated summer hot-soak distributions report in support of the Tier 3 rulemaking To peer review ERG's KenCaryl (CO) estimated summer hot-soak distributions report (for Tier 3 rulemaking)
MacArthur, Christine; Jolly, Kate; Ingram, Lucy; Freemantle, Nick; Dennis, Cindy-Lee; Hamburger, Ros; Brown, Julia; Chambers, Jackie; Khan, Khalid
2009-01-30
To assess the effectiveness of an antenatal service using community based breastfeeding peer support workers on initiation of breast feeding. Cluster randomised controlled trial. Community antenatal clinics in one primary care trust in a multiethnic, deprived population. 66 antenatal clinics with 2511 pregnant women: 33 clinics including 1140 women were randomised to receive the peer support worker service and 33 clinics including 1371 women were randomised to receive standard care. An antenatal peer support worker service planned to comprise a minimum of two contacts with women to provide advice, information, and support from approximately 24 weeks' gestation within the antenatal clinic or at home. The trained peer support workers were of similar ethnic and sociodemographic backgrounds to their clinic population. Initiation of breast feeding obtained from computerised maternity records of the hospitals where women from the primary care trust delivered. The sample was multiethnic, with only 9.4% of women being white British, and 70% were in the lowest 10th for deprivation. Most of the contacts with peer support workers took place in the antenatal clinics. Data on initiation of breast feeding were obtained for 2398 of 2511 (95.5%) women (1083/1140 intervention and 1315/1371 controls). The groups did not differ for initiation of breast feeding: 69.0% (747/1083) in the intervention group and 68.1% (896/1315) in the control groups; cluster adjusted odds ratio 1.11 (95% confidence interval 0.87 to 1.43). Ethnicity, parity, and mode of delivery independently predicted initiation of breast feeding, but randomisation to the peer support worker service did not. A universal service for initiation of breast feeding using peer support workers provided within antenatal clinics serving a multiethnic, deprived population was ineffective in increasing initiation rates. Current Controlled Trials ISRCTN16126175.
Clinical perspective: creating an effective practice peer review process-a primer.
Gandhi, Manisha; Louis, Frances S; Wilson, Shae H; Clark, Steven L
2017-03-01
Peer review serves as an important adjunct to other hospital quality and safety programs. Despite its importance, the available literature contains virtually no guidance regarding the structure and function of effective peer review committees. This Clinical Perspective provides a summary of the purposes, structure, and functioning of effective peer review committees. We also discuss important legal considerations that are a necessary component of such processes. This discussion includes useful templates for case selection and review. Proper committee structure, membership, work flow, and leadership as well as close cooperation with the hospital medical executive committee and legal representatives are essential to any effective peer review process. A thoughtful, fair, systematic, and organized approach to creating a peer review process will lead to confidence in the committee by providers, hospital leadership, and patients. If properly constructed, such committees may also assist in monitoring and enforcing compliance with departmental protocols, thus reducing harm and promoting high-quality practice. Copyright © 2016 Elsevier Inc. All rights reserved.
Patient disclosure of medical errors in paediatrics: A systematic literature review
Koller, Donna; Rummens, Anneke; Le Pouesard, Morgane; Espin, Sherry; Friedman, Jeremy; Coffey, Maitreya; Kenneally, Noah
2016-01-01
Medical errors are common within paediatrics; however, little research has examined the process of disclosing medical errors in paediatric settings. The present systematic review of current research and policy initiatives examined evidence regarding the disclosure of medical errors involving paediatric patients. Peer-reviewed research from a range of scientific journals from the past 10 years is presented, and an overview of Canadian and international policies regarding disclosure in paediatric settings are provided. The purpose of the present review was to scope the existing literature and policy, and to synthesize findings into an integrated and accessible report. Future research priorities and policy implications are then identified. PMID:27429578
Open Peer Review by a Selected-Papers Network
Lee, Christopher
2011-01-01
A selected-papers (SP) network is a network in which researchers who read, write, and review articles subscribe to each other based on common interests. Instead of reviewing a manuscript in secret for the Editor of a journal, each reviewer simply publishes his review (typically of a paper he wishes to recommend) to his SP network subscribers. Once the SP network reviewers complete their review decisions, the authors can invite any journal editor they want to consider these reviews and initial audience size, and make a publication decision. Since all impact assessment, reviews, and revisions are complete, this decision process should be short. I show how the SP network can provide a new way of measuring impact, catalyze the emergence of new subfields, and accelerate discovery in existing fields, by providing each reader a fine-grained filter for high-impact. I present a three phase plan for building a basic SP network, and making it an effective peer review platform that can be used by journals, conferences, users of repositories such as arXiv, and users of search engines such as PubMed. I show how the SP network can greatly improve review and dissemination of research articles in areas that are not well-supported by existing journals. Finally, I illustrate how the SP network concept can work well with existing publication services such as journals, conferences, arXiv, PubMed, and online citation management sites. PMID:22291635
Why Are Chemists and Other Scientists Afraid of the Peer Review of Teaching?
NASA Astrophysics Data System (ADS)
Atwood, Charles H.; Taylor, James W.; Hutchings, Pat A.
2000-02-01
This paper presents a series of arguments that teaching should be subjected to the similar review standards that chemical research employs. Through peer review, the hope is to elevate the status of teaching in academe. The paper also describes a national effort through the American Association for Higher Education and the Carnegie Foundation for the Advancement of Teaching to establish a peer-review process appropriate for teaching. Finally, an examination of some of the perceived barriers to peer review, including fear, is detailed.
Liu, Jiaying; Zhao, Siman; Chen, Xi; Falk, Emily; Albarracín, Dolores
2017-10-01
Although the influence of peers on adolescent smoking should vary depending on social dynamics, there is a lack of understanding of which elements are most crucial and how this dynamic unfolds for smoking initiation and continuation across areas of the world. The present meta-analysis included 75 studies yielding 237 effect sizes that examined associations between peers' smoking and adolescents' smoking initiation and continuation with longitudinal designs across 16 countries. Mixed-effects models with robust variance estimates were used to calculate weighted-mean Odds ratios. This work showed that having peers who smoke is associated with about twice the odds of adolescents beginning (OR ¯ = 1.96, 95% confidence interval [CI] [1.76, 2.19]) and continuing to smoke (OR ¯ = 1.78, 95% CI [1.55, 2.05]). Moderator analyses revealed that (a) smoking initiation was more positively correlated with peers' smoking when the interpersonal closeness between adolescents and their peers was higher (vs. lower); and (b) both smoking initiation and continuation were more positively correlated with peers' smoking when samples were from collectivistic (vs. individualistic) cultures. Thus, both individual as well as population level dynamics play a critical role in the strength of peer influence. Accounting for cultural variables may be especially important given effects on both initiation and continuation. Implications for theory, research, and antismoking intervention strategies are discussed. (PsycINFO Database Record (c) 2017 APA, all rights reserved).
Helping agencies improve their planning analysis techniques.
DOT National Transportation Integrated Search
2011-11-18
This report summarizes the results of a peer review of the AZTDM. The peer review was : supported by the Travel Model Improvement Program (TMIP), which is sponsored by FHWA. : The peer review of a travel model can serve multiple purposes, including i...
The U.S. EPA finalized comments gathered from a public peer review of the scientific basis supporting the human health hazard and dose-response assessment of dibutyl phthalate (DBP) that will appear on the Integrated Risk Information System (IRIS) database. The peer review has en...
Giving Feedback: Preparing Students for Peer Review and Self-Evaluation
ERIC Educational Resources Information Center
Philippakos, Zoi A.
2017-01-01
Revision is an important aspect of the writing process but is often challenging for students. Peer review can be helpful, but training is needed for it to work effectively. This article suggests an approach to preparing students for peer review by teaching specific evaluation criteria and leading collaborative practice in reviewing papers written…
Writing Quality Peer Reviews of Research Manuscripts
ERIC Educational Resources Information Center
Ward, Phillip; Graber, Kim C.; van der Mars, Hans
2015-01-01
Peer review is an important mechanism for advancing knowledge in a manner deemed as acceptable by the research community. It can also serve the function of providing guidance to an author(s) to improve the likelihood that manuscripts will be accepted in peer reviewed journals. There is, however, little assistance for new or existing reviewers of…
IRIS Toxicological Review and Summary Documents for 1,4-Dichlorobenzene (External Peer Review)
The U.S. EPA has conducted a peer review of the scientific basis supporting the human health hazard and dose-response assessment of 1,4-dichlorobenzene that will appear on the Integrated Risk Information System (IRIS) database. Peer review is meant to ensure that science is used ...
Biomass Program 2007 Program Peer Review - Feedstock Platform Summary
DOE Office of Scientific and Technical Information (OSTI.GOV)
none,
This document discloses the comments provided by a review panel at the U.S. Department of Energy Office of the Biomass Program Peer Review held on November 15-16, 2007 in Baltimore, MD and the Feedstock Platform Portfolio Peer Review held on August 21st through 23rd in Washington D.C.
ERIC Educational Resources Information Center
Khurana, Gauri; Henderson, Schuyler; Walter, Garry; Martin, Andres
2012-01-01
Objective: The authors reviewed and characterized conflict of interest (COI) and disclosure policies published in peer-reviewed psychiatric and nonpsychiatric journals. Methods: The authors examined peer-reviewed publications in the psychiatric (N=20) and nonpsychiatric (N=20) literature. Using qualitative and quantitative approaches, they…
The Problem of Humiliation in Peer Review
ERIC Educational Resources Information Center
Comer, Debra R.; Schwartz, Michael
2014-01-01
This paper examines the problem of vituperative feedback from peer reviewers. We argue that such feedback is morally unacceptable, insofar as it humiliates authors and damages their dignity. We draw from social-psychological research to explore those aspects of the peer-review process in general and the anonymity of blind reviewing in particular…
Online Peer Review: Encouraging Student Response and Development
ERIC Educational Resources Information Center
Lansiquot, Reneta; Rosalia, Christine
2015-01-01
This study explored the use of a tailored online peer review program for first-year undergraduate students at an urban college of technology. The program facilitated group peer review in meaningful and technologically elegant ways. Students in a composition class were divided into two groups. One group acted as first reviewers, and the other group…
ERIC Educational Resources Information Center
Copeman, Peter; Keightley, Polly
2014-01-01
In 2013 the University of Canberra (UC) initiated a program of peer-assisted academic skills help, the Academic Skills Rovers program, with the goal of providing drop-in peer learning support to students at campus locations where they congregate to study. The Academic Skills Rovers were initially recruited from the teacher education discipline,…
Thank you to our 2016 peer reviewers
NASA Astrophysics Data System (ADS)
Hauck, Steven A.; Baratoux, David; Stanley, Sabine
2017-02-01
Peer review is one of most fundamental aspects of the modern practice of science. As scientists we hold our own work up to scrutiny by experts among our peers in order to encourage the best practices in scientific conduct and communication. Thorough consideration and review by professional colleagues of scientific papers are critical aspects of ensuring that the manuscripts published by JGR-Planets are accurate, valuable, and clearly communicated. Peer review is an essential element of the process of refining understanding and sharing science, and the effort and expertise shared by each reviewer are crucial to the advancement of planetary science. In 2016, JGR Planets benefited from more than 451 reviews provided by 337 of our peers for papers submitted to the journal. Thank you all for your dedication to advancing planetary science.
How Sensor, Signal, and Imaging Informatics May Impact Patient Centered Care and Care Coordination
Moreau-Gaudry, A.
2015-01-01
Summary Objective This synopsis presents a selection for the IMIA (International Medical Informatics Association) Yearbook 2015 of excellent research in the broad field of Sensor, Signal, and Imaging Informatics published in the year 2014, with a focus on patient centered care coordination. Methods The two section editors performed a systematic initial selection and a double blind peer review process to select a list of candidate best papers in the domain published in 2014, from the PubMed and Web of Science databases. A set of MeSH keywords provided by experts was used. This selection was peer-reviewed by external reviewers. Results The review process highlighted articles illustrating two current trends related to care coordination and patient centered care: the enhanced capacity to predict the evolution of a disease based on patient-specific information can impact care coordination; similarly, better perception of the patient and his treatment could lead to enhanced personalized care with a potential impact on care coordination. Conclusions This review shows the multiplicity of angles from which the question of patient-centered care can be addressed, with consequences on care coordination that will need to be confirmed and demonstrated in the future. PMID:26293856
ERIC Educational Resources Information Center
Ainsworth, Larry; Christinson, Jan
The assessment model described in this guide was initially developed by a team of fifth-grade teachers who wrote objectives of integrating social studies and language arts. It helps the teacher guide students to create a task-specific rubric that they use to evaluate their own and peers' work. Teachers review the student evaluations, determine the…
Glonti, Ketevan; Cauchi, Daniel; Cobo, Erik; Boutron, Isabelle; Moher, David; Hren, Darko
2017-10-22
The primary functions of peer reviewers are poorly defined. Thus far no body of literature has systematically identified the roles and tasks of peer reviewers of biomedical journals. A clear establishment of these can lead to improvements in the peer review process. The purpose of this scoping review is to determine what is known on the roles and tasks of peer reviewers. We will use the methodological framework first proposed by Arksey and O'Malley and subsequently adapted by Levac et al and the Joanna Briggs Institute. The scoping review will include all study designs, as well as editorials, commentaries and grey literature. The following eight electronic databases will be searched (from inception to May 2017): Cochrane Library, Cumulative Index to Nursing and Allied Health Literature, Educational Resources Information Center, EMBASE, MEDLINE, PsycINFO, Scopus and Web of Science. Two reviewers will use inclusion and exclusion criteria based on the 'Population-Concept-Context' framework to independently screen titles and abstracts of articles considered for inclusion. Full-text screening of relevant eligible articles will also be carried out by two reviewers. The search strategy for grey literature will include searching in websites of existing networks, biomedical journal publishers and organisations that offer resources for peer reviewers. In addition we will review journal guidelines to peer reviewers on how to perform the manuscript review. Journals will be selected using the 2016 journal impact factor. We will identify and assess the top five, middle five and lowest-ranking five journals across all medical specialties. This scoping review will undertake a secondary analysis of data already collected and does not require ethical approval. The results will be disseminated through journals and conferences targeting stakeholders involved in peer review in biomedical research. © Article author(s) (or their employer(s) unless otherwise stated in the text of the article) 2017. All rights reserved. No commercial use is permitted unless otherwise expressly granted.
Bridging the Otolaryngology Peer Review Knowledge Gap: A Call for a Residency Development Program.
Schmalbach, Cecelia E
2016-07-01
Current otolaryngology literature and future scientific direction rely heavily on a rigorous peer review process. Just as manuscripts warrant thoughtful review with constructive feedback to the authors, the same can be said for critiques written by novice peer reviewers. Formal scientific peer review training programs are lacking. Recognizing this knowledge gap, Otolaryngology-Head and Neck Surgery is excited to offer its new Resident Reviewer Development Program. All otolaryngology residents who are postgraduate year 2 and above and in excellent academic standing are eligible to participate in this mentored program, during which they will conduct 6 manuscript reviews under the direction of a seasoned reviewer in his or her subspecialty area of interest. By completing reviews alongside a mentor, participants gain the required skills to master the peer review process-a first step that often leads to journal editorial board and associate editor invitations. © American Academy of Otolaryngology—Head and Neck Surgery Foundation 2016.
The AIRInforma experiment: peer-reviewed public dissemination of science in Italy
NASA Astrophysics Data System (ADS)
Forneris, Federico; Cassetta, Luca; Gravina, Teresita
2015-04-01
Public dissemination of science to the public is often negatively affected by biased, incorrect information distributed over the world wide web through social networks and weblogs. In Italy, the lack of correct scientific information has generated several important issues, raising concerns by the international scientific community in several occasions over the past five years. Our association AIRIcerca (International Association of Italian Researchers, http://www.airicerca.org) has recently started a novel scientific dissemination initiative to the general public in Italy. The project is based on 1) direct involvement of researchers (with accademic or industrial affiliation) in article preparation and publication and 2) introduction of a peer-reviewing system similar to that applied in conventional scientific publishing. Our initiative, named AIRInforma (http://informa.airicerca.org) has already published more than 10 original articles and 3 meeting reports, in Italian language, about various fields of scientific research, ranging from social sciences to evolutionary biology , mathematics and medicine . The editorial board is composed of approximately 20 Italian scientists working all over the world and voluntarily contributing to the AIRInforma initiative. Submitted manuscripts are initially evaluated by the editorial board and, if suitable, they are assigned to four non-anonymous reviewers selected by the editorial board for accurate evaluation. Two reviewers are selected based on their specific expertise on the topic presented in the manuscript (expert reviewers), and two are specifically selected as working on distant fields (naive reviewers). The purpose of naive reviewers is to provide feedback on the efficacy and clarity of the information for the general public. So far, AIRInforma has established a novel channel of scientific communication in Italy, receiving excellent feedback and reaching more than 8000 new unique visitors every month on our website and social network communication pages. Recently established collaborations with other scientific blogs will facilitate the expansion of our public and of our pool of authors, which is constantly growing. Following the initial enthusiasm and success of our initiative, we are considering to convert AIRInforma into an effective scientific publication by obtaining digital object identifiers for our articles in order to increase their impact and facilitate their dissemination. We are strongly convinced that a correct scientific information to the public will be more and more relevant in the future, and we are confident that AIRInforma will contribute solid milestones of correctness and scientific accuracy to the complex landscape of scientific communication in Italy.
Early stages of development of a peer specialist fidelity measure
Chinman, Matthew; McCarthy, Sharon; Mitchell-Miland, Chantele; Daniels, Karin; Youk, Ada; Edelen, Maria
2017-01-01
OBJECTIVE Research on peer specialists (individuals with serious mental illness supporting others with serious mental illness in clinical and other settings), has not yet included the measurement of fidelity. Without measuring fidelity, it’s unclear if the absence of impact in some studies is attributable to ineffective peer specialist services or because the services were not true to the intended role. This paper describes the initial development of a peer specialist fidelity measure for two content areas: services provided by peer specialists and factors that either support or hamper the performance of those services. METHODS A literature search identified 40 domains; an expert panel narrowed the number of domains and helped generate and then review survey items to operationalize those domains. Twelve peer specialists, individuals with whom they work, and their supervisors participated in a pilot test and cognitive interviews regarding item content. RESULTS Peer specialists tended to rate themselves as having engaged in various peer service activities more than supervisors and individuals with whom they work. A subset of items tapping peer specialist services “core” to the role regardless of setting had higher ratings. Participants stated the measure was clear, appropriate, and could be useful in performance improvement. CONCLUSIONS AND IMPLICATIONS FOR PRACTICE Although preliminary, findings were consistent with organizational research on performance ratings of supervisors and employees made in the workplace. Several changes in survey content and administration were identified. With continued work, the measure could crystalize the role of peer specialists and aid in research and clinical administration. PMID:27618462
U.S. EPA. 2000. Science Policy Council Handbook: Peer Review
The goal of the Peer Review Policy and this Handbook is to enhance the quality and credibility of Agency decisions by ensuring that the scientific and technical work products underlying these decisions receive appropriate levels of peer review by independe
Bagnall, Anne-Marie; South, Jane; Hulme, Claire; Woodall, James; Vinall-Collier, Karen; Raine, Gary; Kinsella, Karina; Dixey, Rachael; Harris, Linda; Wright, Nat M J
2015-03-25
Prisoners experience significantly worse health than the general population. This review examines the effectiveness and cost-effectiveness of peer interventions in prison settings. A mixed methods systematic review of effectiveness and cost-effectiveness studies, including qualitative and quantitative synthesis was conducted. In addition to grey literature identified and searches of websites, nineteen electronic databases were searched from 1985 to 2012. Study selection criteria were: Prisoners resident in adult prisons and children resident in Young Offender Institutions (YOIs). Peer-based interventions. Review questions 3 and 4 compared peer and professionally led approaches. Prisoner health or determinants of health; organisational/process outcomes; views of prison populations. Quantitative, qualitative and mixed method evaluations. Fifty-seven studies were included in the effectiveness review and one study in the cost-effectiveness review; most were of poor methodological quality. Evidence suggested that peer education interventions are effective at reducing risky behaviours, and that peer support services are acceptable within the prison environment and have a positive effect on recipients, practically or emotionally. Consistent evidence from many, predominantly qualitative, studies, suggested that being a peer deliverer was associated with positive effects. There was little evidence on cost-effectiveness of peer-based interventions. There is consistent evidence from a large number of studies that being a peer worker is associated with positive health; peer support services are also an acceptable source of help within the prison environment and can have a positive effect on recipients. Research into cost-effectiveness is sparse. PROSPERO ref: CRD42012002349.
Letting the daylight in: Reviewing the reviewers and other ways to maximize transparency in science
Wicherts, Jelte M.; Kievit, Rogier A.; Bakker, Marjan; Borsboom, Denny
2012-01-01
With the emergence of online publishing, opportunities to maximize transparency of scientific research have grown considerably. However, these possibilities are still only marginally used. We argue for the implementation of (1) peer-reviewed peer review, (2) transparent editorial hierarchies, and (3) online data publication. First, peer-reviewed peer review entails a community-wide review system in which reviews are published online and rated by peers. This ensures accountability of reviewers, thereby increasing academic quality of reviews. Second, reviewers who write many highly regarded reviews may move to higher editorial positions. Third, online publication of data ensures the possibility of independent verification of inferential claims in published papers. This counters statistical errors and overly positive reporting of statistical results. We illustrate the benefits of these strategies by discussing an example in which the classical publication system has gone awry, namely controversial IQ research. We argue that this case would have likely been avoided using more transparent publication practices. We argue that the proposed system leads to better reviews, meritocratic editorial hierarchies, and a higher degree of replicability of statistical analyses. PMID:22536180
NASA Astrophysics Data System (ADS)
Pon-Barry, Heather; Packard, Becky Wai-Ling; St. John, Audrey
2017-01-01
A dilemma within computer science departments is developing sustainable ways to expand capacity within introductory computer science courses while remaining committed to inclusive practices. Training near-peer mentors for peer code review is one solution. This paper describes the preparation of near-peer mentors for their role, with a focus on regular, consistent feedback via peer code review and inclusive pedagogy. Introductory computer science students provided consistently high ratings of the peer mentors' knowledge, approachability, and flexibility, and credited peer mentor meetings for their strengthened self-efficacy and understanding. Peer mentors noted the value of videotaped simulations with reflection, discussions of inclusion, and the cohort's weekly practicum for improving practice. Adaptations of peer mentoring for different types of institutions are discussed. Computer science educators, with hopes of improving the recruitment and retention of underrepresented groups, can benefit from expanding their peer support infrastructure and improving the quality of peer mentor preparation.
Olthof, A W; van Ooijen, P M A
2016-09-01
The purpose of this work is to demonstrate the possibility of implementation of a PACS-integrated peer review system based on RADPEER™ classification providing a step-wise implementation plan utilizing features already present in the standard PACS implementation and without the requirement of additional software development. Furthermore, we show the usage and effects of the system during the first 30 months of usage. To allow fast and easy implementation into the daily workflow the key-word feature of the PACS was used. This feature allows to add a key-word to an imaging examination for easy searching in the PACS database (e.g. by entering keywords for different kinds of pathology). For peer review we implemented a keyword structure including a code for each of the existing RADPEER™ scoring language terms and a keyword with the phrase "second reading" followed by the name of the individual radiologist. The use of the short-keys to enter the codes in relation to the peer review was a simple to use solution. During the study 599 reports were peer reviewed. The active participation in this study of the radiologists varies and ranges from 3 to 327 reviews per radiologist. The number of peer review is highest in CT and CR. There are no significant technical obstacles to implement a PACS-integrated RADPEER™ -system based on key-words allowing easy integration of peer review into the daily routine without the requirement of additional software. Peer review implemented in a non-random setting based on relevant priors could already help in increasing the quality of radiological reporting and serve as continuing education among peers. Decisiveness, tact and trust are needed to promote use of the system and collaborative discussion of the results by radiologist.
What's with all this peer-review stuff anyway?
DOE Office of Scientific and Technical Information (OSTI.GOV)
Warner, J. S.
2010-01-01
The Journal of Physical Security was ostensibly started to deal with a perceived lack of peer-reviewed journals related to the field of physical security. In fact, concerns have been expressed that the field of physical security is scarcely a field at all. A typical, well-developed field might include the following: multiple peer-reviewed journals devoted to the subject, rigor and critical thinking, metrics, fundamental principles, models and theories, effective standards and guidelines, R and D conferences, professional societies, certifications, its own academic department (or at least numerous academic experts), widespread granting of degrees in the field from 4-year research universities, mechanismsmore » for easily spotting 'snake oil' products and services, and the practice of professionals organizing to police themselves, provide quality control, and determine best practices. Physical Security seems to come up short in a number of these areas. Many of these attributes are difficult to quantify. This paper seeks to focus on one area that is quantifiable: the number of peer-reviewed journals dedicated to the field of Physical Security. In addition, I want to examine the number of overall periodicals (peer-reviewed and non-peer-reviewed) dedicated to physical security, as well as the number of papers published each year about physical security. These are potentially useful analyses because one can often infer how healthy or active a given field is by its publishing activity. For example, there are 2,754 periodicals dedicated to the (very healthy and active) field of physics. This paper concentrates on trade journal versus peer-reviewed journals. Trade journals typically focus on practice-related topics. A paper appropriate for a trade journal is usually based more on practical experience than rigorous studies or research. Models, theories, or rigorous experimental research results will usually not be included. A trade journal typically targets a specific market in an industry or trade. Such journals are often considered to be news magazines and may contain industry specific advertisements and/or job ads. A peer-reviewed journal, a.k.a 'referred journal', in contrast, contains peer-reviewed papers. A peer-reviewed paper is one that has been vetted by the peer review process. In this process, the paper is typically sent to independent experts for review and consideration. A peer-reviewed paper might cover experimental results, and/or a rigorous study, analyses, research efforts, theory, models, or one of many other scholarly endeavors.« less
2012-01-01
Background The UK general practitioner (GP) appraisal system is deemed to be an inadequate source of performance evidence to inform a future medical revalidation process. A long-running voluntary model of external peer review in the west of Scotland provides feedback by trained peers on the standard of GP colleagues' core appraisal activities and may 'add value' in strengthening the robustness of the current system in support of revalidation. A significant minority of GPs has participated in the peer feedback model, but a clear majority has yet to engage with it. We aimed to explore the views of non-participants to identify barriers to engagement and attitudes to external peer review as a means to inform the current appraisal system. Methods We conducted semi-structured interviews with a sample of west of Scotland GPs who had yet to participate in the peer review model. A thematic analysis of the interview transcriptions was conducted using a constant comparative approach. Results 13 GPs were interviewed of whom nine were males. Four core themes were identified in relation to the perceived and experienced 'value' placed on the topics discussed and their relevance to routine clinical practice and professional appraisal: 1. Value of the appraisal improvement activity. 2. Value of external peer review. 3. Value of the external peer review model and host organisation and 4. Attitudes to external peer review. Conclusions GPs in this study questioned the 'value' of participation in the external peer review model and the national appraisal system over the standard of internal feedback received from immediate work colleagues. There was a limited understanding of the concept, context and purpose of external peer review and some distrust of the host educational provider. Future engagement with the model by these GPs is likely to be influenced by policy to improve the standard of appraisal and contractual related activities, rather than a self-directed recognition of learning needs. PMID:22443714
Curnock, Esther; Bowie, Paul; Pope, Lindsey; McKay, John
2012-03-23
The UK general practitioner (GP) appraisal system is deemed to be an inadequate source of performance evidence to inform a future medical revalidation process. A long-running voluntary model of external peer review in the west of Scotland provides feedback by trained peers on the standard of GP colleagues' core appraisal activities and may 'add value' in strengthening the robustness of the current system in support of revalidation. A significant minority of GPs has participated in the peer feedback model, but a clear majority has yet to engage with it. We aimed to explore the views of non-participants to identify barriers to engagement and attitudes to external peer review as a means to inform the current appraisal system. We conducted semi-structured interviews with a sample of west of Scotland GPs who had yet to participate in the peer review model. A thematic analysis of the interview transcriptions was conducted using a constant comparative approach. 13 GPs were interviewed of whom nine were males. Four core themes were identified in relation to the perceived and experienced 'value' placed on the topics discussed and their relevance to routine clinical practice and professional appraisal: 1. Value of the appraisal improvement activity. 2. Value of external peer review. 3. Value of the external peer review model and host organisation and 4. Attitudes to external peer review. GPs in this study questioned the 'value' of participation in the external peer review model and the national appraisal system over the standard of internal feedback received from immediate work colleagues. There was a limited understanding of the concept, context and purpose of external peer review and some distrust of the host educational provider. Future engagement with the model by these GPs is likely to be influenced by policy to improve the standard of appraisal and contractual related activities, rather than a self-directed recognition of learning needs.
Online Peer-to-Peer Support for Young People With Mental Health Problems: A Systematic Review.
Ali, Kathina; Farrer, Louise; Gulliver, Amelia; Griffiths, Kathleen M
2015-01-01
Adolescence and early adulthood are critical periods for the development of mental disorders. Online peer-to-peer communication is popular among young people and may improve mental health by providing social support. Previous systematic reviews have targeted Internet support groups for adults with mental health problems, including depression. However, there have been no systematic reviews examining the effectiveness of online peer-to-peer support in improving the mental health of adolescents and young adults. The aim of this review was to systematically identify available evidence for the effectiveness of online peer-to peer support for young people with mental health problems. The PubMed, PsycInfo, and Cochrane databases were searched using keywords and Medical Subject Headings (MeSH) terms. Retrieved abstracts (n=3934) were double screened and coded. Studies were included if they (1) investigated an online peer-to-peer interaction, (2) the interaction discussed topics related to mental health, (3) the age range of the sample was between 12 to 25 years, and (4) the study evaluated the effectiveness of the peer-to-peer interaction. Six studies satisfied the inclusion criteria for the current review. The studies targeted a range of mental health problems including depression and anxiety (n=2), general psychological problems (n=1), eating disorders (n=1), and substance use (tobacco) (n=2). The majority of studies investigated Internet support groups (n=4), and the remaining studies focused on virtual reality chat sessions (n=2). In almost all studies (n=5), the peer support intervention was moderated by health professionals, researchers or consumers. Studies employed a range of study designs including randomized controlled trials (n=3), pre-post studies (n=2) and one randomized trial. Overall, two of the randomized controlled trials were associated with a significant positive outcome in comparison to the control group at post-intervention. In the remaining four studies, peer-to-peer support was not found to be effective. This systematic review identified an overall lack of high-quality studies examining online peer-to-peer support for young people. Given that peer support is frequently used as an adjunct to Internet interventions for a variety of mental health conditions, there is an urgent need to determine the effectiveness of peer support alone as an active intervention.
28 CFR 34.101 - Exceptions to applicability.
Code of Federal Regulations, 2010 CFR
2010-07-01
... Section 34.101 Judicial Administration DEPARTMENT OF JUSTICE OJJDP COMPETITION AND PEER REVIEW PROCEDURES Peer Review § 34.101 Exceptions to applicability. The assistance and procurement contract situations... outside the scope of the section 262(d) peer review requirement as set forth in this subpart. ...
Perry, Gad; Bertoluci, Jaime; Bury, R. Bruce; Hansen, Robert W.; Jehle, Robert; Measey, John; Moon, Brad R.; Muths, Erin L.; Zuffi, Marco A.L.
2011-01-01
Peer review is the best available mechanism for assessing and improving the quality of scientific work. As herpetology broadens its disciplinary and geographic boundaries, high-quality external review is ever more essential. We are writing this editorial jointly because the review process has become increasingly difficult. The resulting delays slow publication times, negatively affect performance reviews, tenure, promotions, and grant proposal success. It harms authors, agencies, and institutions (Ware 2011).
A Descriptive Study of Nursing Peer-Review Programs in US Magnet® Hospitals.
Roberts, Holli; Cronin, Sherill Nones
2017-04-01
The goal of this study was to assess the types of nursing peer review (NPR) programs in US Magnet® organizations. The 2 most predominant models of NPR programs in the literature are performance evaluation and clinical peer review. The literature on clinical peer review is primarily descriptive, outlining structures and anecdotal outcomes. Participants from hospitals holding Magnet recognition were selected using a stratified random-sampling method. A survey developed by the researchers assessed the presence of NPR. If clinical NPR was in place, program design, evaluation measurements, and barriers were explored. Findings suggest wide variability in NPR models. More than one-third of the respondents conduct peer evaluation as the only mechanism of NPR. Most hospitals with a clinical peer-review program reported a case review structure and process measurements not supported by data. The variations noted in this study suggest more research is needed to measure the effectiveness of NPR models and associated outcomes.
Timely deposition of macromolecular structures is necessary for peer review
DOE Office of Scientific and Technical Information (OSTI.GOV)
Joosten, Robbie P.; Soueidan, Hayssam; Wessels, Lodewyk F. A.
2013-12-01
Deposition of crystallographic structures should be concurrent with or prior to manuscript submission for peer review, enabling validation and increasing reliability of the PDB. Most of the macromolecular structures in the Protein Data Bank (PDB), which are used daily by thousands of educators and scientists alike, are determined by X-ray crystallography. It was examined whether the crystallographic models and data were deposited to the PDB at the same time as the publications that describe them were submitted for peer review. This condition is necessary to ensure pre-publication validation and the quality of the PDB public archive. It was found thatmore » a significant proportion of PDB entries were submitted to the PDB after peer review of the corresponding publication started, and many were only submitted after peer review had ended. It is argued that clear description of journal policies and effective policing is important for pre-publication validation, which is key in ensuring the quality of the PDB and of peer-reviewed literature.« less
Peer Review and Surgical Innovation: Robotic Surgery and Its Hurdles.
Vyas, Dinesh; Cronin, Sean
2015-12-01
The peer review processes as outlined in the Health Care Quality Improvement Act (HCQIA) is meant ensure quality standard of care through a self-policing mechanism by the medical community. This process grants immunity for people filing a peer review, which is meant to protect whistleblowers. However, it also creates a loophole that can be used maliciously to hinder competition. This is accentuated when surgeons are integrating new technologies, such as robotic surgery, into their practice. With more than 2000 da Vinci robots in use and more than 300 new units being shipped each year, robotic surgery has become a mainstay in the surgical field. The applications for robots continue to expand as surgeons discover their expanding capability. We need a better peer review process. That ensures the peer review is void of competitive bias. Peer reviewers need to be familiar with the procedure and the technology. The current process could stymie innovation in the name of competition.
... Supplements Peer Review Process Review Committees Application Support Library Clinical Research Next Steps Pre-Funding: After Review Terms of ... Supplements Peer Review Process Review Committees Application Support Library Clinical Research Next Steps Pre-Funding: After Review Terms of ...
... Supplements Peer Review Process Review Committees Application Support Library Clinical Research Next Steps Pre-Funding: After Review Terms of ... Supplements Peer Review Process Review Committees Application Support Library Clinical Research Next Steps Pre-Funding: After Review Terms of ...
Benign Essential Blepharospasm
... Supplements Peer Review Process Review Committees Application Support Library Clinical Research Next Steps Pre-Funding: After Review Terms of ... Supplements Peer Review Process Review Committees Application Support Library Clinical Research Next Steps Pre-Funding: After Review Terms of ...
Maintaining live discussion in two-stage open peer review.
Sandewall, Erik
2012-01-01
Open peer review has been proposed for a number of reasons, in particular, for increasing the transparency of the article selection process for a journal, and for obtaining a broader basis for feedback to the authors and for the acceptance decision. The review discussion may also in itself have a value for the research community. These goals rely on the existence of a lively review discussion, but several experiments with open-process peer review in recent years have encountered the problem of faltering review discussions. The present article addresses the question of how lively review discussion may be fostered by relating the experience of the journal Electronic Transactions on Artificial Intelligence (ETAI) which was an early experiment with open peer review. Factors influencing the discussion activity are identified. It is observed that it is more difficult to obtain lively discussion when the number of contributed articles increases, which implies difficulties for scaling up the open peer review model. Suggestions are made for how this difficulty may be overcome.
Maintaining Live Discussion in Two-Stage Open Peer Review
Sandewall, Erik
2011-01-01
Open peer review has been proposed for a number of reasons, in particular, for increasing the transparency of the article selection process for a journal, and for obtaining a broader basis for feedback to the authors and for the acceptance decision. The review discussion may also in itself have a value for the research community. These goals rely on the existence of a lively review discussion, but several experiments with open-process peer review in recent years have encountered the problem of faltering review discussions. The present article addresses the question of how lively review discussion may be fostered by relating the experience of the journal Electronic Transactions on Artificial Intelligence (ETAI) which was an early experiment with open peer review. Factors influencing the discussion activity are identified. It is observed that it is more difficult to obtain lively discussion when the number of contributed articles increases, which implies difficulties for scaling up the open peer review model. Suggestions are made for how this difficulty may be overcome. PMID:22363282
Doing a Good Deed or Confounding the Problem? Peer Review and Sociology Textbooks.
ERIC Educational Resources Information Center
Kendall, Diana
1999-01-01
Examines how the peer review process influences the writing and publication of sociology textbooks and the teaching of sociology. States that the peer review process may influence the final textbook in five ways: (1) degree of innovation; (2) length; (3) reading level; (4) cloning ancillaries and accessories; and (5) using reviewers as marketing…
Applying Peer Reviews in Software Engineering Education: An Experiment and Lessons Learned
ERIC Educational Resources Information Center
Garousi, V.
2010-01-01
Based on the demonstrated value of peer reviews in the engineering industry, numerous industry experts have listed it at the top of the list of desirable development practices. Experience has shown that problems (defects) are eliminated earlier if a development process incorporates peer reviews and that these reviews are as effective as or even…
Loonen, Martijn P J; Hage, J Joris; Kon, Moshe
2005-10-01
Little is known of what is done with the comments on submitted manuscripts provided by peer reviewers or to what extent these comments benefit the editor in deciding to accept or reject the manuscript, the author(s) in revising their manuscript, or the readership at large. Furthermore, nothing is known of any possible benefits of the process to the peer reviewer. Finally, the peer-review process may even be maleficent because of its implicit delay of publication and a possible bias against manuscripts originating from non-Anglo-American countries. The authors evaluated the benefits of the peer-review process to authors, editor, readers, and reviewers by a bibliometric analysis of the outcome of 100 requests for review made by the editor of Plastic and Reconstructive Surgery from 1992 through 2003. The publication delay and potential geographical bias were evaluated as potential disadvantages. The authors' reviewer advised acceptance of 56 percent of the manuscripts, and the editor mostly agreed with his advice. This suggests that the editor benefited from the review. The authors addressed 48 to 81 percent of the reviewer's constructive suggestions, and this suggests that they and the readers benefited also. Readers of Plastic and Reconstructive Surgery may further benefit because manuscripts rejected by Plastic and Reconstructive Surgery end up in less prestigious journals. The implicit delay of publication is limited, and the authors found no bias against non-Anglo-American submissions. The cost-effectiveness of the process for the peer reviewer remains unclear. The peer-review system of Plastic and Reconstructive Surgery, in general, is beneficial.
Frampton, Geoff K.; Pickett, Karen; Wyatt, Jeremy C.
2018-01-01
Objective To investigate methods and processes for timely, efficient and good quality peer review of research funding proposals in health. Methods A two-stage evidence synthesis: (1) a systematic map to describe the key characteristics of the evidence base, followed by (2) a systematic review of the studies stakeholders prioritised as relevant from the map on the effectiveness and efficiency of peer review ‘innovations’. Standard processes included literature searching, duplicate inclusion criteria screening, study keyword coding, data extraction, critical appraisal and study synthesis. Results A total of 83 studies from 15 countries were included in the systematic map. The evidence base is diverse, investigating many aspects of the systems for, and processes of, peer review. The systematic review included eight studies from Australia, Canada, and the USA, evaluating a broad range of peer review innovations. These studies showed that simplifying the process by shortening proposal forms, using smaller reviewer panels, or expediting processes can speed up the review process and reduce costs, but this might come at the expense of peer review quality, a key aspect that has not been assessed. Virtual peer review using videoconferencing or teleconferencing appears promising for reducing costs by avoiding the need for reviewers to travel, but again any consequences for quality have not been adequately assessed. Conclusions There is increasing international research activity into the peer review of health research funding. The studies reviewed had methodological limitations and variable generalisability to research funders. Given these limitations it is not currently possible to recommend immediate implementation of these innovations. However, many appear promising based on existing evidence, and could be adapted as necessary by funders and evaluated. Where feasible, experimental evaluation, including randomised controlled trials, should be conducted, evaluating impact on effectiveness, efficiency and quality. PMID:29750807
ERIC Educational Resources Information Center
Speer, Sandra
2011-01-01
Peer learning has already existed for a long time, as an informal as well as a formal practice between people from the same professional area. However, peer learning systems on the macro level are relatively newer concepts. Policy learning can be fostered by various types of organised activities, ranging from peer review frameworks, which often…
Peering into peer-review at GigaScience.
Edmunds, Scott C
2013-01-24
Fostering and promoting more open and transparent science is one of the goals of GigaScience. One of the ways we have been doing this is by throwing light on the peer-review process and carrying out open peer-review as standard. In this editorial, we provide our rationale for undertaking this policy, give examples of our positive experiences to date, and encourage others to open up the normally opaque publication process.
Ohio’s Research Initiative for Locals Peer Exchange Report, March 8-9, 2017
DOT National Transportation Integrated Search
2017-10-23
On March 8-9, 2017, the Ohio Department of Transportation (ODOT) hosted a peer exchange on behalf of the Ohios Research Initiative for Locals (ORIL) program. Peer exchanges provide an opportunity to foster best practices and evaluate processes wit...
Two decades of external peer review of cancer care in general hospitals; the Dutch experience.
Kilsdonk, Melvin J; Siesling, Sabine; Otter, Rene; van Harten, Wim H
2016-03-01
External peer review was introduced in general hospitals in the Netherlands in 1994 to assess and improve the multidisciplinary team approach in cancer care. This paper aims to explore the value, perceived impact, and (future) role of external peer review in cancer care. Semistructured interviews were held with clinicians, oncology nurses, and managers from fifteen general hospitals that participated in three rounds of peer review over a period of 16 years. Interviewees reflected on the goals and expectations, experiences, perceived impact, and future role of external peer review. Transcriptions of the interviews were coded to discover recurrent themes. Improving clinical care and organization were the main motives for participation. Positive impact was perceived on multiple aspects of care such as shared responsibilities, internal prioritization of cancer care, improved communication, and a clear structure and position of cancer care within general hospitals. Establishing a direct relationship between the external peer review and organizational or clinical impact proved to be difficult. Criticism was raised on the content of the program being too theoretical and organization-focussed after three rounds. According to most stakeholders, external peer review can improve multidisciplinary team work in cancer care; however, the acceptance is threatened by a perceived disbalance between effort and visible clinical impact. Leaner and more clinically focused programs are needed to keep repeated peer reviews challenging and worthwhile. © 2015 The Authors. Cancer Medicine published by John Wiley & Sons Ltd.
Information Quality in Regulatory Decision Making: Peer Review versus Good Laboratory Practice.
McCarty, Lynn S; Borgert, Christopher J; Mihaich, Ellen M
2012-07-01
There is an ongoing discussion on the provenance of toxicity testing data regarding how best to ensure its validity and credibility. A central argument is whether journal peer-review procedures are superior to Good Laboratory Practice (GLP) standards employed for compliance with regulatory mandates. We sought to evaluate the rationale for regulatory decision making based on peer-review procedures versus GLP standards. We examined pertinent published literature regarding how scientific data quality and validity are evaluated for peer review, GLP compliance, and development of regulations. Some contend that peer review is a coherent, consistent evaluative procedure providing quality control for experimental data generation, analysis, and reporting sufficient to reliably establish relative merit, whereas GLP is seen as merely a tracking process designed to thwart investigator corruption. This view is not supported by published analyses pointing to subjectivity and variability in peer-review processes. Although GLP is not designed to establish relative merit, it is an internationally accepted quality assurance, quality control method for documenting experimental conduct and data. Neither process is completely sufficient for establishing relative scientific soundness. However, changes occurring both in peer-review processes and in regulatory guidance resulting in clearer, more transparent communication of scientific information point to an emerging convergence in ensuring information quality. The solution to determining relative merit lies in developing a well-documented, generally accepted weight-of-evidence scheme to evaluate both peer-reviewed and GLP information used in regulatory decision making where both merit and specific relevance inform the process.
Appendix G: Peer review nondisclosure agreement
DOE Office of Scientific and Technical Information (OSTI.GOV)
None, None
This peer review nondisclosure agreement should be signed by each reviewer prior to the program sending review materials if sensitive or proprietary information will be provided reviewers or discussed during the review, and to everyone attending a review.
A Review of Peer Social Development in Early Childhood.
ERIC Educational Resources Information Center
Goin, Robin P.
1998-01-01
Reviews the literature on young children's peer social development. Addresses implications of social learning theory and empirical research. Discusses recurring themes, including child/peer versus child/adult interactions, incorporation of toys and games, influence of mothers, and gender peer preferences. Considers areas lacking empirical support…
Fitzgerald, Amanda; Fitzgerald, Noelle; Aherne, Cian
2012-08-01
This systematic review investigated the relationship between peer and/or friend variables and physical activity among adolescents by synthesising cross-sectional, longitudinal, and experimental research conducted in the US. Seven electronic databases were searched to identify related articles published within the last 10 years and the articles reviewed included adolescents between 10 and 18 years. Studies reporting a measure of physical activity for adolescents and at least one potential peer and/or friend variable were included. Research demonstrated that peers and friends have an important role to play in the physical activity behavior of adolescents. Six processes were identified through which peers and/or friends may have an influence on physical activity including: peer and/or friend support, presence of peers and friends, peer norms, friendship quality and acceptance, peer crowds, and peer victimization. The theoretical significance of these results is assessed and the development of peer-related physical activity programs for adolescents is discussed. Copyright © 2012 The Foundation for Professionals in Services for Adolescents. Published by Elsevier Ltd. All rights reserved.
[Improving patient safety through voluntary peer review].
Kluge, S; Bause, H
2015-01-01
The intensive care unit (ICU) is one area of the hospital in which processes and communication are of primary importance. Errors in intensive care units can lead to serious adverse events with significant consequences for patients. Therefore quality and risk-management are important measures when treating critically ill patients. A pragmatic approach to support quality and safety in intensive care is peer review. This approach has gained significant acceptance over the past years. It consists of mutual visits by colleagues who conduct standardised peer reviews. These reviews focus on the systematic evaluation of the quality of an ICU's structure, its processes and outcome. Together with different associations, the State Chambers of Physicians and the German Medical Association have developed peer review as a standardized tool for quality improvement. The common goal of all stakeholders is the continuous and sustainable improvement in intensive care with peer reviews significantly increasing and improving communication between professions and disciplines. Peer reviews secure the sustainability of planned change processes and consequently lead the way to an improved culture of quality and safety.
7 CFR 3400.10 - Establishment and operation of peer review groups.
Code of Federal Regulations, 2010 CFR
2010-01-01
...) COOPERATIVE STATE RESEARCH, EDUCATION, AND EXTENSION SERVICE, DEPARTMENT OF AGRICULTURE SPECIAL RESEARCH GRANTS PROGRAM Scientific Peer Review of Research Grant Applications § 3400.10 Establishment and operation of peer review groups. Subject to § 3400.5, the Administrator will adopt procedures for the...
42 CFR 52h.5 - Conflict of interest.
Code of Federal Regulations, 2014 CFR
2014-10-01
... Health PUBLIC HEALTH SERVICE, DEPARTMENT OF HEALTH AND HUMAN SERVICES GRANTS SCIENTIFIC PEER REVIEW OF...) This section applies only to conflicts of interest involving members of peer review groups. This... Executive Order 11222, as amended. For those federal employees serving on peer review groups, in accordance...
42 CFR 52h.5 - Conflict of interest.
Code of Federal Regulations, 2013 CFR
2013-10-01
... Health PUBLIC HEALTH SERVICE, DEPARTMENT OF HEALTH AND HUMAN SERVICES GRANTS SCIENTIFIC PEER REVIEW OF...) This section applies only to conflicts of interest involving members of peer review groups. This... Executive Order 11222, as amended. For those federal employees serving on peer review groups, in accordance...
42 CFR 52h.5 - Conflict of interest.
Code of Federal Regulations, 2012 CFR
2012-10-01
... Health PUBLIC HEALTH SERVICE, DEPARTMENT OF HEALTH AND HUMAN SERVICES GRANTS SCIENTIFIC PEER REVIEW OF...) This section applies only to conflicts of interest involving members of peer review groups. This... Executive Order 11222, as amended. For those federal employees serving on peer review groups, in accordance...
An Observational Case Study of Near-peer Teaching in Medical and Pharmacy Experiential Training.
Sharif-Chan, Bayan; Tankala, Dipti; Leong, Christine; Austin, Zubin; Battistella, Marisa
2016-09-25
Objective. To compare peer teaching in a medical and a pharmacy clinical teaching unit and to provide suggestions for future research in pharmacy near-peer teaching. Methods. This exploratory observational study used principles of ethnographic methodology for data collection and analysis. Observations were collected in a large downtown teaching hospital. An average of 4-6 hours per day were spent observing a team of medical trainees from the Faculty (School) of Medicine in the general internal medicine (unit for two weeks, followed by a team of pharmacy trainees in an ambulatory hemodialysis (HD) unit for two weeks. Data was collected through field notes and informal interviews that were audiotaped and subsequently transcribed. Data was interpreted by the observer and reviewed weekly by two impartial pharmacists. Results. Five major themes emerged: (1) influence of peer teaching hierarchy; (2) educational distance between peer learners and teachers; (3) effect of the clinical teaching unit size on peer learning; (4) trainees' perception of their teaching role in the clinical teaching unit; and (5) influence of daily schedule and workload on peer teaching. As opposed to pharmacy, a hierarchy and pyramidal structure of peer teaching was observed in medical experiential training. There appeared to be no effect of educational distance on near peer teaching; however, perception of teaching role and influence of daily schedule affected near-peer teaching. Conclusion. Through initial comparisons of medical and pharmacy clinical teaching units, this study provides a reflection of elements that may be necessary to successfully implement near-peer teaching in pharmacy experiential training. Future studies in this area should assess learning outcomes and participant satisfaction, preceptor workload, and impact on patient care.
An Observational Case Study of Near-peer Teaching in Medical and Pharmacy Experiential Training
Sharif-Chan, Bayan; Tankala, Dipti; Leong, Christine; Austin, Zubin
2016-01-01
Objective. To compare peer teaching in a medical and a pharmacy clinical teaching unit and to provide suggestions for future research in pharmacy near-peer teaching. Methods. This exploratory observational study used principles of ethnographic methodology for data collection and analysis. Observations were collected in a large downtown teaching hospital. An average of 4-6 hours per day were spent observing a team of medical trainees from the Faculty (School) of Medicine in the general internal medicine (unit for two weeks, followed by a team of pharmacy trainees in an ambulatory hemodialysis (HD) unit for two weeks. Data was collected through field notes and informal interviews that were audiotaped and subsequently transcribed. Data was interpreted by the observer and reviewed weekly by two impartial pharmacists. Results. Five major themes emerged: (1) influence of peer teaching hierarchy; (2) educational distance between peer learners and teachers; (3) effect of the clinical teaching unit size on peer learning; (4) trainees’ perception of their teaching role in the clinical teaching unit; and (5) influence of daily schedule and workload on peer teaching. As opposed to pharmacy, a hierarchy and pyramidal structure of peer teaching was observed in medical experiential training. There appeared to be no effect of educational distance on near peer teaching; however, perception of teaching role and influence of daily schedule affected near-peer teaching. Conclusion. Through initial comparisons of medical and pharmacy clinical teaching units, this study provides a reflection of elements that may be necessary to successfully implement near-peer teaching in pharmacy experiential training. Future studies in this area should assess learning outcomes and participant satisfaction, preceptor workload, and impact on patient care. PMID:27756922
Can editors save peer review from peer reviewers?
D'Andrea, Rafael; O'Dwyer, James P
2017-01-01
Peer review is the gold standard for scientific communication, but its ability to guarantee the quality of published research remains difficult to verify. Recent modeling studies suggest that peer review is sensitive to reviewer misbehavior, and it has been claimed that referees who sabotage work they perceive as competition may severely undermine the quality of publications. Here we examine which aspects of suboptimal reviewing practices most strongly impact quality, and test different mitigating strategies that editors may employ to counter them. We find that the biggest hazard to the quality of published literature is not selfish rejection of high-quality manuscripts but indifferent acceptance of low-quality ones. Bypassing or blacklisting bad reviewers and consulting additional reviewers to settle disagreements can reduce but not eliminate the impact. The other editorial strategies we tested do not significantly improve quality, but pairing manuscripts to reviewers unlikely to selfishly reject them and allowing revision of rejected manuscripts minimize rejection of above-average manuscripts. In its current form, peer review offers few incentives for impartial reviewing efforts. Editors can help, but structural changes are more likely to have a stronger impact.
Kapur, Ajay; Adair, Nilda; O'Brien, Mildred; Naparstek, Nikoleta; Cangelosi, Thomas; Zuvic, Petrina; Joseph, Sherin; Meier, Jason; Bloom, Beatrice; Potters, Louis
Modern external beam radiation therapy treatment delivery processes potentially increase the number of tasks to be performed by therapists and thus opportunities for errors, yet the need to treat a large number of patients daily requires a balanced allocation of time per treatment slot. The goal of this work was to streamline the underlying workflow in such time-interval constrained processes to enhance both execution efficiency and active safety surveillance using a Kaizen approach. A Kaizen project was initiated by mapping the workflow within each treatment slot for 3 Varian TrueBeam linear accelerators. More than 90 steps were identified, and average execution times for each were measured. The time-consuming steps were stratified into a 2 × 2 matrix arranged by potential workflow improvement versus the level of corrective effort required. A work plan was created to launch initiatives with high potential for workflow improvement but modest effort to implement. Time spent on safety surveillance and average durations of treatment slots were used to assess corresponding workflow improvements. Three initiatives were implemented to mitigate unnecessary therapist motion, overprocessing of data, and wait time for data transfer defects, respectively. A fourth initiative was implemented to make the division of labor by treating therapists as well as peer review more explicit. The average duration of treatment slots reduced by 6.7% in the 9 months following implementation of the initiatives (P = .001). A reduction of 21% in duration of treatment slots was observed on 1 of the machines (P < .001). Time spent on safety reviews remained the same (20% of the allocated interval), but the peer review component increased. The Kaizen approach has the potential to improve operational efficiency and safety with quick turnaround in radiation therapy practice by addressing non-value-adding steps characteristic of individual department workflows. Higher effort opportunities are identified to guide continual downstream quality improvements. Copyright © 2017 American Society for Radiation Oncology. Published by Elsevier Inc. All rights reserved.
NASA Astrophysics Data System (ADS)
Brewer, J. H.
2014-12-01
I have built a "demonstration" website at http://oPeer.org to illustrate how peer review and publication might be improved relative to the current model, which was designed and implemented in an era when scientific communication was either face-to-face or relied upon human delivery of ink marks on dead trees.
Kumpf, Oliver; Bloos, Frank; Bause, Hanswerner; Brinkmann, Alexander; Deja, Maria; Marx, Gernot; Kaltwasser, Arnold; Dubb, Rolf; Muhl, Elke; Greim, Clemens-A.; Weiler, Norbert; Chop, Ines; Jonitz, Günther; Schaefer, Henning; Felsenstein, Matthias; Liebeskind, Ursula; Leffmann, Carsten; Jungbluth, Annemarie; Waydhas, Christian; Pronovost, Peter; Spies, Claudia; Braun, Jan-Peter
2014-01-01
Introduction: Quality improvement and safety in intensive care are rapidly evolving topics. However, there is no gold standard for assessing quality improvement in intensive care medicine yet. In 2007 a pilot project in German intensive care units (ICUs) started using voluntary peer reviews as an innovative tool for quality assessment and improvement. We describe the method of voluntary peer review and assessed its feasibility by evaluating anonymized peer review reports and analysed the thematic clusters highlighted in these reports. Methods: Retrospective data analysis from 22 anonymous reports of peer reviews. All ICUs – representing over 300 patient beds – had undergone voluntary peer review. Data were retrieved from reports of peers of the review teams and representatives of visited ICUs. Data were analysed with regard to number of topics addressed and results of assessment questionnaires. Reports of strengths, weaknesses, opportunities and threats (SWOT reports) of these ICUs are presented. Results: External assessment of structure, process and outcome indicators revealed high percentages of adherence to predefined quality goals. In the SWOT reports 11 main thematic clusters were identified representative for common ICUs. 58.1% of mentioned topics covered personnel issues, team and communication issues as well as organisation and treatment standards. The most mentioned weaknesses were observed in the issues documentation/reporting, hygiene and ethics. We identified several unique patterns regarding quality in the ICU of which long-term personnel problems und lack of good reporting methods were most interesting Conclusion: Voluntary peer review could be established as a feasible and valuable tool for quality improvement. Peer reports addressed common areas of interest in intensive care medicine in more detail compared to other methods like measurement of quality indicators. PMID:25587245
Kumpf, Oliver; Bloos, Frank; Bause, Hanswerner; Brinkmann, Alexander; Deja, Maria; Marx, Gernot; Kaltwasser, Arnold; Dubb, Rolf; Muhl, Elke; Greim, Clemens-A; Weiler, Norbert; Chop, Ines; Jonitz, Günther; Schaefer, Henning; Felsenstein, Matthias; Liebeskind, Ursula; Leffmann, Carsten; Jungbluth, Annemarie; Waydhas, Christian; Pronovost, Peter; Spies, Claudia; Braun, Jan-Peter
2014-01-01
Quality improvement and safety in intensive care are rapidly evolving topics. However, there is no gold standard for assessing quality improvement in intensive care medicine yet. In 2007 a pilot project in German intensive care units (ICUs) started using voluntary peer reviews as an innovative tool for quality assessment and improvement. We describe the method of voluntary peer review and assessed its feasibility by evaluating anonymized peer review reports and analysed the thematic clusters highlighted in these reports. Retrospective data analysis from 22 anonymous reports of peer reviews. All ICUs - representing over 300 patient beds - had undergone voluntary peer review. Data were retrieved from reports of peers of the review teams and representatives of visited ICUs. Data were analysed with regard to number of topics addressed and results of assessment questionnaires. Reports of strengths, weaknesses, opportunities and threats (SWOT reports) of these ICUs are presented. External assessment of structure, process and outcome indicators revealed high percentages of adherence to predefined quality goals. In the SWOT reports 11 main thematic clusters were identified representative for common ICUs. 58.1% of mentioned topics covered personnel issues, team and communication issues as well as organisation and treatment standards. The most mentioned weaknesses were observed in the issues documentation/reporting, hygiene and ethics. We identified several unique patterns regarding quality in the ICU of which long-term personnel problems und lack of good reporting methods were most interesting Conclusion: Voluntary peer review could be established as a feasible and valuable tool for quality improvement. Peer reports addressed common areas of interest in intensive care medicine in more detail compared to other methods like measurement of quality indicators.
Three decades of disasters: a review of disaster-specific literature from 1977-2009.
Smith, Erin; Wasiak, Jason; Sen, Ayan; Archer, Frank; Burkle, Frederick M
2009-01-01
The potential for disasters exists in all communities. To mitigate the potential catastrophes that confront humanity in the new millennium, an evidence-based approach to disaster management is required urgently. This study moves toward such an evidence-based approach by identifying peer-reviewed publications following a range of disasters and events over the past three decades. Peer-reviewed, event-specific literature was identified using a comprehensive search of the electronically indexed database, MEDLINE (1956-January 2009). An extended comprehensive search was conducted for one event to compare the event-specific literature indexed in MEDLINE to other electronic databases (EMBASE, CINAHL, AMED, CENTRAL, Psych Info, Maternity and Infant Care, EBM Reviews). Following 25 individual disasters or overwhelming crises, a total of 2,098 peer-reviewed, event-specific publications were published in 789 journals (652 publications following disasters/events caused by natural hazards, 966 following human-made/technological disasters/events, and 480 following conflict/complex humanitarian events).The event with the greatest number of peer-reviewed, event-specific publications was the 11 September 2001 terrorist attacks (686 publications). Prehospital and Disaster Medicine published the greatest number of peer-reviewed, event-specific publications (54), followed by Journal of Traumatic Stress (42), Military Medicine (40), and Psychiatric Services (40). The primary topics of event-specific publications were mental health, medical health, and response. When an extended, comprehensive search was conducted for one event, 75% of all peer-reviewed, event-specific publications were indexed in MEDLINE. A broad range of multi-disciplinary journals publish peer reviewed, event-specific publications. While the majority of peer-reviewed, event-specific literature is indexed in MEDLINE, comprehensive search strategies should include EMBASE to increase yield.
Reflections of a CHAMPUS-APA peer reviewer.
Parlour, R R
1986-02-01
Peer review is a major professional response to the problems of health insurance coverage for psychiatric services. Standard insurance programs reimburse only services that are conventional and cost-effective. The system assumes that services are skillfully documented by providers. Experience as a peer reviewer helps clinicians acquire skill in documentation.
Marketing Academics' Perceptions of the Peer Review Process
ERIC Educational Resources Information Center
Bailey, Charles D.; Hair, Joe F.; Hermanson, Dana R.; Crittenden, Victoria L.
2012-01-01
Publication in refereed journals is critical to career success for most marketing faculty members, and the peer review process is the gatekeeper for a refereed journal. The study reported here examines marketing academics' perceptions of this peer review process. Based on responses from 653 marketing academics, we find favorable overall…
The Neuroscience Peer Review Consortium
Saper, Clifford B; Maunsell, John HR
2009-01-01
As the Neuroscience Peer Review Consortium (NPRC) ends its first year, it is worth looking back to see how the experiment has worked. In order to encourage dissemination of the details outlined in this Editorial, it will also be published in other journals in the Neuroscience Peer Review Consortium. PMID:19284614
Code of Federal Regulations, 2014 CFR
2014-10-01
... 42 Public Health 1 2014-10-01 2014-10-01 false Peer review. 24.5 Section 24.5 Public Health PUBLIC HEALTH SERVICE, DEPARTMENT OF HEALTH AND HUMAN SERVICES PERSONNEL SENIOR BIOMEDICAL RESEARCH SERVICE § 24.5 Peer review. An individual may not be considered for appointment into the SBRS unless his/her...
Code of Federal Regulations, 2012 CFR
2012-10-01
... 42 Public Health 1 2012-10-01 2012-10-01 false Peer review. 24.5 Section 24.5 Public Health PUBLIC HEALTH SERVICE, DEPARTMENT OF HEALTH AND HUMAN SERVICES PERSONNEL SENIOR BIOMEDICAL RESEARCH SERVICE § 24.5 Peer review. An individual may not be considered for appointment into the SBRS unless his/her...
Code of Federal Regulations, 2013 CFR
2013-10-01
... 42 Public Health 1 2013-10-01 2013-10-01 false Peer review. 24.5 Section 24.5 Public Health PUBLIC HEALTH SERVICE, DEPARTMENT OF HEALTH AND HUMAN SERVICES PERSONNEL SENIOR BIOMEDICAL RESEARCH SERVICE § 24.5 Peer review. An individual may not be considered for appointment into the SBRS unless his/her...
Code of Federal Regulations, 2011 CFR
2011-10-01
... 42 Public Health 1 2011-10-01 2011-10-01 false Peer review. 24.5 Section 24.5 Public Health PUBLIC HEALTH SERVICE, DEPARTMENT OF HEALTH AND HUMAN SERVICES PERSONNEL SENIOR BIOMEDICAL RESEARCH SERVICE § 24.5 Peer review. An individual may not be considered for appointment into the SBRS unless his/her...
Federal Register 2010, 2011, 2012, 2013, 2014
2013-10-24
... responses. The peer reviewers generally concurred with our methods and conclusions, and they provided... corallicola, and Harrisia aboriginum. The peer reviewers generally concurred with our methods and conclusions... discussion, below. (6) Comment: One peer reviewer provided research findings on the seed longevity and...
Peer Review Undergoing Revitalization
ERIC Educational Resources Information Center
Sawchuk, Stephen
2009-01-01
Established in the 142,000-student Montgomery County, Maryland, district in 1999, peer assistance and review (PAR)--or "peer review," as it is occasionally called--is actually an old idea. In 1981, the then-president of the Toledo Federation of Teachers, Dal Lawrence, helped create the first PAR program. Almost 30 years later, only a…
Peer-review: An IOP Publishing Perspective
NASA Astrophysics Data System (ADS)
Smith, Timothy
2015-03-01
Online publishing is challenging, and potentially changing, the role of publishers in both managing the peer-review process and disseminating the work that they publish in meeting contrasting needs from diverse groups of research communities. Recognizing the value of peer-review as a fundamental service to authors and the research community, the underlying principles of managing the process for journals published by IOP Publishing remain unchanged and yet the potential and demand for alternative models exists. This talk will discuss the traditional approach to peer-review placed in the context of this changing demand.
The objective impact of clinical peer review on hospital quality and safety.
Edwards, Marc T
2011-01-01
Despite its importance, the objective impact of clinical peer review on the quality and safety of care has not been studied. Data from 296 acute care hospitals show that peer review program and related organizational factors can explain up to 18% of the variation in standardized measures of quality and patient safety. The majority of programs rely on an outmoded and dysfunctional process model. Adoption of best practices informed by the continuing study of peer review program effectiveness has the potential to significantly improve patient outcomes.
Halim, Audrey S; Finkenstaedt-Quinn, Solaire A; Olsen, Laura J; Gere, Anne Ruggles; Shultz, Ginger V
2018-06-01
Student misconceptions are an obstacle in science, technology, engineering, and mathematics courses and unless remediated may continue causing difficulties in learning as students advance in their studies. Writing-to-learn assignments (WTL) are characterized by their ability to promote in-depth conceptual learning by allowing students to explore their understanding of a topic. This study sought to determine whether and what types of misconceptions are elicited by WTL assignments and how the process of peer review and revision leads to remediation or propagation of misconceptions. We examined four WTL assignments in an introductory biology course in which students first wrote about content by applying it to a realistic scenario, then participated in a peer-review process before revising their work. Misconceptions were identified in all four assignments, with the greatest number pertaining to protein structure and function. Additionally, in certain contexts, students used scientific terminology incorrectly. Analysis of the drafts and peer-review comments generated six profiles by which misconceptions were addressed through the peer-review process. The prevalent mode of remediation arose through directed peer-review comments followed by correction during revision. It was also observed that additional misconceptions were elicited as students revised their writing in response to general peer-review suggestions.
Peering into peer-review at GigaScience
2013-01-01
Fostering and promoting more open and transparent science is one of the goals of GigaScience. One of the ways we have been doing this is by throwing light on the peer-review process and carrying out open peer-review as standard. In this editorial, we provide our rationale for undertaking this policy, give examples of our positive experiences to date, and encourage others to open up the normally opaque publication process. PMID:23587291
Peer-review for selection of oral presentations for conferences: Are we reliable?
Deveugele, Myriam; Silverman, Jonathan
2017-11-01
Although peer-review for journal submission, grant-applications and conference submissions has been called 'a counter- stone of science', and even 'the gold standard for evaluating scientific merit', publications on this topic remain scares. Research that has investigated peer-review reveals several issues and criticisms concerning bias, poor quality review, unreliability and inefficiency. The most important weakness of the peer review process is the inconsistency between reviewers leading to inadequate inter-rater reliability. To report the reliability of ratings for a large international conference and to suggest possible solutions to overcome the problem. In 2016 during the International Conference on Communication in Healthcare, organized by EACH: International Association for Communication in Healthcare, a calibration exercise was proposed and feedback was reported back to the participants of the exercise. Most abstracts, as well as most peer-reviewers, receive and give scores around the median. Contrary to the general assumption that there are high and low scorers, in this group only 3 peer-reviewers could be identified with a high mean, while 7 has a low mean score. Only 2 reviewers gave only high ratings (4 and 5). Of the eight abstracts included in this exercise, only one abstract received a high mean score and one a low mean score. Nevertheless, both these abstracts received both low and high scores; all other abstracts received all possible scores. Peer-review of submissions for conferences are, in accordance with the literature, unreliable. New and creative methods will be needed to give the participants of a conference what they really deserve: a more reliable selection of the best abstracts. More raters per abstract improves the inter-rater reliability; training of reviewers could be helpful; providing feedback to reviewers can lead to less inter-rater disagreement; fostering negative peer-review (rejecting the inappropriate submissions) rather than a positive (accepting the best) could be fruitful for selecting abstracts for conferences. Copyright © 2017 Elsevier B.V. All rights reserved.
Nasim, Aashir; Belgrave, Faye Z; Jagers, Robert J; Wilson, Karen D; Owens, Kristal
2007-01-01
African-American adolescents have lower rates of alcohol consumption than White youth. However, African-American youth suffer disproportionately more adverse social, mental, and physical health outcomes related to alcohol use. Affiliating with negative peers is a risk factor for alcohol initiation and consumption. Cultural variables have shown moderating effects against other risk factors for African-American youth and therefore were the focus of this study. Specifically, we tested whether three culturally-relevant variables, Africentric beliefs, religiosity, and ethnic identity were promotive or protective for alcohol initiation and use within the context of negative peer affiliations. The sample consisted of 114 at-risk African-American adolescents whose ages ranged from 13 to 20. Participants were administered a questionnaire with measures of alcohol initiation and use, peer risk behaviors, ethnic identity, Africentric beliefs, religiosity, and demographic items. Peer risk behaviors accounted for significant percentages of the variance in age of alcohol initiation, lifetime use, and current and heavy alcohol use after adjusting for age and gender. Cultural variables showed both promotive and protective effects. Africentric beliefs were promotive of delayed alcohol initiation, whereas both Africentrism and religiosity moderated peer risk behaviors effect on alcohol initiation. Africentric beliefs were also inversely related to lifetime alcohol use revealing a promotive effect. Moreover, there were significant protective effects of ethnic identity and religiosity on heavy alcohol consumption. One implication of these findings is that prevention programs that infuse cultural values and practices such as Africentrism, ethnic identity, and religiosity may delay alcohol initiation and reduce use especially for youth with high risk peers.
Purtell, D L
1990-11-01
The Health Care Quality Improvement Act of 1986 can help protect medical professionals and healthcare facilities from antitrust and defamation claims and other forms of litigation arising from the peer review process. Some hospitals may need to make major changes in their peer review activity as a result of the act. The healthcare entity, not the physicians involved in peer review, has the burden of complying with the provisions of the act. Failure to comply with the act can lead to loss of immunity from damages, fines, and potential exclusion from the Medicare program. The potential for liability has sparked a need for hospitals to reexamine and possibly reorganize medical staff and update procedures and related governing documents. Healthcare entities may consider changes such as implementing a director of medical affairs function, choosing medical staff for multiple-year terms, and centralizing physician review files. In the 1980s many hospitals created quality assurance and risk management programs. Risk managers need to share data with quality assurance personnel, who must in turn share the information with medical staff involved with credentialing, peer review, and medical affairs management. Legal counsel will need to be familiar with the legalities of the act, as well as the hospital's peer review procedures and operations. General legal counsel should oversee coordination of hospital proceedings and assist in educating staff on the legalities of peer review.
McGrath, Robert J; Priestley, Jennifer Lewis; Zhou, Yiyun; Culligan, Patrick J
2018-04-09
Information from ratings sites are increasingly informing patient decisions related to health care and the selection of physicians. The current study sought to determine the validity of online patient ratings of physicians through comparison with physician peer review. We extracted 223,715 reviews of 41,104 physicians from 10 of the largest cities in the United States, including 1142 physicians listed as "America's Top Doctors" through physician peer review. Differences in mean online patient ratings were tested for physicians who were listed and those who were not. Overall, no differences were found between the online patient ratings based upon physician peer review status. However, statistical differences were found for four specialties (family medicine, allergists, internal medicine, and pediatrics), with online patient ratings significantly higher for those physicians listed as a peer-reviewed "Top Doctor" versus those who were not. The results of this large-scale study indicate that while online patient ratings are consistent with physician peer review for four nonsurgical, primarily in-office specializations, patient ratings were not consistent with physician peer review for specializations like anesthesiology. This result indicates that the validity of patient ratings varies by medical specialization. ©Robert J McGrath, Jennifer Lewis Priestley, Yiyun Zhou, Patrick J Culligan. Originally published in the Interactive Journal of Medical Research (http://www.i-jmr.org/), 09.04.2018.
Clinical peer review program self-evaluation for US hospitals.
Edwards, Marc T
2010-01-01
Prior research has shown wide variation in clinical peer review program structure, process, governance, and perceived effectiveness. This study sought to validate the utility of a Peer Review Program Self-Evaluation Tool as a potential guide to physician and hospital leaders seeking greater program value. Data from 330 hospitals show that the total score from the self-evaluation tool is strongly associated with perceived quality impact. Organizational culture also plays a significant role. When controlling for these factors, there was no evidence of benefit from a multispecialty review process. Physicians do not generally use reliable methods to measure clinical performance. A high rate of change since 2007 has not produced much improvement. The Peer Review Program Self-Evaluation Tool reliably differentiates hospitals along a continuum of perceived program performance. The full potential of peer review as a process to improve the quality and safety of care has yet to be realized.
Callaham, Michael L; Tercier, John
2007-01-01
Background Peer review is considered crucial to the selection and publication of quality science, but very little is known about the previous experiences and training that might identify high-quality peer reviewers. The reviewer selection processes of most journals, and thus the qualifications of their reviewers, are ill defined. More objective selection of peer reviewers might improve the journal peer review process and thus the quality of published science. Methods and Findings 306 experienced reviewers (71% of all those associated with a specialty journal) completed a survey of past training and experiences postulated to improve peer review skills. Reviewers performed 2,856 reviews of 1,484 separate manuscripts during a four-year study period, all prospectively rated on a standardized quality scale by editors. Multivariable analysis revealed that most variables, including academic rank, formal training in critical appraisal or statistics, or status as principal investigator of a grant, failed to predict performance of higher-quality reviews. The only significant predictors of quality were working in a university-operated hospital versus other teaching environment and relative youth (under ten years of experience after finishing training). Being on an editorial board and doing formal grant (study section) review were each predictors for only one of our two comparisons. However, the predictive power of all variables was weak. Conclusions Our study confirms that there are no easily identifiable types of formal training or experience that predict reviewer performance. Skill in scientific peer review may be as ill defined and hard to impart as is “common sense.” Without a better understanding of those skills, it seems unlikely journals and editors will be successful in systematically improving their selection of reviewers. This inability to predict performance makes it imperative that all but the smallest journals implement routine review ratings systems to routinely monitor the quality of their reviews (and thus the quality of the science they publish). PMID:17411314
A Scoping Review of Health Game Research: Past, Present, and Future
Lu, Amy Shirong; Gharghabi, Fardad; Coleman, Whitney
2012-01-01
Abstract Health game research has flourished over the last decade. The number of peer-reviewed scientific publications has surged as the clinical application of health games has diversified. In response to this growth, several past literature reviews have assessed the effectiveness of health games in specific clinical subdomains. The past literature reviews, however, have not provided a general scope of health games independent of clinical context. The present systematic review identified 149 publications. All sources were published before 2011 in a peer-reviewed venue. To be included in this review, publications were required (1) to be an original research, (2) to focus on health, (3) to utilize a sound research design, (4) to report quantitative health outcomes, and (5) to target healthcare receivers. Initial findings showed certain trends in health game publications: Focus on younger male demographics, relatively low number of study participants, increased number of controlled trials, short duration of intervention periods, short duration and frequency of user–game interaction, dominance of exercise and rehab games, lack of underlying theoretical frameworks, and concentration on clinical contexts such as physical activity and nutrition. The review concludes that future research should (1) widen the demographics to include females and elderly, (2) increase the number of participants in controlled trials, (3) lengthen both the intervention period and user–game interaction duration, and (4) expand the application of health games in new clinical contexts. PMID:24416638
Rouette, Julie; Gutierrez, Eric; O'Donnell, Jennifer; Reddeman, Lindsay; Hart, Margaret; Foxcroft, Sophie; Mitera, Gunita; Warde, Padraig; Brundage, Michael D
2017-07-01
To describe the outcomes of peer review across all 14 cancer centers in Ontario. We identified all peer-reviewed, curative treatment plans delivered in Ontario within a 3-month study period from 2013 to 2014 using a provincial cancer treatment database and collected additional data on the peer-review outcomes. Considerable variation was found in the proportion of peer-reviewed plans across the centers (average 70.2%, range 40.8%-99.2%). During the study period, 5561 curative plans underwent peer review. Of those, 184 plans (3.3%) had changes recommended. Of the 184 plans, the changes were major (defined as requiring repeat planning or having a major effect on planning or clinical outcomes, or both) in 40.2% and minor in 47.8%. For the remaining 12.0%, data were missing. The proportions of recommended changes varied among disease sites (0.0%-7.0%). The disease sites with the most recommended changes to treatment plans after peer review and with the greatest potential for benefit were the esophagus (7.0%), uterus (6.7%), upper limb (6.3%), cervix and lower limb (both 6.0%), head and neck and bilateral lung (both 5.9%), right supraclavicular lymph nodes (5.7%), rectum (5.3%), and spine (5.0%). Although the heart is an organ at risk in left-sided breast treatment plans, the proportions of recommended changes did not significantly differ between the left breast treatment plans (3.0%, 95% confidence interval 2.0%-4.5%) and right breast treatment plans (2.4%, 95% confidence interval 1.5%-3.8%). The recommended changes were more frequently made when peer review occurred before radiation therapy (3.8%) than during treatment (1.4%-2.8%; P=.0048). The proportion of plans with recommended changes was not significantly associated with patient volume (P=.23), peer-review performance (P=.36), or center academic status (P=.75). Peer review of treatment plans directly affects the quality of care by identifying important clinical and planning changes. Provincial strategies are underway to optimize its conduct in radiation oncology. Copyright © 2016. Published by Elsevier Inc.
Alternatives to Peer Review: Novel Approaches for Research Evaluation
Birukou, Aliaksandr; Wakeling, Joseph Rushton; Bartolini, Claudio; Casati, Fabio; Marchese, Maurizio; Mirylenka, Katsiaryna; Osman, Nardine; Ragone, Azzurra; Sierra, Carles; Wassef, Aalam
2011-01-01
In this paper we review several novel approaches for research evaluation. We start with a brief overview of the peer review, its controversies, and metrics for assessing efficiency and overall quality of the peer review. We then discuss five approaches, including reputation-based ones, that come out of the research carried out by the LiquidPub project and research groups collaborated with LiquidPub. Those approaches are alternative or complementary to traditional peer review. We discuss pros and cons of the proposed approaches and conclude with a vision for the future of the research evaluation, arguing that no single system can suit all stakeholders in various communities. PMID:22174702
Bähler, C; Foster, S; Estévez, N; Dey, M; Gmel, G; Mohler-Kuo, M
2016-11-01
The aim of this study was to assess the association between changes in living arrangement and the initiation of daily smoking and monthly risky single-occasion drinking (RSOD) in a cohort of young Swiss men. Longitudinal cohort study. The sample consisted of 4662 young men drawn from the Cohort Study on Substance Use Risk Factors who lived with their family at baseline. Follow-up assessments occurred 15 months later. Multiple regression models were adjusted for individual and family factors (family model), as well as for individual and peer-related factors (peer model). Relative to those still living with their parents at follow-up (n = 3845), those who had moved out (n = 817) were considerably more likely to have taken up smoking or RSOD after adjusting for several individual, family, and peer-related variables: OR (daily smoking) = 1.67 (95% CI 1.15-2.41) (P = 0.007) and OR (monthly RSOD) = 1.42 (95% CI 1.08-1.88) (P = 0.012). The strongest family-related predictors of smoking initiation were family structure and the lack of parental regulation and the strongest peer-related factors alcohol/drug problems in peers. Meanwhile, the strongest peer-related predictors of RSOD initiation were peer pressure (misconduct), perceived social support from friends, and perceived social support from a significant other, whereas family factors were not associated with RSOD initiation. Further subanalyses were conducted to examine the impact of different living arrangement changes on substance use initiation and revealed that living with peers at follow-up was associated with the greatest risk. We identified a strong association between moving out of one's parents' home and daily smoking and monthly RSOD initiation in young Swiss men. Moving out to live with peers was an especially strong predictor of substance use initiation. Campaigns that aim to prevent heavy smoking and drinking should be intensified at the end of obligatory school. Copyright © 2016 The Royal Society for Public Health. Published by Elsevier Ltd. All rights reserved.
Successful peer review of courses: a case study.
Horowitz, S; Van Eyck, S; Albanese, M
1998-03-01
The authors describe their school's system of peer review for courses, established in 1988 to facilitate faculty evaluation and continual course and curriculum improvement. (The system has been temporarily suspended while the school's new curriculum becomes established.) They explain how the system was created and then report how faculty reviews of courses over the five-year operation of the system compared with students' reviews of the same courses. The faculty and students' ratings were in agreement 75% of the time. When not in agreement, the students' ratings tended to upgrade courses that were not very demanding, had easy grading, and emphasized clinical details, often at the expense of basic concepts and the big picture. The authors then document how the work of the peer review system favorably influenced the transformation of the school's curriculum. They also provide guidelines for the creation and operation of a course review process that uses faculty peers. The authors maintain that the peer review system worked because it was run by a committee of experienced and respected teachers who had been selected by their peers, the other faculty. Additional reasons for its success were that the school's faculty supported and respected the committee and its work, that course directors helped evaluate their courses, and that peer reviewers took their work seriously despite having no remuneration, and the clearly positive impact of the review system on faculty interaction, faculty-student interaction, and the reform of the curriculum.
Marks, Lawrence B.; Adams, Robert D.; Pawlicki, Todd; Blumberg, Albert L.; Hoopes, David; Brundage, Michael D.; Fraass, Benedick A.
2013-01-01
This report is part of a series of white papers commissioned for the American Society for Radiation Oncology (ASTRO) Board of Directors as part of ASTRO's Target Safely Campaign, focusing on the role of peer review as an important component of a broad safety/quality assurance (QA) program. Peer review is one of the most effective means for assuring the quality of qualitative, and potentially controversial, patient-specific decisions in radiation oncology. This report summarizes many of the areas throughout radiation therapy that may benefit from the application of peer review. Each radiation oncology facility should evaluate the issues raised and develop improved ways to apply the concept of peer review to its individual process and workflow. This might consist of a daily multidisciplinary (eg, physicians, dosimetrists, physicists, therapists) meeting to review patients being considered for, or undergoing planning for, radiation therapy (eg, intention to treat and target delineation), as well as meetings to review patients already under treatment (eg, adequacy of image guidance). This report is intended to clarify and broaden the understanding of radiation oncology professionals regarding the meaning, roles, benefits, and targets for peer review as a routine quality assurance tool. It is hoped that this work will be a catalyst for further investigation, development, and study of the efficacy of peer review techniques and how these efforts can help improve the safety and quality of our treatments. PMID:24175002
ERIC Educational Resources Information Center
Card, Noel A.; Hodges, Ernest V. E.
2008-01-01
Peer victimization among schoolchildren is a common problem that predicts serious maladjustment. In this article, the authors define peer victimization, provide a brief overview of the history of research on the topic, and review prevalence rates, common measurement approaches, and the correlates of peer victimization. This review leads to…
DOT National Transportation Integrated Search
2001-05-01
The team began this peer exchange with a review of the first Oregon Peer Exchange conducted in may, 1998. The review included a summary of recommendations made and the changes made as a result of the 1998 Peer Exchange Report. : The primary focus of ...
Peering into peer review: Galileo, ESP, Dr Scott Reuben, and advancing our professional evolution.
Biddle, Chuck
2011-10-01
The fundamental purpose of peer review is quality control that facilitates the introduction of information into our discipline; information that is essential to the care of patients who require anesthesia services. While the AANA Journal relies heavily on this process to maintain the overall quality of our scholarly literature, it may fail that objective under certain conditions. This editorial serves to inform readers of the nature and goals of the peer review process.
2017 Building Technologies Office Peer Review Report
DOE Office of Scientific and Technical Information (OSTI.GOV)
None, None
The 2017 Building Technologies Office Peer Review Report summarizes the feedback submitted by reviewers for the 109 Building Technologies Office (BTO) projects presented at the 2017 BTO Peer Review. The report presents an overview of the goals and activities under each technology program area, a summary of project scores for each program, and a brief analysis of general evaluation trends within each program area or its constituent subprograms.
ERIC Educational Resources Information Center
Schroter, Daniela C.; Coryn, Chris L. S.; Montrosse, Bianca E.
2008-01-01
Peer review is an umbrella term that refers to a class of selection and oversight practices, including the familiar mechanisms of the review of proposals submitted for funding, of manuscripts for scholarly publications, and of personnel qualifications and portfolios for selection and promotion. Peer review has long been a cornerstone of modern…
What do we know about grant peer review in the health sciences?
Guthrie, Susan; Ghiga, Ioana; Wooding, Steven
2017-01-01
Peer review decisions award >95% of academic medical research funding, so it is crucial to understand how well they work and if they could be improved. This paper summarises evidence from 105 relevant papers identified through a literature search on the effectiveness and burden of peer review for grant funding. There is a remarkable paucity of evidence about the overall efficiency of peer review for funding allocation, given its centrality to the modern system of science. From the available evidence, we can identify some conclusions around the effectiveness and burden of peer review. The strongest evidence around effectiveness indicates a bias against innovative research. There is also fairly clear evidence that peer review is, at best, a weak predictor of future research performance, and that ratings vary considerably between reviewers. There is some evidence of age bias and cronyism. Good evidence shows that the burden of peer review is high and that around 75% of it falls on applicants. By contrast, many of the efforts to reduce burden are focused on funders and reviewers/panel members. We suggest funders should acknowledge, assess and analyse the uncertainty around peer review, even using reviewers' uncertainty as an input to funding decisions. Funders could consider a lottery element in some parts of their funding allocation process, to reduce both burden and bias, and allow better evaluation of decision processes. Alternatively, the distribution of scores from different reviewers could be better utilised as a possible way to identify novel, innovative research. Above all, there is a need for open, transparent experimentation and evaluation of different ways to fund research. This also requires more openness across the wider scientific community to support such investigations, acknowledging the lack of evidence about the primacy of the current system and the impossibility of achieving perfection.
Peer Review: Structured, Informal, Confidential, Helpful!
ERIC Educational Resources Information Center
Cassidy, Alice; Lee, Jack
2011-01-01
This paper describes an introductory workshop, Preparing to be a Peer Reviewer, presented at the University of British Columbia (UBC) to give hands-on practice to faculty members and others in order to provide formative peer review upon request. This workshop, which was designed at the request of a faculty member, is complemented by an Advanced…
Preparing English Learners for Effective Peer Review in the Writers' Workshop
ERIC Educational Resources Information Center
Kim, Soo Hyon
2015-01-01
English Language Learners (ELLs) often face challenges when participating in peer review activities in writers' workshops. This article identifies some of the potential difficulties that ELL writers may experience, and provides teachers with strategies to address these problems. The author describes a simple three-step peer review training model…
Using Peer Review to Improve Student Writing in Business Courses
ERIC Educational Resources Information Center
Rieber, Lloyd J.
2006-01-01
Student peer review has proven an effective technique for improving student writing in both English and business communication classes, yet the technique is not widely used in business courses other than business communication. In this article, the author discusses using student peer review in business classes to improve students' final written…
Peer Review of Teaching: Best Practices for a Non-Programmatic Approach
ERIC Educational Resources Information Center
Alabi, Jaena; Weare, William H., Jr.
2014-01-01
Many academic librarians who provide library instruction have never received formal training in educational theory and methods. To bridge this gap and improve the teaching skills of instruction librarians, some academic libraries have established peer review of teaching programs. Despite the recognized benefits of peer review, it may not be…
The Great Fossil Fiasco: Teaching about Peer Review.
ERIC Educational Resources Information Center
Gift, Nancy; Krasny, Marianne
2003-01-01
Describes a lesson that engages middle school students in learning about peer review. Uses the article "Archaeoraptor Fossil Trail," which was published in the November, 1999 issue of "National Geographic" as an example of a real life story of how peer review forces scientists to critically re-examine a fossil discovery. (SOE)
Influence of Peer Effects on Learning Outcomes: A Review of the Literature.
ERIC Educational Resources Information Center
Wilkinson, Ian A. G.; Hattie, John A.; Parr, Judy M.; Townsend, Michael A. R.; Fung, Irene; Ussher, Charlotte; Thrupp, Martin; Lauder, Hugh; Robinson, Tony
This report presents a literature review and conceptual model summarizing the influence of peer effects on learning outcomes. The report describes the approach to the review and provides a theoretical account of the environments, mechanisms, and processes that mediate learning among peers. It then summarizes the literature on compositional effects…
Federal Register 2010, 2011, 2012, 2013, 2014
2012-09-24
... Collect Information: Forms Pertaining to the Peer Review of ARS Research Projects AGENCY: Agricultural Research Service (ARS), USDA. ACTION: Notice and request for comments. SUMMARY: The proposed information... allow the ARS to efficiently manage data associated with the peer review of agricultural research. All...
Original Research and Peer Review Using Web-Based Collaborative Tools by College Students
ERIC Educational Resources Information Center
Cakir, Mustafa; Carlsen, William S.
2007-01-01
The Environmental Inquiry program supports inquiry based, student-centered science teaching on selected topics in the environmental sciences. Many teachers are unfamiliar with both the underlying science of toxicology, and the process and importance of peer review in scientific method. The protocol and peer review process was tested with college…
DOE Hydrogen Program: 2010 Annual Merit Review and Peer Evaluation Report
DOE Office of Scientific and Technical Information (OSTI.GOV)
Not Available
This document summarizes the comments provided by peer reviewers on hydrogen and fuel cell projects presented at the FY 2010 U.S. Department of Energy (DOE) Hydrogen Program and Vehicle Technologies Program Annual Merit Review and Peer Evaluation Meeting (AMR), held June 7-11, 2010 in Washington, D.C.
EPA is peer reviewing the Agency’s report modeling the relationship between lead in drinking water and blood lead levels in children utilizing the Integrated Exposure Uptake Biokinetic (IEUBK) model. The report being peer reviewed may be used to inform the derivation of a concent...
Peer Review: The CHAMPUS Program.
ERIC Educational Resources Information Center
Stricker, George
This paper examines the use of the peer review system in evaluating out-patient clinical services for a third-party payer seeking justification for payment of services. Peer review is defined as a process by which one professional, in an official capacity, makes a judgment about a co-professional in a matter involving professional functioning. The…
Systematic review of peer education intervention programmes among individuals with type 2 diabetes.
Gatlin, Tricia K; Serafica, Reimund; Johnson, Michael
2017-12-01
To systematically review published randomised controlled trials of peer education interventions among adults with type 2 diabetes. Systematic reviews have shown mixed results for peer support interventions to improve diabetes self-management. Given the effectiveness of diabetes education by healthcare professionals, peer education interventions may be a useful alternative approach. This review addressed that gap. Systematic review. A systematic search of published randomised controlled trials between 2006-2016 was conducted using the keywords diabetes, type 2 diabetes, randomised controlled trials, self-management, peer education and peer support. The methodological quality of each study was assessed using the Jadad scale. Seven studies were included in the final review, and the Jadad scores ranged from 8-10 of a possible 13 points. There was no consistent design, setting, or outcome measurement among the studies. There were two types of peer education interventions compared to traditional diabetes education: face-to-face or a combination of face-to-face and telephone/texting. The most common clinical outcome measure was HbA1c. Two of six studies showed statistically significant improvement in HbA1c between intervention and control groups. An increase in diabetes knowledge was also statistically significant in two of five studies. Peer education could be successful in improving clinical outcomes. No evidence was found indicating that healthcare provider education was superior in regard to clinical knowledge or behavioural or psychological outcome measures than peer education. HbA1c was statistically significantly lower in some peer education groups compared to control groups. There is evidence that peer education can be useful in achieving positive clinical outcomes such as decreasing HbA1c levels and increasing diabetes knowledge. A certified diabetes educator or a trained healthcare professional should not be overlooked though when using peer educators. © 2017 John Wiley & Sons Ltd.
SPS energy conversion and power management workshop. Final report
DOE Office of Scientific and Technical Information (OSTI.GOV)
Not Available
1980-06-01
In 1977 a four year study, the concept Development and Evaluation Program, was initiated by the US Department of Energy and the National Aeronautics and Space Administration. As part of this program, a series of peer reviews were carried out within the technical community to allow available information on SPS to be sifted, examined and, if need be, challenged. The SPS Energy Conversion and Power Management Workshop, held in Huntsville, Alabama, February 5 to 7, 1980, was one of these reviews. The results of studies in this particular field were presented to an audience of carefully selected scientists and engineers.more » This first report summarizes the results of that peer review. It is not intended to be an exhaustive treatment of the subject. Rather, it is designed to look at the SPS energy conversion and power management options in breadth, not depth, to try to foresee any troublesome and/or potentially unresolvable problems and to identify the most promising areas for future research and development. Topics include photovoltaic conversion, solar thermal conversion, and electric power distribution processing and power management. (WHK)« less
Nesi, Jacqueline; Choukas-Bradley, Sophia; Prinstein, Mitchell J
2018-04-07
As social media use becomes increasingly widespread among adolescents, research in this area has accumulated rapidly. Researchers have shown a growing interest in the impact of social media on adolescents' peer experiences, including the ways that the social media context shapes a variety of peer relations constructs. This paper represents Part 2 of a two-part theoretical review. In this review, we offer a new model for understanding the transformative role of social media in adolescents' peer experiences, with the goal of stimulating future empirical work that is grounded in theory. The transformation framework suggests that the features of the social media context transform adolescents' peer experiences by changing their frequency or immediacy, amplifying demands, altering their qualitative nature, and/or offering new opportunities for compensatory or novel behaviors. In the current paper, we consider the ways that social media may transform peer relations constructs that often occur at the group level. Our review focuses on three key constructs: peer victimization, peer status, and peer influence. We selectively review and highlight existing evidence for the transformation of these domains through social media. In addition, we discuss methodological considerations and key conceptual principles for future work. The current framework offers a new theoretical perspective through which peer relations researchers may consider adolescent social media use.
Feldstein Ewing, Sarah W; Saitz, Richard
2015-02-01
Peer review aims to ensure the quality and credibility of research reporting. Conducted by volunteer scientists who receive no guidance or direction, peer review widely varies from fast and facilitative, to unclear and obstructive. Poor quality is an issue because most science research is publicly funded, whereby scientists must make an effort to quickly disseminate their findings back to the public. An unfortunately not uncommon barrier in this process is ineffective peer review. Most scientists agree that when done well, editors and reviewers drive and maintain the high standards of science. At the same time, ineffective peer review can cause great delay with no introduced improvement in final product. These delays and requests interfere with the path of communication between scientist and public, at a great cost to editors, reviewers, authors and those who stand to benefit from application of the results of the studies. We offer a series of concrete recommendations to improve this process.
IRIS Toxicological Review of Inorganic Arsenic (Cancer) ...
On February 19, 2010, the draft IRIS Toxicological Review of Inorganic Arsenic (Cancer) external review draft document and the charge to external peer reviewers were released for public review and comment. The draft document and the charge to external peer reviewers were reviewed internally by EPA and by other federal agencies and White House Offices before public release. In the new IRIS process, introduced by the EPA Administrator, all written comments on IRIS assessments submitted by other federal agencies and White House Offices will be made publicly available. Accordingly, interagency comments and the interagency science consultation draft of the Toxicological Review of Inorganic Arsenic and the charge to external peer reviewers are posted on this site. This draft IRIS health assessment addresses only cancer human health effects that may result from chronic exposure to this chemical. An assessment of noncancer health effects of inorganic arsenic will be released for external peer review and public comment at a later date.
Collins, Gary S; Boutron, Isabelle; Yu, Ly-Mee; Cook, Jonathan; Shanyinde, Milensu; Wharton, Rose; Shamseer, Larissa; Altman, Douglas G
2014-01-01
Objective To investigate the effectiveness of open peer review as a mechanism to improve the reporting of randomised trials published in biomedical journals. Design Retrospective before and after study. Setting BioMed Central series medical journals. Sample 93 primary reports of randomised trials published in BMC-series medical journals in 2012. Main outcome measures Changes to the reporting of methodological aspects of randomised trials in manuscripts after peer review, based on the CONSORT checklist, corresponding peer reviewer reports, the type of changes requested, and the extent to which authors adhered to these requests. Results Of the 93 trial reports, 38% (n=35) did not describe the method of random sequence generation, 54% (n=50) concealment of allocation sequence, 50% (n=46) whether the study was blinded, 34% (n=32) the sample size calculation, 35% (n=33) specification of primary and secondary outcomes, 55% (n=51) results for the primary outcome, and 90% (n=84) details of the trial protocol. The number of changes between manuscript versions was relatively small; most involved adding new information or altering existing information. Most changes requested by peer reviewers had a positive impact on the reporting of the final manuscript—for example, adding or clarifying randomisation and blinding (n=27), sample size (n=15), primary and secondary outcomes (n=16), results for primary or secondary outcomes (n=14), and toning down conclusions to reflect the results (n=27). Some changes requested by peer reviewers, however, had a negative impact, such as adding additional unplanned analyses (n=15). Conclusion Peer reviewers fail to detect important deficiencies in reporting of the methods and results of randomised trials. The number of these changes requested by peer reviewers was relatively small. Although most had a positive impact, some were inappropriate and could have a negative impact on reporting in the final publication. PMID:24986891
ERIC Educational Resources Information Center
Christoffersen, Katherine O'Donnell
2015-01-01
Peer review is now a commonplace practice in process-oriented writing instruction. A crucial aspect of peer review is assessing another classmate's work, which encompasses the act of disagreement. Given its prevalence in the classroom, it is necessary to analyze how L2 learners mitigate disagreement in the context of peer review with other L2…
Doing peer review and receiving feedback: impact on scientific literacy and writing skills.
Geithner, Christina A; Pollastro, Alexandria N
2016-03-01
Doing peer review has been effectively implemented to help students develop critical reading and writing skills; however, its application in Human Physiology programs is limited. The purpose of the present study was to determine the impact of peer review on Human Physiology majors' perceptions of their scientific literacy and writing skills. Students enrolled in the Scientific Writing course completed multiple writing assignments, including three revisions after receiving peer and instructor feedback. Students self-assessed their knowledge, skills, and attitudes related to science and writing in pre- and postcourse surveys (n = 26 with complete data). Seven survey items related to scientific literacy and writing skills impacted by peer review were selected for analysis. Scores on these survey items were summed to form a composite self-rating score. Responses to two questions regarding the most useful learning activities were submitted to frequency analysis. Mean postcourse scores for individual survey items and composite self-rating scores were significantly higher than precourse means (P < 0.05). Peer review was the most frequently noted among 21 learning activities for increasing scientific literacy and in the top 5 for improving writing skills. In conclusion, peer review is an effective teaching/learning approach for improving undergraduate Human Physiology majors' knowledge, skills, and attitudes regarding science and scientific writing. Copyright © 2016 The American Physiological Society.
Peer Acceptance and Friendship in Early Childhood: The Conceptual Distinctions between Them
ERIC Educational Resources Information Center
Beazidou, Eleftheria; Botsoglou, Kafenia
2016-01-01
This paper reviews previous literature about peer acceptance and friendship, two of the most critical aspects of peer relations that have received most of research attention during the past years. In this review, we will focus on the processes explaining the way children use the ability to socialise with peers; explore the hypothesis that certain…
Peer Response to L2 Student Writing: Patterns and Expectations
ERIC Educational Resources Information Center
Abdalla Salih, Abdel Rahman
2013-01-01
This paper reports the corrective feedback patterns in L2 writing and the student writers' preferences for peer feedback. The study examines the actual focus of peer review and the types of corrective feedback provided in L2 composing process. Sixteen L2 matriculation students at a Malaysian university took part in five peer review sessions,…
ERIC Educational Resources Information Center
Nguyen, Huy; Xiong, Wenting; Litman, Diane
2017-01-01
A peer-review system that automatically evaluates and provides formative feedback on free-text feedback comments of students was iteratively designed and evaluated in college and high-school classrooms. Classroom assignments required students to write paper drafts and submit them to a peer-review system. When student peers later submitted feedback…
Peer Review from the Students' Perspective: Invaluable or Invalid?
ERIC Educational Resources Information Center
Brammer, Charlotte; Rees, Mary
2007-01-01
Only a few instances of empirical research examine what the students themselves think of their participation in peer review. Perhaps because peer response is practically instinctive to those who teach writing, few have felt the need to study the student perspective. Instead, studies have focused on the quality of peer comments, their effect on the…
Peer Mentoring and Peer Tutoring among K-12 Students: A Literature Review
ERIC Educational Resources Information Center
Goodrich, Andrew
2018-01-01
The purpose of this literature review is to examine research on peer mentoring among K-12 students to assist practitioners with how to incorporate these instructional techniques into their own music programs. Primary themes across the music education literature of peer mentoring include the role of music teachers, the role of students as they…
Unmanned Maritime Systems Incremental Acquisition Approach
2016-12-01
We find that current UMS acquisitions are utilizing previous acquisition reforms, but could benefit from additional contractor peer competition and...peer review. Additional cost and schedule benefits could result from contractor competition during build processes in each incremental process. We...acquisitions are utilizing previous acquisition reforms, but could benefit from additional contractor peer competition and peer review. Additional
What do we know about grant peer review in the health sciences?
Guthrie, Susan; Ghiga, Ioana; Wooding, Steven
2018-01-01
Background: Peer review decisions award an estimated >95% of academic medical research funding, so it is crucial to understand how well they work and if they could be improved. Methods: This paper summarises evidence from 105 papers identified through a literature search on the effectiveness and burden of peer review for grant funding. Results: There is a remarkable paucity of evidence about the efficiency of peer review for funding allocation, given its centrality to the modern system of science. From the available evidence, we can identify some conclusions around the effectiveness and burden of peer review. The strongest evidence around effectiveness indicates a bias against innovative research. There is also fairly clear evidence that peer review is, at best, a weak predictor of future research performance, and that ratings vary considerably between reviewers. There is some evidence of age bias and cronyism. Good evidence shows that the burden of peer review is high and that around 75% of it falls on applicants. By contrast, many of the efforts to reduce burden are focused on funders and reviewers/panel members. Conclusions: We suggest funders should acknowledge, assess and analyse the uncertainty around peer review, even using reviewers’ uncertainty as an input to funding decisions. Funders could consider a lottery element in some parts of their funding allocation process, to reduce both burden and bias, and allow better evaluation of decision processes. Alternatively, the distribution of scores from different reviewers could be better utilised as a possible way to identify novel, innovative research. Above all, there is a need for open, transparent experimentation and evaluation of different ways to fund research. This also requires more openness across the wider scientific community to support such investigations, acknowledging the lack of evidence about the primacy of the current system and the impossibility of achieving perfection. PMID:29707193
Peer Support for the Hardly Reached: A Systematic Review.
Sokol, Rebeccah; Fisher, Edwin
2016-07-01
Health disparities are aggravated when prevention and care initiatives fail to reach those they are intended to help. Groups can be classified as hardly reached according to a variety of circumstances that fall into 3 domains: individual (e.g., psychological factors), demographic (e.g., socioeconomic status), and cultural-environmental (e.g., social network). Several reports have indicated that peer support is an effective means of reaching hardly reached individuals. However, no review has explored peer support effectiveness in relation to the circumstances associated with being hardly reached or across diverse health problems. To conduct a systematic review assessing the reach and effectiveness of peer support among hardly reached individuals, as well as peer support strategies used. Three systematic searches conducted in PubMed identified studies that evaluated peer support programs among hardly reached individuals. In aggregate, the searches covered articles published from 2000 to 2015. Eligible interventions provided ongoing support for complex health behaviors, including prioritization of hardly reached populations, assistance in applying behavior change plans, and social-emotional support directed toward disease management or quality of life. Studies were excluded if they addressed temporally isolated behaviors, were limited to protocol group classes, included peer support as the dependent variable, did not include statistical tests of significance, or incorporated comparison conditions that provided appreciable social support. We abstracted data regarding the primary health topic, categorizations of hardly reached groups, program reach, outcomes, and strategies employed. We conducted a 2-sample t test to determine whether reported strategies were related to reach. Forty-seven studies met our inclusion criteria, and these studies represented each of the 3 domains of circumstances assessed (individual, demographic, and cultural-environmental). Interventions addressed 8 health areas, most commonly maternal and child health (25.5%), diabetes (17.0%), and other chronic diseases (14.9%). Thirty-six studies (76.6%) assessed program reach, which ranged from 24% to 79% of the study population. Forty-four studies (94%) reported significant changes favoring peer support. Eleven strategies emerged for engaging and retaining hardly reached individuals. Among them, programs that reported a strategy of trust and respect had higher participant retention (82.8%) than did programs not reporting such a strategy (48.1%; P = .003). In 5 of the 6 studies examining moderators of the effects of peer support, peer support benefits were greater among individuals characterized by disadvantage (e.g., low health literacy). Peer support is a broad and robust strategy for reaching groups that health services too often fail to engage. The wide range of audiences and health concerns among which peer support is successful suggests that a basis for its success may be its flexible response to different contexts, including the intended audience, health problems, and setting. The general benefits of peer support and findings suggesting that it may be more effective among those at heightened disadvantage indicate that peer support should be considered in programs intended to reach and benefit those too often hardly reached. Because engendering trust and respect was significantly associated with participant retention, programs should emphasize this strategy.
IRIS Toxicological Review of Inorganic Arsenic (Cancer) (Interagency Science Consultation Draft)
On February 19, 2010, the draft IRIS Toxicological Review of Inorganic Arsenic (Cancer) external review draft document and the charge to external peer reviewers were released for public review and comment. The draft document and the charge to external peer reviewers were reviewed...
Performance results for a workstation-integrated radiology peer review quality assurance program.
O'Keeffe, Margaret M; Davis, Todd M; Siminoski, Kerry
2016-06-01
To assess review completion rates, RADPEER score distribution, and sources of disagreement when using a workstation-integrated radiology peer review program, and to evaluate radiologist perceptions of the program. Retrospective review of prospectively collected data. Large private outpatient radiology practice. Radiologists (n = 66) with a mean of 16.0 (standard deviation, 9.2) years of experience. Prior studies and reports of cases being actively reported were randomly selected for peer review using the RADPEER scoring system (a 4-point scale, with a score of 1 indicating agreement and scores of 2-4 indicating increasing levels of disagreement). Assigned peer review completion rates, review scores, sources of disagreement and radiologist survey responses. Of 31 293 assigned cases, 29 044 (92.8%; 95% CI 92.5-93.1%) were reviewed. Discrepant scores (score = 2, 3 or 4) were given in 0.69% (95% CI 0.60-0.79%) of cases and clinically significant discrepancy (score = 3 or 4) was assigned in 0.42% (95% CI 0.35-0.50%). The most common cause of disagreement was missed diagnosis (75.2%; 95% CI 66.8-82.1%). By anonymous survey, 94% of radiologists felt that peer review was worthwhile, 90% reported that the scores they received were appropriate and 78% felt that the received feedback was valuable. Workstation-based peer review can increase completion rates and levels of radiologist acceptance while producing RADPEER scores similar to those previously reported. This approach may be one way to increase radiologist engagement in peer review quality assurance. © The Author 2016. Published by Oxford University Press in association with the International Society for Quality in Health Care; all rights reserved.
Challenges in the Ethical Review of Peer Support Interventions
Simmons, David; Bunn, Christopher; Nakwagala, Fred; Safford, Monika M.; Ayala, Guadalupe X.; Riddell, Michaela; Graffy, Jonathan; Fisher, Edwin B.
2015-01-01
PURPOSE Ethical review processes have become increasingly complex. We have examined how 8 collaborating diabetes peer-support clinical trials were assessed by ethics committees. METHODS The ethical reviews from the 8 peer-support studies were collated and subjected to a thematic analysis. We mapped the recommendations of local Institutional Review Boards and ethics committees onto the “4+1 ethical framework” (autonomy, beneficence, non-maleficence, and justice, along with concern for their scope of application). RESULTS Ethics committees did not consistently focus on tasks within the 4+1 framework: many conducted reviews of scientific, organizational, and administrative activities. Of the 20 themes identified across the ethical reviews, only 4 fell within the scope of the 4+1 framework. Variation in processes and requirements for ethics committees were particularly evident between study countries. Some of the consent processes mandated by ethical review boards were disproportionate for peer support, increased participant burden, and reduced the practicality of testing an ethical intervention. Across the 8 studies, ethics committees’ reviews included the required elements to ensure participant safety; however, they created a range of hurdles that in some cases delayed the research and required consent processes that could hinder the spontaneity and/or empathy of peer support. CONCLUSION Ethics committees should avoid repeating the work of other trusted agencies and consider the ethical validity of “light touch” consent procedures for peer-support interventions. The investigators propose an ethical framework for research on peer support. PMID:26304976
Turnitin and Peer Review in ESL Academic Writing Classrooms
ERIC Educational Resources Information Center
Li, Jinrong; Li, Mimi
2018-01-01
Despite the benefits of peer review, there are still challenges that need to be addressed to make it more effective for L2 students. With the development of technology, computer-mediated peer review has captured increasing attention from L2 writing researchers and instructors. While Turnitin is known for its use in detecting plagiarism, its newly…
Working in Triads: A Case Study of a Peer Review Process
ERIC Educational Resources Information Center
Grainger, Peter; Bridgstock, Martin; Houston, Todd; Drew, Steve
2015-01-01
Peer review of teaching has become an accepted educational procedure in Australia to quality assure the quality of teaching practices. The institutional implementation of the peer review process can be viewed as genuine desire to improve teaching quality or an imposition from above as a measure of accountability and performativity. One approach is…
Peer-to-Peer Teaching in Higher Education: A Critical Literature Review
ERIC Educational Resources Information Center
Stigmar, Martin
2016-01-01
The aim of my critical literature review is to identify studies where students are engaged as partners in teaching in higher education and to analyze how tutors and tutees benefit from peer teaching. Thirty studies were included for review. Thirteen countries are represented and two thirds of the studies conducted in the United States of America…
Blog Comments vs. Peer Review: Which Way Makes a Book Better?
ERIC Educational Resources Information Center
Young, Jeffrey R.
2008-01-01
What if scholarly books were peer reviewed by anonymous blog comments rather than by traditional, selected peer reviewers? This is the question posed by an unusual experiment that was started recently by Noah Wardrip-Fruin, an an assistant professor of communication at the University of California at San Diego. His experiment was started after his…
ERIC Educational Resources Information Center
Tribe, Lorena; Cooper, Evan L.
2008-01-01
A well-structured independent literature research project with a poster session was used to introduce students to peer-reviewed literature in a general chemistry course. Overall, students reported an enhanced appreciation of the course due to performing research at some level, using peer-reviewed literature, and presenting their results in a…
DOE Office of Scientific and Technical Information (OSTI.GOV)
Satypal, S.
2011-09-01
This document summarizes the comments provided by peer reviewers on hydrogen and fuel cell projects presented at the FY 2011 U.S. Department of Energy (DOE) Hydrogen Program and Vehicle Technologies Program Annual Merit Review and Peer Evaluation Meeting (AMR), held May 9-13, 2011 in Arlington, Virginia
Bound by Tradition? Peer Review and New Scholarship: An Institutional Case Study
ERIC Educational Resources Information Center
White, Barbara Jo; Cruz, Laura; Ellern, Jill; Ford, George; Moss, Hollye
2012-01-01
Peer review is by no means a routine process for traditional, or basic, research. Even so, peer review is even less routinized for other forms of scholarship. In 1990, Ernest Boyer called for a reconsideration of scholarship and extended the definition to be inclusive of non-traditional modes of scholarly production and delivery. However, peer…
Peer Review Improves the Quality of MCQ Examinations
ERIC Educational Resources Information Center
Malau-Aduli, Bunmi S.; Zimitat, Craig
2012-01-01
The aim of this study was to assess the effect of the introduction of peer review processes on the quality of multiple-choice examinations in the first three years of an Australian medical course. The impact of the peer review process and overall quality assurance (QA) processes were evaluated by comparing the examination data generated in earlier…
Academic Excellence: A Commentary and Reflections on the Inherent Value of Peer Review
ERIC Educational Resources Information Center
Roberts, Thomas J.; Shambrook, Jennifer
2012-01-01
Academic peer review is widely viewed as fair, equitable, and essential to academic quality. Successfully completing the process through publication or award is widely deemed as one of the most rigorous and prestigious forms of scholarly accomplishment. Despite this sentiment the academic peer review process is not without fault. It is criticized…
Doing Peer Review and Receiving Feedback: Impact on Scientific Literacy and Writing Skills
ERIC Educational Resources Information Center
Geithner, Christina A.; Pollastro, Alexandria N.
2016-01-01
Doing peer review has been effectively implemented to help students develop critical reading and writing skills; however, its application in Human Physiology programs is limited. The purpose of the present study was to determine the impact of peer review on Human Physiology majors' perceptions of their scientific literacy and writing skills.…
Student Peer Review: Enhancing Formative Feedback with a Rebuttal
ERIC Educational Resources Information Center
Harland, Tony; Wald, Navé; Randhawa, Haseeb
2017-01-01
This study examines the use of peer review in an undergraduate ecology programme, in which students write a research proposal as a grant application, prior to carrying out the research project. Using a theoretical feedback model, we compared teacher and student peer reviews in a double blind exercise, and show how students responded to feedback…
ERIC Educational Resources Information Center
Watkins, Laci; O'Reilly, Mark; Kuhn, Michelle; Gevarter, Cindy; Lancioni, Giulio E.; Sigafoos, Jeff; Lang, Russell
2015-01-01
This review addresses the use of peer-mediated interventions (PMI) to improve the social interaction skills of students with autism spectrum disorder (ASD) in inclusive settings. The purpose of this review is to (a) identify the characteristics and components of peer-mediated social interaction interventions, (b) evaluate the effectiveness of PMI…
Social Workers' Attitudes toward Peer-Reviewed Literature: The Evidence Base
ERIC Educational Resources Information Center
Knight, Carolyn
2013-01-01
Social workers from one state chapter of the National Association of Social Workers were surveyed to assess their use of and attitudes toward the peer-reviewed literature and their engagement in evidence-based practice. Results reveal that, in general, the practitioners in this study did not read the peer-reviewed literature, particularly articles…
Biagianti, Bruno; Quraishi, Sophia H; Schlosser, Danielle A
2018-04-01
Peer-to-peer interactions and support groups mitigate experiences of social isolation and loneliness often reported by individuals with psychotic disorders. Online peer-to-peer communication can promote broader use of this form of social support. Peer-to-peer interactions occur naturally on social media platforms, but they can negatively affect mental health. Recent digital interventions for persons with psychotic disorders have harnessed the principles of social media to incorporate peer-to-peer communication. This review examined the feasibility, acceptability, and preliminary efficacy of recent digital interventions in order to identify strategies to maximize benefits of online peer-to-peer communication for persons with psychotic disorders. An electronic database search of PubMed, EMBASE, PsycINFO, Ovid MEDLINE, Cochrane Central Register of Controlled Trials, and Health Technology Assessment Database was conducted in February 2017 and yielded a total of 1,015 results. Eight publications that reported data from six independent trials and five interventions were reviewed. The technology supporting peer-to-peer communication varied greatly across studies, from online forums to embedded social networking. When peer-to-peer interactions were moderated by facilitators, retention, engagement, acceptability, and efficacy were higher than for interventions with no facilitators. Individuals with psychotic disorders were actively engaged with moderated peer-to-peer communication and showed improvements in perceived social support. Studies involving service users in intervention design showed higher rates of acceptability. Individuals with psychotic disorders value and benefit from digital interventions that include moderated peer-to-peer interactions. Incorporating peer-to-peer communication into digital interventions for this population may increase compliance with other evidence-based therapies by producing more acceptable and engaging online environments.
The DLESE Evaluation Toolkit Project
NASA Astrophysics Data System (ADS)
Buhr, S. M.; Barker, L. J.; Marlino, M.
2002-12-01
The Evaluation Toolkit and Community project is a new Digital Library for Earth System Education (DLESE) collection designed to raise awareness of project evaluation within the geoscience education community, and to enable principal investigators, teachers, and evaluators to implement project evaluation more readily. This new resource is grounded in the needs of geoscience educators, and will provide a virtual home for a geoscience education evaluation community. The goals of the project are to 1) provide a robust collection of evaluation resources useful for Earth systems educators, 2) establish a forum and community for evaluation dialogue within DLESE, and 3) disseminate the resources through the DLESE infrastructure and through professional society workshops and proceedings. Collaboration and expertise in education, geoscience and evaluation are necessary if we are to conduct the best possible geoscience education. The Toolkit allows users to engage in evaluation at whichever level best suits their needs, get more evaluation professional development if desired, and access the expertise of other segments of the community. To date, a test web site has been built and populated, initial community feedback from the DLESE and broader community is being garnered, and we have begun to heighten awareness of geoscience education evaluation within our community. The web site contains features that allow users to access professional development about evaluation, search and find evaluation resources, submit resources, find or offer evaluation services, sign up for upcoming workshops, take the user survey, and submit calendar items. The evaluation resource matrix currently contains resources that have met our initial review. The resources are currently organized by type; they will become searchable on multiple dimensions of project type, audience, objectives and evaluation resource type as efforts to develop a collection-specific search engine mature. The peer review criteria and process for ensuring that the site contains robust and useful resources has been drafted and received initial feedback from the project advisory board, which consists of members of every segment of the target audience. The review criteria are based upon DLESE peer review criteria, the MERLOT digital library peer review criteria, digital resource evaluation criteria, and evaluation best practices. In geoscience education, as in most endeavors, improvements are made by asking questions and acting upon information about successes and failures; project evaluation can be thought of as the systematic process of asking these questions and gathering the right information. The Evaluation Toolkit seeks to help principal investigators, teachers, and evaluators use the evaluation process to improve our projects and our field.
Janke, Kristin K.; Traynor, Andrew P.
2017-01-01
Objectives. To identify peer reviewer and peer review characteristics that enhance manuscript quality and editorial decisions, and to identify valuable elements of peer reviewer training programs. Methods. A three-school, 15-year review of pharmacy practice and pharmacy administration faculty’s publications was conducted to identify high-publication volume journals for inclusion. Editors-in-chief identified all editors managing manuscripts for participation. A three-round modified Delphi process was used. Rounds advanced from open-ended questions regarding actions and attributes of good reviewers to consensus-seeking and clarifying questions related to quality, importance, value, and priority. Results. Nineteen editors representing eight pharmacy journals participated. Three characteristics of reviews were rated required or helpful in enhancing manuscript quality by all respondents: includes a critical analysis of the manuscript (88% required, 12% helpful), includes feedback that contains both strengths and areas of improvement (53% required, 47% helpful), and speaks to the manuscript’s utility in the literature (41% required, 59% helpful). Hands-on experience with review activities (88%) and exposure to good and bad reviews (88%) were identified as very valuable to peer reviewer development. Conclusion. Reviewers, individuals involved in faculty development, and journals should work to assist new reviewers in defining focused areas of expertise, building knowledge in these areas, and developing critical analysis skills. PMID:28630514
Hojat, Mohammadreza; Gonnella, Joseph S; Caelleigh, Addeane S
2003-01-01
High publication demands and the low acceptance rate of peer review journals place the journal editors and their reviewers in a powerful position. Journal reviewers have a vital role not only in influencing the journal editor's publication decisions, but also in the very nature and direction of scientific research. Because of their influence in peer review outcomes, journal reviewers are aptly described as the "gatekeepers of science." In this article we describe several pitfalls that can impede reviewers' impartial judgement. These include such issues as confirmatory bias, the negative results bias (the file drawer problem), the Matthew effect, the Doctor Fox effect, and gender, race, theoretical orientation, and "political correctness." We argue that procedures currently used by many professional journals, such as blind or masked review, may not completely alleviate the effects of these pitfalls. Instead, we suggest that increasing reviewers' awareness of the pitfalls, accountability, and vigilance can improve fairness in the peer review process. The ultimate responsibilities belong to the journal editors who are confronted with the difficult task of satisfying journal readers, contributors, reviewers, and owners. We recommend that the journal editors conduct periodic internal and external evaluations of their journals' peer review process and outcomes, with participation of reviewers, contributors, readers and owners.
Baker, Hannah M; Meernik, Clare; Ranney, Leah M; Richardson, Amanda; Goldstein, Adam O
2017-01-01
Objective This systematic review examines the impact of non-menthol flavours in tobacco products on tobacco use perceptions and behaviours among youth, young adults and adults. Data sources English-language peer-reviewed publications indexed in 4 databases were searched through April 2016. Study selection A search strategy was developed related to tobacco products and flavours. Of 1688 articles identified, we excluded articles that were not English-language, were not peer-reviewed, were qualitative, assessed menthol-flavoured tobacco products only and did not contain original data on outcomes that assessed the impact of flavours in tobacco products on perceptions and use behaviour. Data extraction Outcome measures were identified and tabulated. 2 researchers extracted the data independently and used a validated quality assessment tool to assess study quality. Data synthesis 40 studies met the inclusion criteria. Data showed that tobacco product packaging with flavour descriptors tended to be rated as more appealing and as less harmful by tobacco users and non-users. Many tobacco product users, especially adolescents, reported experimenting, initiating and continuing to use flavoured products because of the taste and variety of the flavours. Users of many flavoured tobacco products also showed decreased likelihood of intentions to quit compared with non-flavoured tobacco product users. Conclusions Flavours in most tobacco products appear to play a key role in how users and non-users, especially youth, perceive, initiate, progress and continue using tobacco products. Banning non-menthol flavours from tobacco products may ultimately protect public health by reducing tobacco use, particularly among youth. PMID:27872344
Adaptive search in mobile peer-to-peer databases
NASA Technical Reports Server (NTRS)
Wolfson, Ouri (Inventor); Xu, Bo (Inventor)
2010-01-01
Information is stored in a plurality of mobile peers. The peers communicate in a peer to peer fashion, using a short-range wireless network. Occasionally, a peer initiates a search for information in the peer to peer network by issuing a query. Queries and pieces of information, called reports, are transmitted among peers that are within a transmission range. For each search additional peers are utilized, wherein these additional peers search and relay information on behalf of the originator of the search.
Zare, Samane; Nemati, Mehdi; Zheng, Yuqing
2018-01-01
Systematic review of research examining consumer preference for the main electronic cigarette (e-cigarette) attributes namely flavor, nicotine strength, and type. A systematic search of peer-reviewed articles resulted in a pool of 12,933 articles. We included only articles that meet all the selection criteria: (1) peer-reviewed, (2) written in English, and (3) addressed consumer preference for one or more of the e-cigarette attributes including flavor, strength, and type. 66 articles met the inclusion criteria for this review. Consumers preferred flavored e-cigarettes, and such preference varied with age groups and smoking status. We also found that several flavors were associated with decreased harm perception while tobacco flavor was associated with increased harm perception. In addition, some flavor chemicals and sweeteners used in e-cigarettes could be of toxicological concern. Finally, consumer preference for nicotine strength and types depended on smoking status, e-cigarette use history, and gender. Adolescents could consider flavor the most important factor trying e-cigarettes and were more likely to initiate vaping through flavored e-cigarettes. Young adults overall preferred sweet, menthol, and cherry flavors, while non-smokers in particular preferred coffee and menthol flavors. Adults in general also preferred sweet flavors (though smokers like tobacco flavor the most) and disliked flavors that elicit bitterness or harshness. In terms of whether flavored e-cigarettes assisted quitting smoking, we found inconclusive evidence. E-cigarette users likely initiated use with a cigarette like product and transitioned to an advanced system with more features. Non-smokers and inexperienced e-cigarettes users tended to prefer no nicotine or low nicotine e-cigarettes while smokers and experienced e-cigarettes users preferred medium and high nicotine e-cigarettes. Weak evidence exists regarding a positive interaction between menthol flavor and nicotine strength.
Rap Music Use, Perceived Peer Behavior, and Sexual Initiation Among Ethnic Minority Youth.
Johnson-Baker, Kimberly A; Markham, Christine; Baumler, Elizabeth; Swain, Honora; Emery, Susan
2016-03-01
Research shows that rap music use is associated with risky sexual behavior in ethnic minority youth; however, it is unknown whether rap music use impacts sexual initiation specifically and, if so, which factors mediate this impact. Thus, we investigated the longitudinal relationship between hours spent listening to rap music in seventh grade and sexual initiation in ninth grade. We also examined the role of perceived peer sexual behavior as a potential mediator of this relationship. We analyzed data from students (n = 443) enrolled in a school-based randomized controlled trial of a sexual health education curriculum collected at baseline and at 18-month follow-up. Rap music use and perceived peer sexual behavior were assessed in seventh grade, whereas sexual initiation was assessed in ninth grade. Univariate, multivariate, and mediation analyses were conducted. At baseline, rap music use was significantly associated with race/ethnicity, parental music rules, and sexual behavior, but not with gender or parental education. Rap music use was a significant predictor of sexual initiation on univariate analysis but not multivariate analysis. Mediation analysis showed that the association between hours spent listening to rap music and sexual initiation was significantly mediated by perceived peer sexual behavior. Rap music use in early adolescence significantly impacts sexual initiation in late adolescence, partially mediated by perceived peer sexual behavior. More research is needed to understand how rap music influences perceptions of peer sexual behavior, which, in turn, influence early sexual initiation. Copyright © 2016 Society for Adolescent Health and Medicine. Published by Elsevier Inc. All rights reserved.
Roberts, Christopher M; Stone, Robert A; Buckingham, Rhona J; Pursey, Nancy A; Lowe, Derek; Potter, Jonathan M
2012-06-01
Peer review has been widely used within the National Health Service to facilitate health quality improvement but evaluation has been limited particularly over the longer-term. Change within the National Health Service (NHS) can take a prolonged period--1-2 years--to occur. We report here a 3-year evaluation of the largest randomized trial of peer review ever conducted in the UK. To evaluate whether targeted mutual peer review of respiratory units brings about improvements in services for chronic obstructive pulmonary disease (COPD) over 3 years. The peer review intervention was a reciprocal supportive exercise that included clinicians, hospital management, commissioners and patients, which focused on the quality of the provision of four specific evidence-based aspects of COPD care. Follow-up at 36 months demonstrated limited significant quantitative differences in the quality of services offered in the two groups but a strong trend in favour of intervention sites. Qualitative data suggested many benefits of peer review in most but not all intervention units and some control teams. The data identify factors that promote and obstruct change. The findings demonstrate significant change in service provision over 3 years in both control and intervention sites with great variability in both groups. The combined quantitative and qualitative findings indicate that targeted mutual peer review is associated with improved quality of care, improvements in service delivery and with changes within departments that promote and are precursors to quality improvement. The generic findings of this study have potential implications for the application of peer review throughout the NHS. © 2011 Blackwell Publishing Ltd.
Scope of Policy Issues in eHealth: Results From a Structured Literature Review
Durrani, Hammad; Nayani, Parvez; Fahim, Ammad
2012-01-01
Background eHealth is widely used as a tool for improving health care delivery and information. However, distinct policies and strategies are required for its proper implementation and integration at national and international levels. Objective To determine the scope of policy issues faced by individuals, institutions, or governments in implementing eHealth programs. Methods We conducted a structured review of both peer-reviewed and gray literature from 1998–2008. A Medline search for peer-reviewed articles found 40 papers focusing on different aspects of eHealth policy. In addition, a Google search found 20 national- and international-level policy papers and documents. We reviewed these articles to extract policy issues and solutions described at different levels of care. Results The literature search found 99 policy issues related to eHealth. We grouped these issues under the following themes: (1) networked care, (2) interjurisdictional practice, (3) diffusion of eHealth/digital divide, (4) eHealth integration with existing systems, (5) response to new initiatives, (6) goal-setting for eHealth policy, (7) evaluation and research, (8) investment, and (9) ethics in eHealth. Conclusions We provide a list of policy issues that should be understood and addressed by policy makers at global, jurisdictional, and institutional levels, to facilitate smooth and reliable planning of eHealth programs. PMID:22343270
Pleban, Francis T; Oketope, Olutosin; Shrestha, Laxmi
2017-12-01
A review study was conducted to examine the adverse effects of styrene, styrene mixtures, or styrene and/or styrene mixtures and noise on the auditory system in humans employed in occupational settings. The search included peer-reviewed articles published in English language involving human volunteers spanning a 25-year period (1990-2015). Studies included peer review journals, case-control studies, and case reports. Animal studies were excluded. An initial search identified 40 studies. After screening for inclusion, 13 studies were retrieved for full journal detail examination and review. As a whole, the results range from no to mild associations between styrene exposure and auditory dysfunction, noting relatively small sample sizes. However, four studies investigating styrene with other organic solvent mixtures and noise suggested combined exposures to both styrene organic solvent mixtures may be more ototoxic than exposure to noise alone. There is little literature examining the effect of styrene on auditory functioning in humans. Nonetheless, findings suggest public health professionals and policy makers should be made aware of the future research needs pertaining to hearing impairment and ototoxicity from styrene. It is recommended that chronic styrene-exposed individuals be routinely evaluated with a comprehensive audiological test battery to detect early signs of auditory dysfunction.
Moore, Ellie; Lawn, Sharon; Oster, Candice; Morello, Andrea
2017-01-01
Objectives Review the evidence for the effectiveness of chronic condition self-management programs applied to Aboriginal and Torres Strait Islander Peoples. Methods A rapid review methodology was followed to develop an evidence summary from peer-reviewed and grey literature. Results Only seven peer-reviewed studies were identified. The evidence indicated that group programs, particularly the Stanford Program, and structured individual chronic condition self-management programs were of good quality for Aboriginal and Torres Strait Islander Peoples, although these need to be integrated into practice in order to see the greatest benefits. The Flinders Program showed promise as a standardised program with content designed specifically with and for these populations. Numerous grey literature sources were identified, many using strong participatory approaches developed locally within Aboriginal and Torres Strait Islander Peoples. However, few of these programs have been subject to rigorous evaluation. Discussion Despite the significant focus on chronic condition self-management programs to help address the burden of disease for Aboriginal and Torres Strait Islander Peoples, few studies exist that have been properly evaluated. The Closing the Gap Principles developed by the Australian Institute of Health and Welfare offer important guidance for how to proceed to maximise engagement, cultural appropriateness and ownership of program initiatives.
Cabassa, Leopoldo J; Camacho, David; Vélez-Grau, Carolina M; Stefancic, Ana
2017-01-01
Health interventions delivered by peer specialists or co-facilitated by peer specialists and health professionals can help improve the physical health of people with serious mental illness (SMI). Yet, the quality of the studies examining these health interventions and their impact on health outcomes remains unclear. To address this gap, we conducted a systematic literature review of peer-based health interventions for people with SMI. We rated the methodological quality of studies, summarized intervention strategies and health outcomes, and evaluated the inclusion of racial and ethnic minorities in these studies. We used the Preferred Reporting Items for Systematic Review and Meta-Analysis guidelines to conduct our systematic literature review. Electronic bibliographic databases and manual searches were used to locate articles that were published in English in peer-reviewed journals between 1990 and 2015, described peer-based health interventions for people with SMI, and evaluated the impact of the interventions on physical health outcomes. Two independent reviewers used a standardized instrument to rate studies' methodological quality, abstracted study characteristics, and evaluated the effects of the interventions on different health outcomes. Eighteen articles were reviewed. Findings indicated that the strength of the evidence generated from these studies is limited due to several methodological limitations. Mixed and limited intervention effects were reported for most health outcomes. The most promising interventions were self-management and peer-navigator interventions. Efforts to strengthen the evidence of peer-based interventions require a research agenda that focuses on establishing the efficacy and effectiveness of these interventions across different populations and settings. Copyright © 2016 Elsevier Ltd. All rights reserved.
IRIS Toxicological Review of Trimethylbenzenes (Interagency Science Consultation Draft)
On June 26, 2012, the draft Toxicological Review of Trimethylbenzenes and the draft charge to external peer reviewers were released for external peer review and public comment. The Toxicological Review and charge were reviewed internally by EPA and by other federal agencies and W...
IRIS Toxicological Review of Trichloroethylene (Interagency Science Consultation Draft)
On November 3, 2009, the Toxicological Review of Trichloroethylene and the charge to external peer reviewers were released for external peer review and public comment. The Toxicological Review and charge were reviewed internally by EPA and by other federal agencies and White Hous...
IRIS Toxicological Review of Formaldehyde (Interagency Science Consultation Draft)
On June 2, 2010, the Toxicological Review of Formaldehyde and the charge to external peer reviewers were released for external peer review and public comment. The Toxicological Review and charge were reviewed internally by EPA and by other federal agencies and White House Offices...
IRIS Toxicological Review of Biphenyl (Interagency Science Consultation Draft)
On September 30, 2011, the draft Toxicological Review of Biphenyl and the charge to external peer reviewers were released for external peer review and public comment. The Toxicological Review and charge were reviewed internally by EPA and by other federal agencies and White House...
IRIS Toxicological Review of Acrylonitrile (Interagency Science Consultation Draft)
On June 30, 2011, the draft Toxicological Review of Acrylonitrile and the charge to external peer reviewers were released for external peer review and public comment. The Toxicological Review and charge were reviewed internally by EPA and by other federal agencies and White House...
Leung, Rachel K; Toumbourou, John W; Hemphill, Sheryl A
2014-01-01
Adolescent alcohol use remains an important public health concern. One of the most salient and consistent predictors for drinking behaviour among young people is peer influence. A systematic review of longitudinal studies that examined the effect of peer influence on adolescent alcohol use between January 1997 and February 2011 is presented. Twenty-two studies fulfilled inclusion criteria and were reviewed. All but one study confirmed affiliation with alcohol-using or deviant peers as prospective predictors for the development of adolescent alcohol use. Findings revealed that existing longitudinal studies that have used multivariate analytic techniques to segregate peer influence (whereby adolescents start drinking after exposure to alcohol-using friends) and peer selection (whereby adolescents that start drinking without alcohol-using friends subsequently seek out drinking peers) effects consistently report significant peer influence effects. However, studies are unable to elucidate the relative contribution and developmental sequence of peer influence and selection. Existing research is synthesised to model the developmental influence of peer processes on adolescent alcohol use. Future research directions are recommended to inform better designed investigations that can lead to more effective endeavours to address peer processes in prevention efforts.
First CytoJournal Peer-Reviewer's Retreat in 2006 – Open access, peer-review, and impact factor
Shidham, Vinod B; Sandweiss, Lynn; Atkinson, Barbara F
2006-01-01
CytoJournal organized its first Peer-Reviewer's Retreat of 2006 during the United States and Canadian Academy of Pathology Annual Meeting at Atlanta on Feb 12, 2006. The major topics discussed were open access, peer review, and impact factors. Representative participants volunteered to join the task force to prepare an instructional guide for peer-reviewing cytopathology manuscripts. Concern about the impact factor for CytoJournal was discussed. A feedback to its readers and authors was recommended. Impact factor calculation needs at least three years of journal statistics. It is only possible after two years from the time a journal is first accepted by Thomson-ISI for citation tracking. CytoJournal is still too new for an impact factor to be calculated. However, general progress of CytoJournal suggests an encouraging pattern for high impact factor. PMID:16566816
Medical students as peer tutors: a systematic review
2014-01-01
Background While Peer Assisted Learning (PAL) has long occurred informally in medical education, in the past ten years, there has been increasing international interest in formally organised PAL, with many benefits for both the students and institutions. We conducted a systematic review of the literature to establish why and how PAL has been implemented, focussing on the recruitment and training process for peer tutors, the benefits for peer tutors, and the competency of peer tutors. Method A literature search was conducted in three electronic databases. Selection of titles and abstracts were made based on pre-determined eligibility criteria. We utilized the ‘AMEE Peer assisted learning: a planning and implementation framework: AMEE Guide no. 30’ to assist us in establishing the review aims in a systematic review of the literature between 2002 and 2012. Six key questions were developed and used in our analysis of particular aspects of PAL programs within medical degree programs. Results We found nineteen articles that satisfied our inclusion criteria. The PAL activities fell into three broad categories of teacher training, peer teaching and peer assessment. Variability was found in the reporting of tutor recruitment and training processes, tutor outcomes, and tutor competencies. Conclusion Results from this review suggest that there are many perceived learning benefits for student tutors. However, there were mixed results regarding the accuracy of peer assessment and feedback, and no substantial evidence to conclude that participation as a peer tutor improves one’s own examination performance. Further research into PAL in medicine is required if we are to better understand the relative impact and benefits for student tutors. PMID:24912500
NASA Astrophysics Data System (ADS)
Gold, A. U.; Ledley, T. S.; McCaffrey, M. S.; Buhr, S. M.; Manduca, C. A.; Niepold, F.; Fox, S.; Howell, C. D.; Lynds, S. E.
2010-12-01
The topic of climate change permeates all aspects of our society: the news, household debates, scientific conferences, etc. To provide students with accurate information about climate science and energy awareness, educators require scientifically and pedagogically robust teaching materials. To address this need, the NSF-funded Climate Literacy & Energy Awareness Network (CLEAN) Pathway has assembled a new peer-reviewed digital collection as part of the National Science Digital Library (NSDL) featuring teaching materials centered on climate and energy science for grades 6 through 16. The scope and framework of the collection is defined by the Essential Principles of Climate Science (CCSP 2009) and a set of energy awareness principles developed in the project. The collection provides trustworthy teaching materials on these socially relevant topics and prepares students to become responsible decision-makers. While a peer-review process is desirable for curriculum developer as well as collection builder to ensure quality, its implementation is non-trivial. We have designed a rigorous and transparent peer-review process for the CLEAN collection, and our experiences provide general guidelines that can be used to judge the quality of digital teaching materials across disciplines. Our multi-stage review process ensures that only resources with teaching goals relevant to developing climate literacy and energy awareness are considered. Each relevant resource is reviewed by two individuals to assess the i) scientific accuracy, ii) pedagogic effectiveness, and iii) usability/technical quality. A science review by an expert ensures the scientific quality and accuracy. Resources that pass all review steps are forwarded to a review panel of educators and scientists who make a final decision regarding inclusion of the materials in the CLEAN collection. Results from the first panel review show that about 20% (~100) of the resources that were initially considered for inclusion passed final review. Reviewer comments are recorded as annotations to enhance the resources in the collection and help educators with the implementation in their curriculum. CLEAN launched the first collection of digital educational resources about climate science and energy awareness in November 2010. The final CLEAN collection will include ≥500 resources and will also provide the alignment with the Benchmarks for Science Literacy and the NAAEE Excellence in Environmental Education Guidelines for Learning through the interactive NSDL strandmaps. We will present the first user feedback to this new collection.
Family Studies of Sensorimotor and Neurocognitive Heterogeneity in Autism Spectrum Disorders
2014-11-01
understanding the role of the cerebellum in this disorder. b. Peer-Reviewed Scientific Journals: Wang Z, Magnon GC, White SP, Greene RK, Vaillancourt DE...cortico-cerebellar abnormalities in autism spectrum disorder.Society for Neuroscience (SfN); (2014; November). Washington, DC. Wang Z, Magnon GC, Greene RK... Magnon GC, Greene RK, Vaillancourt DE, Mosconi MW. (in press). Individuals with autism spectrum disorder (ASD) show abnormalities during initial impulse
Successfully Coaching Nursing Staff to Publish Outcomes.
Kooker, Barbara Molina; Latimer, Renee; Mark, Debra D
2015-12-01
There is a need for bedside nurses to disseminate the results of evidence-based practice quality initiatives to a wider audience through publications in peer-reviewed journals. Barriers to publication are common and include lack of time, skills, experience, confidence, and tangible support. This article describes the structured approach, timeline, writing activities, and coaching guidance used to support the publication of 12 quality improvement articles in 1 nursing journal.
ERIC Educational Resources Information Center
Li, Weidong; Xiang, Ping; Gao, Zan; Shen, Bo; Yin, Zhihua; Kong, Qingtao
2016-01-01
Purpose: This study examined the impact of published national physical activity (PA) and health guidelines, documents, and initiatives on the evolution of research on teaching K-12 physical education (PE) in U.S.A. from 1996 to October 2013. Methods: A total of 262 peer-reviewed, data-based journal articles meeting our inclusion and exclusion…
ACM TOMS replicated computational results initiative
Heroux, Michael Allen
2015-06-03
In this study, the scientific community relies on the peer review process for assuring the quality of published material, the goal of which is to build a body of work we can trust. Computational journals such as The ACM Transactions on Mathematical Software (TOMS) use this process for rigorously promoting the clarity and completeness of content, and citation of prior work. At the same time, it is unusual to independently confirm computational results.
48 CFR 201.170 - Peer Reviews.
Code of Federal Regulations, 2011 CFR
2011-10-01
... Section 201.170 Federal Acquisition Regulations System DEFENSE ACQUISITION REGULATIONS SYSTEM, DEPARTMENT... Peer Reviews, the military departments, defense agencies, and DoD field activities shall provide a... departments, defense agencies, and DoD field activities shall establish procedures for— (1) Pre-award Peer...
48 CFR 201.170 - Peer Reviews.
Code of Federal Regulations, 2010 CFR
2010-10-01
... Section 201.170 Federal Acquisition Regulations System DEFENSE ACQUISITION REGULATIONS SYSTEM, DEPARTMENT... Peer Reviews, the military departments, defense agencies, and DoD field activities shall provide a... departments, defense agencies, and DoD field activities shall establish procedures for— (1) Pre-award Peer...