Independent Research Projects in General Chemistry Classes as an Introduction to Peer-Reviewed Literature

ERIC Educational Resources Information Center

Tribe, Lorena; Cooper, Evan L.

2008-01-01

A well-structured independent literature research project with a poster session was used to introduce students to peer-reviewed literature in a general chemistry course. Overall, students reported an enhanced appreciation of the course due to performing research at some level, using peer-reviewed literature, and presenting their results in a…

Redefining the Practice of Peer Review Through Intelligent Automation-Part 3: Automated Report Analysis and Data Reconciliation.

PubMed

Reiner, Bruce I

2018-02-01

One method for addressing existing peer review limitations is the assignment of peer review cases on a completely blinded basis, in which the peer reviewer would create an independent report which can then be cross-referenced with the primary reader report of record. By leveraging existing computerized data mining techniques, one could in theory automate and objectify the process of report data extraction, classification, and analysis, while reducing time and resource requirements intrinsic to manual peer review report analysis. Once inter-report analysis has been performed, resulting inter-report discrepancies can be presented to the radiologist of record for review, along with the option to directly communicate with the peer reviewer through an electronic data reconciliation tool aimed at collaboratively resolving inter-report discrepancies and improving report accuracy. All associated report and reconciled data could in turn be recorded in a referenceable peer review database, which provides opportunity for context and user-specific education and decision support.

Peer review in forensic science.

PubMed

Ballantyne, Kaye N; Edmond, Gary; Found, Bryan

2017-08-01

Peer review features prominently in the forensic sciences. Drawing on recent research and studies, this article examines different types of peer review, specifically: editorial peer review; peer review by the scientific community; technical and administrative review; and verification (and replication). The article reviews the different meanings of these quite disparate activities and their utility in relation to enhancing performance and reducing error. It explains how forensic practitioners should approach and use peer review, as well as how it should be described in expert reports and oral testimony. While peer review has considerable potential, and is a key component of modern quality management systems, its actual value in most forensic science settings has yet to be determined. In consequence, forensic practitioners should reflect on why they use specific review procedures and endeavour to make their actual practices and their potential value transparent to consumers; whether investigators, lawyers, jurors or judges. Claims that review increases the validity of a scientific technique or accuracy of opinions within a particular case should be avoided until empirical evidence is available to support such assertions. Copyright © 2017 Elsevier B.V. All rights reserved.

Is Peer Review an Appropriate Form of Assessment in a MOOC? Student Participation and Performance in Formative Peer Review

ERIC Educational Resources Information Center

Meek, Sarah E. M.; Blakemore, Louise; Marks, Leah

2017-01-01

Many aspects of higher education must be reconceptualised for massive open online courses (MOOCs). Formative and summative assessment of qualitative work in particular requires novel approaches to cope with the numbers involved. Peer review has been proposed as one solution, and has been widely adopted by major MOOC providers, but there is…

Associations between Peer Victimization and Academic Performance

ERIC Educational Resources Information Center

Espelage, Dorothy L.; Hong, Jun Sung; Rao, Mrinalini A.; Low, Sabina

2013-01-01

This article reviews the extant literature on the links between peer victimization and academic performance and engagement among children and adolescents. Although most of the research on this association is based on cross-sectional investigations, research using longitudinal designs is starting to point to the fact that peer victimization does…

The Global Burden of Journal Peer Review in the Biomedical Literature: Strong Imbalance in the Collective Enterprise.

PubMed

Kovanis, Michail; Porcher, Raphaël; Ravaud, Philippe; Trinquart, Ludovic

2016-01-01

The growth in scientific production may threaten the capacity for the scientific community to handle the ever-increasing demand for peer review of scientific publications. There is little evidence regarding the sustainability of the peer-review system and how the scientific community copes with the burden it poses. We used mathematical modeling to estimate the overall quantitative annual demand for peer review and the supply in biomedical research. The modeling was informed by empirical data from various sources in the biomedical domain, including all articles indexed at MEDLINE. We found that for 2015, across a range of scenarios, the supply exceeded by 15% to 249% the demand for reviewers and reviews. However, 20% of the researchers performed 69% to 94% of the reviews. Among researchers actually contributing to peer review, 70% dedicated 1% or less of their research work-time to peer review while 5% dedicated 13% or more of it. An estimated 63.4 million hours were devoted to peer review in 2015, among which 18.9 million hours were provided by the top 5% contributing reviewers. Our results support that the system is sustainable in terms of volume but emphasizes a considerable imbalance in the distribution of the peer-review effort across the scientific community. Finally, various individual interactions between authors, editors and reviewers may reduce to some extent the number of reviewers who are available to editors at any point.

The Global Burden of Journal Peer Review in the Biomedical Literature: Strong Imbalance in the Collective Enterprise

PubMed Central

Porcher, Raphaël; Ravaud, Philippe; Trinquart, Ludovic

2016-01-01

The growth in scientific production may threaten the capacity for the scientific community to handle the ever-increasing demand for peer review of scientific publications. There is little evidence regarding the sustainability of the peer-review system and how the scientific community copes with the burden it poses. We used mathematical modeling to estimate the overall quantitative annual demand for peer review and the supply in biomedical research. The modeling was informed by empirical data from various sources in the biomedical domain, including all articles indexed at MEDLINE. We found that for 2015, across a range of scenarios, the supply exceeded by 15% to 249% the demand for reviewers and reviews. However, 20% of the researchers performed 69% to 94% of the reviews. Among researchers actually contributing to peer review, 70% dedicated 1% or less of their research work-time to peer review while 5% dedicated 13% or more of it. An estimated 63.4 million hours were devoted to peer review in 2015, among which 18.9 million hours were provided by the top 5% contributing reviewers. Our results support that the system is sustainable in terms of volume but emphasizes a considerable imbalance in the distribution of the peer-review effort across the scientific community. Finally, various individual interactions between authors, editors and reviewers may reduce to some extent the number of reviewers who are available to editors at any point. PMID:27832157

A Descriptive Study of Nursing Peer-Review Programs in US Magnet® Hospitals.

PubMed

Roberts, Holli; Cronin, Sherill Nones

2017-04-01

The goal of this study was to assess the types of nursing peer review (NPR) programs in US Magnet® organizations. The 2 most predominant models of NPR programs in the literature are performance evaluation and clinical peer review. The literature on clinical peer review is primarily descriptive, outlining structures and anecdotal outcomes. Participants from hospitals holding Magnet recognition were selected using a stratified random-sampling method. A survey developed by the researchers assessed the presence of NPR. If clinical NPR was in place, program design, evaluation measurements, and barriers were explored. Findings suggest wide variability in NPR models. More than one-third of the respondents conduct peer evaluation as the only mechanism of NPR. Most hospitals with a clinical peer-review program reported a case review structure and process measurements not supported by data. The variations noted in this study suggest more research is needed to measure the effectiveness of NPR models and associated outcomes.

Evaluating the Pros and Cons of Different Peer Review Policies via Simulation.

PubMed

Zhu, Jia; Fung, Gabriel; Wong, Wai Hung; Li, Zhixu; Xu, Chuanhua

2016-08-01

In the academic world, peer review is one of the major processes in evaluating a scholars contribution. In this study, we are interested in quantifying the merits of different policies in a peer review process, such as single-blind review, double-blind review, and obtaining authors feedback. Currently, insufficient work has been undertaken to evaluate the benefits of different peer review policies. One of the major reasons for this situation is the inability to conduct any empirical study because data are presently unavailable. In this case, a computer simulation is one of the best ways to conduct a study. We perform a series of simulations to study the effects of different policies on a peer review process. In this study, we focus on the peer review process of a typical computer science conference. Our results point to the crucial role of program chairs in determining the quality and diversity of the articles to be accepted for publication. We demonstrate the importance of discussion among reviewers, suggest circumstances in which the double-blind review policy should be adopted, and question the credibility of the authors feedback mechanism. Finally, we stress that randomness plays an important role in the peer review process, and this role cannot be eliminated. Although our model may not capture every component of a peer review process, it covers some of the most essential elements. Thus, even the simulation results clearly cannot be taken as literal descriptions of an actual peer review process. However, we can at least still use them to identify alternative directions for future study.

Development of a peer-review framework for cancer multidisciplinary meetings.

PubMed

Johnson, Claire E; Slavova-Azmanova, Neli; Saunders, Christobel

2017-05-01

There is no mechanism in place for monitoring or quality improvement of cancer multidisciplinary meetings (MDM) in Australia. To develop a peer-review process for quality improvement of MDM. This project involved three phases: (i) development of a draft peer-review framework, supporting documents and peer-review process; (ii) consultation with key stakeholders; (iii) refinement of the framework, documents and processes following a pilot study with three MDM. Feedback indicated that specific standards included in the framework needed to allow the peer reviewers to be flexible relative to the circumstances of the individual MDM. Conversely, feedback identified the need for clear, evidence-based clinical practice guidelines for the conduct of MDM, with accepted standards and objective measures of performance. MDM members were divided about the need to employ peer reviewers from the tumour stream of the MDM under review but agreed that closer involvement of the team under review to support the implementation of recommendations is warranted. We developed an adaptable peer-review framework and process using the current available evidence and guidance. While further research is needed to establish what constitutes best practice in MDM and which processes contribute to improved patient outcomes, the structured peer-review process we describe, when modified using the disease-relevant evidence, could be utilised more broadly as a quality improvement tool. © 2017 Royal Australasian College of Physicians.

Citation Ranking versus Peer Evaluation of Senior Faculty Research Performance: A Case Study of Kurdish Scholarship.

ERIC Educational Resources Information Center

Meho, Lokman I.; Sonnenwald, Diane H.

2000-01-01

Analyzes the relationship between citation ranking and peer evaluation in assessing senior faculty research performance. Describes a study of faculty specializing in Kurdish studies that investigated to what degree citation ranking correlates with data from citation content analysis, book reviews, and peer ranking. (Contains 72 references.)…

Peer video review and feedback improve performance in basic surgical skills.

PubMed

Vaughn, Carolyn J; Kim, Edward; O'Sullivan, Patricia; Huang, Emily; Lin, Matthew Y C; Wyles, Susannah; Palmer, Barnard J A; Pierce, Jonathan L; Chern, Hueylan

2016-02-01

Incorporation of home-video assessments allows flexibility in feedback but requires faculty time. Peer feedback (PF) may provide additional benefits while avoiding these constraints. Twenty-four surgical interns completed a 12-week skills curriculum with home-video assignments focused on knot tying and suturing. Interns were randomized into 2 groups: PF or faculty feedback (FF). Peers and faculty provided feedback on home videos with checklists, global rating, and comments. Learners' skills were assessed at baseline, during, and at the conclusion of the curriculum. Performance of the 2 groups as rated by experts was compared. FF and PF were compared. Both groups improved from baseline, and the highest rated scores were seen on their home-video assessments. The PF group performed better at the final assessment than the FF group (effect size, .84). When using a checklist, there was no significant difference between scores given by peers and faculty. The PF group performed better at the final assessment, suggesting reviewing and analyzing another's performance may improve one's own performance. With checklists as guidance, peers can serve as raters comparable to faculty. Copyright © 2016 Elsevier Inc. All rights reserved.

JOURNAL CLUB: Assessment of Interobserver Variability in the Peer Review Process: Should We Agree to Disagree?

PubMed

Verma, Nupur; Hippe, Daniel S; Robinson, Jeffrey D

2016-12-01

Peer review is an important and necessary part of radiology. There are several options to perform the peer review process. This study examines the reproducibility of peer review by comparing two scoring systems. American Board of Radiology-certified radiologists from various practice environments and subspecialties were recruited to score deidentified examinations on a web-based PACS with two scoring systems, RADPEER and Cleareview. Quantitative analysis of the scores was performed for interrater agreement. Interobserver variability was high for both the RADPEER and Cleareview scoring systems. The interobserver correlations (kappa values) were 0.17-0.23 for RADPEER and 0.10-0.16 for Cleareview. Interrater correlation was not statistically significantly different when comparing the RADPEER and Cleareview systems (p = 0.07-0.27). The kappa values were low for the Cleareview subscores when we evaluated for missed findings (0.26), satisfaction of search (0.17), and inadequate interpretation of findings (0.12). Our study confirms the previous report of low interobserver correlation when using the peer review process. There was low interobserver agreement seen when using both the RADPEER and the Cleareview scoring systems.

A Peer-Reviewed Research Assignment for Large Classes.

ERIC Educational Resources Information Center

Henderson, LaRhee; Buising, Charisse

2000-01-01

Introduces a writing exercise students work on in collaborative groups. Aims to enhance students' scientific research paper writing skills and provide experience working in collaborative groups. Presents evaluation criteria for peer-group evaluation of a poster presentation, intra-group evaluation of peer performance, and peer-group evaluation of…

A peer review process as part of the implementation of clinical pathways in radiation oncology: Does it improve compliance?

PubMed

Gebhardt, Brian J; Heron, Dwight E; Beriwal, Sushil

Clinical pathways are patient management plans that standardize evidence-based practices to ensure high-quality and cost-effective medical care. Implementation of a pathway is a collaborative process in our network, requiring the active involvement of physicians. This approach promotes acceptance of pathway recommendations, although a peer review process is necessary to ensure compliance and to capture and approve off-pathway selections. We investigated the peer review process and factors associated with time to completion of peer review. Our cancer center implemented radiation oncology pathways for every disease site throughout a large, integrated network. Recommendations are written based upon national guidelines, published literature, and institutional experience with evidence evaluated hierarchically in order of efficacy, toxicity, and then cost. Physicians enter decisions into an online, menu-driven decision support tool that integrates with medical records. Data were collected from the support tool and included the rate of on- and off-pathway selections, peer review decisions performed by disease site directors, and time to complete peer review. A total of 6965 treatment decisions were entered in 2015, and 605 (8.7%) were made off-pathway and were subject to peer review. The median time to peer review decision was 2 days (interquartile range, 0.2-6.8). Factors associated with time to peer review decision >48 hours on univariate analysis include disease site (P < .0001) with a trend toward significance (P = .066) for radiation therapy modality. There was no difference between recurrent and non-recurrent disease (P = .267). Multivariable analysis revealed disease site was associated with time to peer review (P < .001), with lymphoma and skin/sarcoma most strongly influencing decision time >48 hours. Clinical pathways are an integral tool for standardizing evidence-based care throughout our large, integrated network, with 91.3% of all treatment decisions being made as per pathway. The peer review process was feasible, with <1% selections ultimately rejected, suggesting that awareness of peer review of treatment decisions encourages compliance with clinical pathway recommendations. Copyright © 2017 American Society for Radiation Oncology. Published by Elsevier Inc. All rights reserved.

Peer tutoring programs in health professions schools.

PubMed

Santee, Jennifer; Garavalia, Linda

2006-06-15

Peer tutoring programs may be one method of maintaining quality of pharmacy education in the face of growing student enrollment and a small faculty body. A critical review of the literature was performed to ascertain whether peer tutoring programs improve or maintain the academic performance of health care professional students. Various electronic databases and abstracts from past American Association of Colleges of Pharmacy's annual meetings were searched to identify pertinent research. Only those articles with quantitative data, an experimental design, and comparative statistical analysis were included for review. Most studies found that peer tutoring had a positive impact on academic performance. These results may not be readily generalizable as there were numerous methodological flaws and limited descriptions of the programs and participants. Studies with better designs and more detail are needed to answer definitively whether peer tutoring is of benefit. Details of what resources were required should be included in the study to allow the reader to determine the feasibility of the intervention.

Peer Tutoring Programs in Health Professions Schools

PubMed Central

Garavalia, Linda

2006-01-01

Objective Peer tutoring programs may be one method of maintaining quality of pharmacy education in the face of growing student enrollment and a small faculty body. A critical review of the literature was performed to ascertain whether peer tutoring programs improve or maintain the academic performance of health care professional students. Methods Various electronic databases and abstracts from past American Association of Colleges of Pharmacy's annual meetings were searched to identify pertinent research. Only those articles with quantitative data, an experimental design, and comparative statistical analysis were included for review. Results Most studies found that peer tutoring had a positive impact on academic performance. These results may not be readily generalizable as there were numerous methodological flaws and limited descriptions of the programs and participants. Implications Studies with better designs and more detail are needed to answer definitively whether peer tutoring is of benefit. Details of what resources were required should be included in the study to allow the reader to determine the feasibility of the intervention. PMID:17136190

The learner as co-creator: A new peer review and self-assessment feedback form created by student nurses.

PubMed

Duers, Lorraine E

2017-11-01

Engagement with peer review and self-assessment is not always regarded by student nurses as an activity that results in a positive learning experience. Literature indicates that withdrawal from the learning process becomes attractive to individuals affected by a negative experience of peer review. Literature also provides examples of student nurses' feeling 'torn to shreds' during the process of peer review, resulting in loss of confidence and self-esteem. An influencing factor in such situations appears to be the absence of specific learner-driven criteria against which student nurses can assess peer and self-performance. The idea was thus ignited, that creation and utilisation of a learner-driven feedback form might potentially prevent, or at least minimise, the possibility of negative peer review experience. Set within the context of a pre-registration nursing programme, within a Higher Education institution, student nurses (n=25), created a peer review/self-assessment feedback form. Its potential cross-discipline, global applicability is reasonably speculated. Purposive sampling, followed by Stratified Random sampling, maximised participant variation. Data collection took place on 34 occasions, utilising focus group discussions using Nominal Group Technique, a practical task which was video recorded for mediating artefact purposes, and individual interviews. Analysis was concept and theme driven. The study found that participants desired a new feedback form that specifically asks the evaluator to judge human qualities, such as 'compassion' and 'kindness', in addition to the skills and knowledge criteria that any peer review or self-assessment form used currently had incorporated. Providing the participants with the opportunity to develop criteria, against which performance could be measured, with emphasis being afforded to student inclusivity and resultant shift in power balance from the educator to the learner, embraces the idea of teaching and learning in the 21st Century. Crown Copyright © 2017. Published by Elsevier Ltd. All rights reserved.

Predatory Journals, Peer Review, and Education Research

ERIC Educational Resources Information Center

Beall, Jeffrey

2017-01-01

This commentary examines the problem of predatory journals, low-quality open-access journals that seek to earn revenue from scholarly authors without following scholarly publishing best practices. Seeking to accept as many papers as possible, they typically do not perform a standard peer review, leading to the publication of improperly vetted…

A scoping review protocol on the roles and tasks of peer reviewers in the manuscript review process in biomedical journals.

PubMed

Glonti, Ketevan; Cauchi, Daniel; Cobo, Erik; Boutron, Isabelle; Moher, David; Hren, Darko

2017-10-22

The primary functions of peer reviewers are poorly defined. Thus far no body of literature has systematically identified the roles and tasks of peer reviewers of biomedical journals. A clear establishment of these can lead to improvements in the peer review process. The purpose of this scoping review is to determine what is known on the roles and tasks of peer reviewers. We will use the methodological framework first proposed by Arksey and O'Malley and subsequently adapted by Levac et al and the Joanna Briggs Institute. The scoping review will include all study designs, as well as editorials, commentaries and grey literature. The following eight electronic databases will be searched (from inception to May 2017): Cochrane Library, Cumulative Index to Nursing and Allied Health Literature, Educational Resources Information Center, EMBASE, MEDLINE, PsycINFO, Scopus and Web of Science. Two reviewers will use inclusion and exclusion criteria based on the 'Population-Concept-Context' framework to independently screen titles and abstracts of articles considered for inclusion. Full-text screening of relevant eligible articles will also be carried out by two reviewers. The search strategy for grey literature will include searching in websites of existing networks, biomedical journal publishers and organisations that offer resources for peer reviewers. In addition we will review journal guidelines to peer reviewers on how to perform the manuscript review. Journals will be selected using the 2016 journal impact factor. We will identify and assess the top five, middle five and lowest-ranking five journals across all medical specialties. This scoping review will undertake a secondary analysis of data already collected and does not require ethical approval. The results will be disseminated through journals and conferences targeting stakeholders involved in peer review in biomedical research. © Article author(s) (or their employer(s) unless otherwise stated in the text of the article) 2017. All rights reserved. No commercial use is permitted unless otherwise expressly granted.

Online physician ratings fail to predict actual performance on measures of quality, value, and peer review.

PubMed

Daskivich, Timothy J; Houman, Justin; Fuller, Garth; Black, Jeanne T; Kim, Hyung L; Spiegel, Brennan

2018-04-01

Patients use online consumer ratings to identify high-performing physicians, but it is unclear if ratings are valid measures of clinical performance. We sought to determine whether online ratings of specialist physicians from 5 platforms predict quality of care, value of care, and peer-assessed physician performance. We conducted an observational study of 78 physicians representing 8 medical and surgical specialties. We assessed the association of consumer ratings with specialty-specific performance scores (metrics including adherence to Choosing Wisely measures, 30-day readmissions, length of stay, and adjusted cost of care), primary care physician peer-review scores, and administrator peer-review scores. Across ratings platforms, multivariable models showed no significant association between mean consumer ratings and specialty-specific performance scores (β-coefficient range, -0.04, 0.04), primary care physician scores (β-coefficient range, -0.01, 0.3), and administrator scores (β-coefficient range, -0.2, 0.1). There was no association between ratings and score subdomains addressing quality or value-based care. Among physicians in the lowest quartile of specialty-specific performance scores, only 5%-32% had consumer ratings in the lowest quartile across platforms. Ratings were consistent across platforms; a physician's score on one platform significantly predicted his/her score on another in 5 of 10 comparisons. Online ratings of specialist physicians do not predict objective measures of quality of care or peer assessment of clinical performance. Scores are consistent across platforms, suggesting that they jointly measure a latent construct that is unrelated to performance. Online consumer ratings should not be used in isolation to select physicians, given their poor association with clinical performance.

Barriers and attitudes influencing non-engagement in a peer feedback model to inform evidence for GP appraisal

PubMed Central

2012-01-01

Background The UK general practitioner (GP) appraisal system is deemed to be an inadequate source of performance evidence to inform a future medical revalidation process. A long-running voluntary model of external peer review in the west of Scotland provides feedback by trained peers on the standard of GP colleagues' core appraisal activities and may 'add value' in strengthening the robustness of the current system in support of revalidation. A significant minority of GPs has participated in the peer feedback model, but a clear majority has yet to engage with it. We aimed to explore the views of non-participants to identify barriers to engagement and attitudes to external peer review as a means to inform the current appraisal system. Methods We conducted semi-structured interviews with a sample of west of Scotland GPs who had yet to participate in the peer review model. A thematic analysis of the interview transcriptions was conducted using a constant comparative approach. Results 13 GPs were interviewed of whom nine were males. Four core themes were identified in relation to the perceived and experienced 'value' placed on the topics discussed and their relevance to routine clinical practice and professional appraisal: 1. Value of the appraisal improvement activity. 2. Value of external peer review. 3. Value of the external peer review model and host organisation and 4. Attitudes to external peer review. Conclusions GPs in this study questioned the 'value' of participation in the external peer review model and the national appraisal system over the standard of internal feedback received from immediate work colleagues. There was a limited understanding of the concept, context and purpose of external peer review and some distrust of the host educational provider. Future engagement with the model by these GPs is likely to be influenced by policy to improve the standard of appraisal and contractual related activities, rather than a self-directed recognition of learning needs. PMID:22443714

Barriers and attitudes influencing non-engagement in a peer feedback model to inform evidence for GP appraisal.

PubMed

Curnock, Esther; Bowie, Paul; Pope, Lindsey; McKay, John

2012-03-23

The UK general practitioner (GP) appraisal system is deemed to be an inadequate source of performance evidence to inform a future medical revalidation process. A long-running voluntary model of external peer review in the west of Scotland provides feedback by trained peers on the standard of GP colleagues' core appraisal activities and may 'add value' in strengthening the robustness of the current system in support of revalidation. A significant minority of GPs has participated in the peer feedback model, but a clear majority has yet to engage with it. We aimed to explore the views of non-participants to identify barriers to engagement and attitudes to external peer review as a means to inform the current appraisal system. We conducted semi-structured interviews with a sample of west of Scotland GPs who had yet to participate in the peer review model. A thematic analysis of the interview transcriptions was conducted using a constant comparative approach. 13 GPs were interviewed of whom nine were males. Four core themes were identified in relation to the perceived and experienced 'value' placed on the topics discussed and their relevance to routine clinical practice and professional appraisal: 1. Value of the appraisal improvement activity. 2. Value of external peer review. 3. Value of the external peer review model and host organisation and 4. Attitudes to external peer review. GPs in this study questioned the 'value' of participation in the external peer review model and the national appraisal system over the standard of internal feedback received from immediate work colleagues. There was a limited understanding of the concept, context and purpose of external peer review and some distrust of the host educational provider. Future engagement with the model by these GPs is likely to be influenced by policy to improve the standard of appraisal and contractual related activities, rather than a self-directed recognition of learning needs.

Radiologist Peer Review by Group Consensus.

PubMed

Harvey, H Benjamin; Alkasab, Tarik K; Prabhakar, Anand M; Halpern, Elkan F; Rosenthal, Daniel I; Pandharipande, Pari V; Gazelle, G Scott

2016-06-01

The objective of this study was to evaluate the feasibility of the consensus-oriented group review (COGR) method of radiologist peer review within a large subspecialty imaging department. This study was institutional review board approved and HIPAA compliant. Radiologist interpretations of CT, MRI, and ultrasound examinations at a large academic radiology department were subject to peer review using the COGR method from October 2011 through September 2013. Discordance rates and sources of discordance were evaluated on the basis of modality and division, with group differences compared using a χ(2) test. Potential associations between peer review outcomes and the time after the initiation of peer review or the number of radiologists participating in peer review were tested by linear regression analysis and the t test, respectively. A total of 11,222 studies reported by 83 radiologists were peer reviewed using COGR during the two-year study period. The average radiologist participated in 112 peer review conferences and had 3.3% of his or her available CT, MRI and ultrasound studies peer reviewed. The rate of discordance was 2.7% (95% confidence interval [CI], 2.4%-3.0%), with significant differences in discordance rates on the basis of division and modality. Discordance rates were highest for MR (3.4%; 95% CI, 2.8%-4.1%), followed by ultrasound (2.7%; 95% CI, 2.0%-3.4%) and CT (2.4%; 95% CI, 2.0%-2.8%). Missed findings were the most common overall cause for discordance (43.8%; 95% CI, 38.2%-49.4%), followed by interpretive errors (23.5%; 95% CI, 18.8%-28.3%), dictation errors (19.0%; 95% CI, 14.6%-23.4%), and recommendation (10.8%; 95% CI, 7.3%-14.3%). Discordant cases, compared with concordant cases, were associated with a significantly greater number of radiologists participating in the peer review process (5.9 vs 4.7 participating radiologists, P < .001) and were significantly more likely to lead to an addendum (62.9% vs 2.7%, P < .0001). COGR permits departments to collect highly contextualized peer review data to better elucidate sources of error in diagnostic imaging reports, while reviewing a sufficient case volume to comply with external standards for ongoing performance review. Copyright © 2016 American College of Radiology. Published by Elsevier Inc. All rights reserved.

The value of 100% retrospective peer review in a forensic pathology practice.

PubMed

Obenson, Ken; Wright, Claire M

2013-11-01

Peer review in forensic pathology practice has become an important cornerstone of continuous quality improvement. Although there are several components to an effective and transparent peer review process, one of the most essential is the review of completed reports. The autopsy report may be reviewed prospectively (report reviewed before sign out) or retrospectively (report reviewed after sign out). Prospective reviews are more likely to be performed on criminal or criminally suspicious cases, pediatric and SIDS deaths and high profile cases. Retrospective reviews on the other hand are performed on a proportion of all other signed-out routine medico-legal cases. The actual percentage varies by jurisdiction since there are no agreed minimum standards. Manpower and workload factors appear to be critical to determining what percentage of cases are reviewed retrospectively. The objective of this report is to present a mechanism by which a 100% retrospective review policy has been implemented, how it integrates with quality management protocols, the outcomes of the reviews and what challenges remain to improve compliance with key quality indicators especially turn around time (TAT) statistics. Copyright © 2013 Elsevier Ltd and Faculty of Forensic and Legal Medicine. All rights reserved.

Peer Instruction: An Evaluation of Its Theory, Application, and Contribution

ERIC Educational Resources Information Center

Gok, Tolga; Gok, Ozge

2017-01-01

Many qualitative and quantitative studies performed on peer instruction based on interactive engagement method used in many different disciplines and courses were reviewed in the present study. The researchers examined the effects of peer instruction on students' cognitive skills (conceptual learning, problem solving, reasoning ability, etc.) and…

[Impact of quality measurement, transparency and peer review on in-hospital mortality - retrospective before-after study with 63 hospitals].

PubMed

Nimptsch, Ulrike; Peschke, Dirk; Mansky, Thomas

2016-10-01

In 2008 the 'Initiative Qualitätsmedizin' (initiative for quality in medical care, IQM) was established as a voluntary non-profit association of hospital providers of all kinds of ownership. Currently, about 350 hospitals from Germany and Switzerland participate in IQM. Member hospitals are committed to a quality strategy based on measuring outcome indicators using administrative data, peer review procedures to improve medical quality, and transparency by public reporting. This study aims to investigate whether voluntary implementation of this approach is associated with improvements in medical outcome. Within a retrospective before-after study 63 hospitals, which started to participate in IQM between 2009 and 2011, were monitored. In-hospital mortality in these hospitals was studied for 14 selected inpatient services in comparison to the German national average. The analyses examine whether in-hospital mortality declined after participation of the studied hospitals in IQM, independently of secular trends or deviations in case mix when compared to the national average, and whether such findings were associated with initial hospital performance or peer review procedures. Declining in-hospital mortality was observed in hospitals with initially subpar performance. These declines were statistically significant for treatment of myocardial infarction, heart failure, pneumonia, and septicemia. Similar, but statistically non-significant trends were observed for nine further treatments. Following peer-review procedures significant declines in in-hospital mortality were observed for treatments of myocardial infarction, heart failure, and pneumonia. Mortality declines after peer reviews regarding stroke, hip fracture and colorectal resection were not significant, and after peer reviews regarding mechanically ventilated patients no changes were observed. The results point to a positive impact of the quality approach applied by IQM on clinical outcomes. A more targeted selection of hospitals to be peer-reviewed might further enhance the impact of this approach. Copyright © 2016. Published by Elsevier GmbH.

Quality Control and Peer Review of Data Sets: Mapping Data Archiving Processes to Data Publication Requirements

NASA Astrophysics Data System (ADS)

Mayernik, M. S.; Daniels, M.; Eaker, C.; Strand, G.; Williams, S. F.; Worley, S. J.

2012-12-01

Data sets exist within scientific research and knowledge networks as both technical and non-technical entities. Establishing the quality of data sets is a multi-faceted task that encompasses many automated and manual processes. Data sets have always been essential for science research, but now need to be more visible as first-class scholarly objects at national, international, and local levels. Many initiatives are establishing procedures to publish and curate data sets, as well as to promote professional rewards for researchers that collect, create, manage, and preserve data sets. Traditionally, research quality has been assessed by peer review of textual publications, e.g. journal articles, conference proceedings, and books. Citation indices then provide standard measures of productivity used to reward individuals for their peer-reviewed work. Whether a similar peer review process is appropriate for assessing and ensuring the quality of data sets remains as an open question. How does the traditional process of peer review apply to data sets? This presentation will describe current work being done at the National Center for Atmospheric Research (NCAR) in the context of the Peer REview for Publication & Accreditation of Research Data in the Earth sciences (PREPARDE) project. PREPARDE is assessing practices and processes for data peer review, with the goal of developing recommendations. NCAR data management teams perform various kinds of quality assessment and review of data sets prior to making them publicly available. The poster will investigate how notions of peer review relate to the types of data review already in place at NCAR. We highlight the data set characteristics and management/archiving processes that challenge the traditional peer review processes by using a number of questions as probes, including: Who is qualified to review data sets? What formal and informal documentation is necessary to allow someone outside of a research team to review a data set? What data set review can be done pre-publication, and what must be done post-publication? What components of the data sets review processes can be automated, and what components will always require human expertise and evaluation?

Medical students as peer tutors: a systematic review

PubMed Central

2014-01-01

Background While Peer Assisted Learning (PAL) has long occurred informally in medical education, in the past ten years, there has been increasing international interest in formally organised PAL, with many benefits for both the students and institutions. We conducted a systematic review of the literature to establish why and how PAL has been implemented, focussing on the recruitment and training process for peer tutors, the benefits for peer tutors, and the competency of peer tutors. Method A literature search was conducted in three electronic databases. Selection of titles and abstracts were made based on pre-determined eligibility criteria. We utilized the ‘AMEE Peer assisted learning: a planning and implementation framework: AMEE Guide no. 30’ to assist us in establishing the review aims in a systematic review of the literature between 2002 and 2012. Six key questions were developed and used in our analysis of particular aspects of PAL programs within medical degree programs. Results We found nineteen articles that satisfied our inclusion criteria. The PAL activities fell into three broad categories of teacher training, peer teaching and peer assessment. Variability was found in the reporting of tutor recruitment and training processes, tutor outcomes, and tutor competencies. Conclusion Results from this review suggest that there are many perceived learning benefits for student tutors. However, there were mixed results regarding the accuracy of peer assessment and feedback, and no substantial evidence to conclude that participation as a peer tutor improves one’s own examination performance. Further research into PAL in medicine is required if we are to better understand the relative impact and benefits for student tutors. PMID:24912500

Performance results for a workstation-integrated radiology peer review quality assurance program.

PubMed

O'Keeffe, Margaret M; Davis, Todd M; Siminoski, Kerry

2016-06-01

To assess review completion rates, RADPEER score distribution, and sources of disagreement when using a workstation-integrated radiology peer review program, and to evaluate radiologist perceptions of the program. Retrospective review of prospectively collected data. Large private outpatient radiology practice. Radiologists (n = 66) with a mean of 16.0 (standard deviation, 9.2) years of experience. Prior studies and reports of cases being actively reported were randomly selected for peer review using the RADPEER scoring system (a 4-point scale, with a score of 1 indicating agreement and scores of 2-4 indicating increasing levels of disagreement). Assigned peer review completion rates, review scores, sources of disagreement and radiologist survey responses. Of 31 293 assigned cases, 29 044 (92.8%; 95% CI 92.5-93.1%) were reviewed. Discrepant scores (score = 2, 3 or 4) were given in 0.69% (95% CI 0.60-0.79%) of cases and clinically significant discrepancy (score = 3 or 4) was assigned in 0.42% (95% CI 0.35-0.50%). The most common cause of disagreement was missed diagnosis (75.2%; 95% CI 66.8-82.1%). By anonymous survey, 94% of radiologists felt that peer review was worthwhile, 90% reported that the scores they received were appropriate and 78% felt that the received feedback was valuable. Workstation-based peer review can increase completion rates and levels of radiologist acceptance while producing RADPEER scores similar to those previously reported. This approach may be one way to increase radiologist engagement in peer review quality assurance. © The Author 2016. Published by Oxford University Press in association with the International Society for Quality in Health Care; all rights reserved.

Does Peer Review of Radiation Plans Affect Clinical Care? A Systematic Review of the Literature

DOE Office of Scientific and Technical Information (OSTI.GOV)

Brunskill, Kelsey; Nguyen, Timothy K.; Boldt, R. Gabriel

Purpose: Peer review is a recommended component of quality assurance in radiation oncology; however, it is resource-intensive and its effect on patient care is not well understood. We conducted a systematic review of the published data to assess the reported clinical impact of peer review on radiation treatment plans. Methods and Materials: A systematic review of published English studies was performed in accordance with the PRISMA guidelines using the MEDLINE and EMBASE databases and abstracts published from major radiation oncology scientific meeting proceedings. For inclusion, the studies were required to report the effect of peer review on ≥1 element ofmore » treatment planning (eg, target volume or organ-at-risk delineation, dose prescription or dosimetry). Results: The initial search strategy identified 882 potentially eligible studies, with 11 meeting the inclusion criteria for full-text review and final analysis. Across a total of 11,491 patient cases, peer review programs led to modifications in a weighted mean of 10.8% of radiation treatment plans. Five studies differentiated between major and minor changes and reported weighted mean rates of change of 1.8% and 7.3%, respectively. The most common changes were related to target volume delineation (45.2% of changed plans), dose prescription or written directives (24.4%), and non-target volume delineation or normal tissue sparing (7.5%). Conclusions: Our findings suggest that peer review leads to changes in clinical care in approximately 1 of every 9 cases overall. This is similar to the reported rates of change in peer review studies from other oncology-related specialties, such as radiology and pathology.« less

Does Peer Review of Radiation Plans Affect Clinical Care? A Systematic Review of the Literature.

PubMed

Brunskill, Kelsey; Nguyen, Timothy K; Boldt, R Gabriel; Louie, Alexander V; Warner, Andrew; Marks, Lawrence B; Palma, David A

2017-01-01

Peer review is a recommended component of quality assurance in radiation oncology; however, it is resource-intensive and its effect on patient care is not well understood. We conducted a systematic review of the published data to assess the reported clinical impact of peer review on radiation treatment plans. A systematic review of published English studies was performed in accordance with the PRISMA guidelines using the MEDLINE and EMBASE databases and abstracts published from major radiation oncology scientific meeting proceedings. For inclusion, the studies were required to report the effect of peer review on ≥1 element of treatment planning (eg, target volume or organ-at-risk delineation, dose prescription or dosimetry). The initial search strategy identified 882 potentially eligible studies, with 11 meeting the inclusion criteria for full-text review and final analysis. Across a total of 11,491 patient cases, peer review programs led to modifications in a weighted mean of 10.8% of radiation treatment plans. Five studies differentiated between major and minor changes and reported weighted mean rates of change of 1.8% and 7.3%, respectively. The most common changes were related to target volume delineation (45.2% of changed plans), dose prescription or written directives (24.4%), and non-target volume delineation or normal tissue sparing (7.5%). Our findings suggest that peer review leads to changes in clinical care in approximately 1 of every 9 cases overall. This is similar to the reported rates of change in peer review studies from other oncology-related specialties, such as radiology and pathology. Copyright © 2016 Elsevier Inc. All rights reserved.

What do we know about grant peer review in the health sciences?

PubMed

Guthrie, Susan; Ghiga, Ioana; Wooding, Steven

2017-01-01

 Peer review decisions award >95% of academic medical research funding, so it is crucial to understand how well they work and if they could be improved.  This paper summarises evidence from 105 relevant papers identified through a literature search on the effectiveness and burden of peer review for grant funding.  There is a remarkable paucity of evidence about the overall efficiency of peer review for funding allocation, given its centrality to the modern system of science. From the available evidence, we can identify some conclusions around the effectiveness and burden of peer review. The strongest evidence around effectiveness indicates a bias against innovative research. There is also fairly clear evidence that peer review is, at best, a weak predictor of future research performance, and that ratings vary considerably between reviewers. There is some evidence of age bias and cronyism. Good evidence shows that the burden of peer review is high and that around 75% of it falls on applicants. By contrast, many of the efforts to reduce burden are focused on funders and reviewers/panel members.  We suggest funders should acknowledge, assess and analyse the uncertainty around peer review, even using reviewers' uncertainty as an input to funding decisions. Funders could consider a lottery element in some parts of their funding allocation process, to reduce both burden and bias, and allow better evaluation of decision processes. Alternatively, the distribution of scores from different reviewers could be better utilised as a possible way to identify novel, innovative research. Above all, there is a need for open, transparent experimentation and evaluation of different ways to fund research. This also requires more openness across the wider scientific community to support such investigations, acknowledging the lack of evidence about the primacy of the current system and the impossibility of achieving perfection.

Peer reviews: taking on new meanings.

PubMed

Raia, Lucille

2011-01-01

Peer reviews in nursing are historically used to gauge performance within an individual's scope of practice or as a tool to evaluate a sentinel or adverse event. Quality of care measures, clinical pertinence, and evaluating standards of care have begun as parallel strategies to replace the former uses in assuring the right care at the right time in the right setting.

Medicare program; description of the Health Care Financing Administration's evaluation methodology for the Peer Review Organization 5th Scope of Work contracts--HCFA. General notice with comment period.

PubMed

1997-07-02

This notice describes how HCFA intends to evaluate the Peer Review Organizations (PROs) for quality improvement activities, under their 5th Scope of Work (SOW) contracts, for efficiency and effectiveness in accordance with the Social Security Act. In accordance with the provisions of the Government Performance and Results Act of 1993, the 5th SOW contracts with the PROs are performance-based contracts.

Directly Improving the Quality of Radiation Treatment Through Peer Review: A Cross-sectional Analysis of Cancer Centers Across a Provincial Cancer Program.

PubMed

Rouette, Julie; Gutierrez, Eric; O'Donnell, Jennifer; Reddeman, Lindsay; Hart, Margaret; Foxcroft, Sophie; Mitera, Gunita; Warde, Padraig; Brundage, Michael D

2017-07-01

To describe the outcomes of peer review across all 14 cancer centers in Ontario. We identified all peer-reviewed, curative treatment plans delivered in Ontario within a 3-month study period from 2013 to 2014 using a provincial cancer treatment database and collected additional data on the peer-review outcomes. Considerable variation was found in the proportion of peer-reviewed plans across the centers (average 70.2%, range 40.8%-99.2%). During the study period, 5561 curative plans underwent peer review. Of those, 184 plans (3.3%) had changes recommended. Of the 184 plans, the changes were major (defined as requiring repeat planning or having a major effect on planning or clinical outcomes, or both) in 40.2% and minor in 47.8%. For the remaining 12.0%, data were missing. The proportions of recommended changes varied among disease sites (0.0%-7.0%). The disease sites with the most recommended changes to treatment plans after peer review and with the greatest potential for benefit were the esophagus (7.0%), uterus (6.7%), upper limb (6.3%), cervix and lower limb (both 6.0%), head and neck and bilateral lung (both 5.9%), right supraclavicular lymph nodes (5.7%), rectum (5.3%), and spine (5.0%). Although the heart is an organ at risk in left-sided breast treatment plans, the proportions of recommended changes did not significantly differ between the left breast treatment plans (3.0%, 95% confidence interval 2.0%-4.5%) and right breast treatment plans (2.4%, 95% confidence interval 1.5%-3.8%). The recommended changes were more frequently made when peer review occurred before radiation therapy (3.8%) than during treatment (1.4%-2.8%; P=.0048). The proportion of plans with recommended changes was not significantly associated with patient volume (P=.23), peer-review performance (P=.36), or center academic status (P=.75). Peer review of treatment plans directly affects the quality of care by identifying important clinical and planning changes. Provincial strategies are underway to optimize its conduct in radiation oncology. Copyright © 2016. Published by Elsevier Inc.

What do we know about grant peer review in the health sciences?

PubMed Central

Guthrie, Susan; Ghiga, Ioana; Wooding, Steven

2018-01-01

Background: Peer review decisions award an estimated >95% of academic medical research funding, so it is crucial to understand how well they work and if they could be improved. Methods: This paper summarises evidence from 105 papers identified through a literature search on the effectiveness and burden of peer review for grant funding. Results: There is a remarkable paucity of evidence about the efficiency of peer review for funding allocation, given its centrality to the modern system of science. From the available evidence, we can identify some conclusions around the effectiveness and burden of peer review. The strongest evidence around effectiveness indicates a bias against innovative research. There is also fairly clear evidence that peer review is, at best, a weak predictor of future research performance, and that ratings vary considerably between reviewers. There is some evidence of age bias and cronyism. Good evidence shows that the burden of peer review is high and that around 75% of it falls on applicants. By contrast, many of the efforts to reduce burden are focused on funders and reviewers/panel members. Conclusions: We suggest funders should acknowledge, assess and analyse the uncertainty around peer review, even using reviewers’ uncertainty as an input to funding decisions. Funders could consider a lottery element in some parts of their funding allocation process, to reduce both burden and bias, and allow better evaluation of decision processes. Alternatively, the distribution of scores from different reviewers could be better utilised as a possible way to identify novel, innovative research. Above all, there is a need for open, transparent experimentation and evaluation of different ways to fund research. This also requires more openness across the wider scientific community to support such investigations, acknowledging the lack of evidence about the primacy of the current system and the impossibility of achieving perfection. PMID:29707193

NASA Product Peer Review Process

NASA Technical Reports Server (NTRS)

Jenks, Ken

2009-01-01

This viewgraph presentation describes NASA's product peer review process. The contents include: 1) Inspection/Peer Review at NASA; 2) Reasons for product peer reviews; 3) Different types of peer reviews; and 4) NASA requirements for peer reviews. This presentation also includes a demonstration of an actual product peer review.

The Effect of Peer Review on Information Literacy Outcomes in a Chemical Literature Course

ERIC Educational Resources Information Center

Zwicky, David A.; Hands, Michael D.

2016-01-01

This article describes the use of peer review in a writing project involving upper-level chemistry students in a chemical literature course, with the goal of improving student performance in meeting information literacy outcomes. Students were asked to find articles on a topic of their choice over the course of a semester and assemble the results…

Cross-Year Peer Tutoring in Healthcare and Dental Education: A Review of the Literature

ERIC Educational Resources Information Center

Hum, Lauren; Maccaro, Justin; Park, Sang E.

2014-01-01

Cross-year peer tutoring (CYPT) programs show promise of potential benefits not only to the tutees and tutors, but also to the entire dental education field. A critical review of the literature was performed to determine the characteristics of studies assessing CYPT programs in the healthcare field, to see if there are adequate resources in the…

Practical and Theoretical Requirements for Controlling Rater Stringency in Peer Review.

ERIC Educational Resources Information Center

Cason, Gerald J.; Cason, Carolyn L.

This study describes a computer based, performance rating information processing system, performance rating theory, and programs for the application of the theory to obtain ratings free from the effects of reviewer stringency in reviewing abstracts of conference papers. Originally, the Performance Rating (PR) System was used to evaluate the…

Peer-assisted learning and orthopaedic evaluation psychomotor skills.

PubMed

Weidner, Thomas G; Popp, Jennifer K

2007-01-01

Athletic training educators often anecdotally suggest that athletic training students enhance their learning by teaching their peers. However, peer-assisted learning (PAL) has not been examined within athletic training education to provide evidence for PAL's current use or for its use as a pedagogic tool. To assess the effectiveness of intentional, formal PAL on the performance of psychomotor skills and to identify students' perceptions of PAL. Randomized, pretest-posttest experimental design. Athletic Training Research and Education Laboratory. Fifty-one undergraduate students (27 athletic training majors, 24 nonmajors). Review sessions led by either an Approved Clinical Instructor or peer tutor. We assessed pretest and posttest performance scores (number of correct skills) and the amount of time to complete the psychomotor skills in 3 categories of orthopaedic evaluation of the hand and wrist for subjects assigned to either a peer tutor or an Approved Clinical Instructor review group. Using the Athletic Training Peer-Assisted Learning Assessment Survey, we evaluated the perceptions of students assigned to the peer-tutor group regarding the benefits of, and preferences for, PAL. Differences in the pretest-posttest skill scores were noted in both groups (P < .05). No differences in the posttest skills scores or the times to perform the skills were seen between the groups. The Athletic Training Peer-Assisted Learning Assessment Survey revealed that most (n = 19, 70.4%) of the subjects felt less anxious when practicing psychomotor skills with peer tutors than with the laboratory instructor, and many students (n = 12, 44.4%) felt more self-confident when practicing psychomotor skills with a peer tutor. Peer-assisted learning appears to be a valid method for improving athletic training psychomotor skills. Peers can be resources for practicing clinical skills and report benefiting from the collaboration. Peer-assisted learning should be deliberately integrated into athletic training education programs to enhance student learning and collaboration.

28 CFR 34.109 - Qualifications of peer reviewers.

Code of Federal Regulations, 2010 CFR

2010-07-01

... Section 34.109 Judicial Administration DEPARTMENT OF JUSTICE OJJDP COMPETITION AND PEER REVIEW PROCEDURES Peer Review § 34.109 Qualifications of peer reviewers. The general reviewer qualification criteria to...). Additional details concerning peer reviewer qualifications are provided in the OJJDP “Peer Review Guideline”. ...

Telemedicine-based system for quality management and peer review in radiology.

PubMed

Morozov, Sergey; Guseva, Ekaterina; Ledikhova, Natalya; Vladzymyrskyy, Anton; Safronov, Dmitry

2018-06-01

Quality assurance is the key component of modern radiology. A telemedicine-based quality assurance system helps to overcome the "scoring" approach and makes the quality control more accessible and objective. A concept for quality assurance in radiology is developed. Its realization is a set of strategies, actions, and tools. The latter is based on telemedicine-based peer review of 23,199 computed tomography (CT) and magnetic resonance imaging (MRI) images. The conception of the system for quality management in radiology represents a chain of actions: "discrepancies evaluation - routine support - quality improvement activity - discrepancies evaluation". It is realized by an audit methodology, telemedicine, elearning, and other technologies. After a year of systemic telemedicine-based peer reviews, the authors have estimated that clinically significant discrepancies were detected in 6% of all cases, while clinically insignificant ones were found in 19% of cases. Most often, problems appear in musculoskeletal records; 80% of the examinations have diagnostic or technical imperfections. The presence of routine telemedicine support and personalized elearning allowed improving the diagnostics quality. The level of discrepancies has decreased significantly (p < 0.05). The telemedicine-based peer review system allows improving radiology departments' network effectiveness. • "Scoring" approach to radiologists' performance assessment must be changed. • Telemedicine peer review and personalized elearning significantly decrease the number of discrepancies. • Teleradiology allows linking all primary-level hospitals to a common peer review network.

The Benefits of Peer Review and a Multisemester Capstone Writing Series on Inquiry and Analysis Skills in an Undergraduate Thesis

ERIC Educational Resources Information Center

Weaver, K. F.; Morales, V.; Nelson, M.; Weaver, P. F.; Toledo, A.; Godde, K.

2016-01-01

This study examines the relationship between the introduction of a four-course writing-intensive capstone series and improvement in inquiry and analysis skills of biology senior undergraduates. To measure the impact of the multicourse write-to-learn and peer-review pedagogy on student performance, we used a modified Valid Assessment of Learning in…

Peer reviewing e-learning: opportunities, challenges, and solutions.

PubMed

Ruiz, Jorge G; Candler, Chris; Teasdale, Thomas A

2007-05-01

Peer review is the foundation of academic publication and a necessary step in the scrutiny of any scholarly work. Simply defined, peer review is the attentive, unbiased assessment of any scholarly work that is submitted for formal scrutiny. Although medical school faculty increasingly use technology in clinical teaching, e-learning materials are often not subjected to a rigorous peer review process. The authors contrast peer review of e-learning materials with that of print materials, describe peer review issues regarding e-learning materials, propose approaches to address the challenges of peer review of e-learning materials, and outline directions for refinement of the e-learning peer review process. At its core, the peer review of e-learning materials should not differ substantially from that of traditional manuscripts. However, e-learning introduces new demands that impel reviewers to consider aspects that are unique to educational technology, including pedagogy, format, usability, navigation, interactivity, delivery, ease of updating, distribution, and access. Four approaches are offered to ease the burden and improve the quality of e-learning peer review: develop peer review training, embrace multidisciplinary peer review, develop guidelines, and provide incentives and compensation. The authors conclude with suggestions about peer review research.

The Effects of Online Peer Assessment and Family Entrepreneurial Experience on Students' Business Planning Performance

ERIC Educational Resources Information Center

Lee, Chun-Yi

2015-01-01

Problem Statement: In recent years, many educators and researchers in the field of education have made efforts to leverage the advantages provided by online peer assessment, leading to its extensive application in a range of domains, particularly higher education. However, studies on the roles of the reviewer and author in online peer assessment…

Peer Assessment for Learning from a Social Perspective: The Influence of Interpersonal Variables and Structural Features

ERIC Educational Resources Information Center

van Gennip, Nanine A. E.; Segers, Mien S. R.; Tillema, Harm H.

2009-01-01

This paper reports a systematic literature review examining empirical studies on the effects of peer assessment for learning. Peer assessment is fundamentally a social process whose core activity is feedback given to and received from others, aimed at enhancing the performance of each individual group member and/or the group as a whole. This makes…

28 CFR 34.106 - Number of peer reviewers.

Code of Federal Regulations, 2010 CFR

2010-07-01

... 28 Judicial Administration 1 2010-07-01 2010-07-01 false Number of peer reviewers. 34.106 Section 34.106 Judicial Administration DEPARTMENT OF JUSTICE OJJDP COMPETITION AND PEER REVIEW PROCEDURES Peer Review § 34.106 Number of peer reviewers. The number of peer reviewers will vary by program (as...

28 CFR 34.106 - Number of peer reviewers.

Code of Federal Regulations, 2013 CFR

2013-07-01

... 28 Judicial Administration 1 2013-07-01 2013-07-01 false Number of peer reviewers. 34.106 Section 34.106 Judicial Administration DEPARTMENT OF JUSTICE OJJDP COMPETITION AND PEER REVIEW PROCEDURES Peer Review § 34.106 Number of peer reviewers. The number of peer reviewers will vary by program (as...

How are we assessing near-peer teaching in undergraduate health professional education? A systematic review.

PubMed

Irvine, Susan; Williams, Brett; McKenna, Lisa

2017-03-01

Near Peer teaching (NPT) is reported as an effective pedagogical approach to student learning and performance. Studies in medicine, nursing and health sciences have relied mainly on self-reports to describe its benefits, focusing on psychomotor and cognitive aspects of learning. Despite increasing research reports on peer teaching internationally, little is known about the various domains of learning used in assessment of performance and objective learning outcomes of NPT. To determine the domains of learning and assessment outcomes used in NPT in undergraduate health professional education. Quantitative systematic review was conducted in accord with the PRISMA protocol and the Joanna Briggs Institute processes. A wide literature search was conducted for the period 1990-November 2015 of fourteen databases. Grey literature was undertaken from all key research articles. Studies meeting the inclusion criteria were eligible for consideration, including measured learning outcomes of near-peer teaching in undergraduate education in nursing, medicine and health sciences. Set limitations included publications after 1990 (2015 inclusive), English language and objective learning outcomes. A quality appraisal process involving two independent reviewers was used to analyse the data. Of 212 selected articles, 26 were included in the review. Terminology was confusing and found to be a barrier to the review process. Although some studies demonstrated effective learning outcomes resulting from near-peer teaching, others were inconclusive. Studies focused on cognitive and psychomotor abilities of learners with none assessing metacognition, affective behaviours or learning outcomes from quality of understanding. The studies reviewed focused on cognitive and psychomotor abilities of learners. Even though evidence clearly indicates that metacognition and affective behaviours have direct influence on learning and performance, indicating more research around this topic is warranted. Methodological quality of the studies and lack of theoretical frameworks underpinned by educational psychology may have contributed to inconsistencies in learning outcomes reported. Crown Copyright © 2016. Published by Elsevier Ltd. All rights reserved.

MELCOR Peer Review

DOE Office of Scientific and Technical Information (OSTI.GOV)

Boyack, B.E.; Dhir, V.K.; Gieseke, J.A.

1992-03-01

MELCOR is a fully integrated, engineering-level computer code that models the progression of severe accidents in light water reactor nuclear power plants. The newest version of MELCOR is Version 1.8.1, July 1991. MELCOR development has reached the point that the United States Nuclear Regulatory Commission sponsored a broad technical review by recognized experts to determine or confirm the technical adequacy of the code for the serious and complex analyses it is expected to perform. For this purpose, an eight-member MELCOR Peer Review Committee was organized. The Committee has completed its review of the MELCOR code: the review process and findingsmore » of the MELCOR Peer Review Committee are documented in this report. The Committee has determined that recommendations in five areas are appropriate: (1) MELCOR numerics, (2) models missing from MELCOR Version 1.8.1, (3) existing MELCOR models needing revision, (4) the need for expanded MELCOR assessment, and (5) documentation.« less

Do peer review models affect clinicians' trust in journals? A survey of junior doctors.

PubMed

Patel, Jigisha; Pierce, Mary; Boughton, Stephanie L; Baldeweg, Stephanie E

2017-01-01

The aim of this survey was to determine the level of awareness and understanding of peer review and peer review models amongst junior hospital doctors and whether this influences clinical decision-making. A 30-question online anonymous survey was developed aimed at determining awareness of peer review models and the purpose of peer review, perceived trustworthiness of different peer review models and the role of peer review in clinical decision-making. It was sent to 800 trainee doctors in medical specialties on the University College London Partners trainee database. The response rate was (178/800) 22%. Most respondents were specialist registrars. Checking that research is conducted correctly (152/178, 85%) and the data interpreted correctly (148/178, 83%) were viewed as the most important purposes of peer review. Most respondents were aware of open (133/178, 75%), double-blind (125/178, 70%) and single-blind peer review (121/178, 68%). 101/178 (57%) had heard of collaborative, 87/178 (49%) of post publication and 29/178 (16%) of decoupled peer review. Of those who were aware of double-blind, single-blind open and collaborative peer review, 85 (68%), 82 (68%), 74 (56%) and 24 (24%), respectively, understood how they worked. The NEJM , Lancet and The BMJ were deemed to have most trustworthy peer review, 137/178 (77%), 129/178 (72%) and 115/178 (65%), respectively. That peer review had taken place was important for a journal content to be used for clinical decision-making 152/178 (85%), but the ability to see peer review reports was not as important 22/178 (12%). Most felt there was a need for peer review training and that this should be at the specialist registrar stage of training. Junior hospital doctors view peer review to be important as a means of quality control, but do not value the ability to scrutinize peer review themselves. The unquestioning acceptance of peer review as final validation in the field of medicine emphasises not only the responsibility held by medical journals to ensure peer review is done well but also the need to raise awareness amongst the medical community of the limitations of the current peer review process.

Clinical peer review in the United States: history, legal development and subsequent abuse.

PubMed

Vyas, Dinesh; Hozain, Ahmed E

2014-06-07

The Joint Commission on Accreditation requires hospitals to conduct peer review to retain accreditation. Despite the intended purpose of improving quality medical care, the peer review process has suffered several setbacks throughout its tenure. In the 1980s, abuse of peer review for personal economic interest led to a highly publicized multimillion-dollar verdict by the United States Supreme Court against the perpetrating physicians and hospital. The verdict led to decreased physician participation for fear of possible litigation. Believing that peer review was critical to quality medical care, Congress subsequently enacted the Health Care Quality Improvement Act (HCQIA) granting comprehensive legal immunity for peer reviewers to increase participation. While serving its intended goal, HCQIA has also granted peer reviewers significant immunity likely emboldening abuses resulting in Sham Peer Reviews. While legal reform of HCQIA is necessary to reduce sham peer reviews, further measures including the need for standardization of the peer review process alongside external organizational monitoring are critical to improving peer review and reducing the prevalence of sham peer reviews.

Clinical peer review in the United States: History, legal development and subsequent abuse

PubMed Central

Vyas, Dinesh; Hozain, Ahmed E

2014-01-01

The Joint Commission on Accreditation requires hospitals to conduct peer review to retain accreditation. Despite the intended purpose of improving quality medical care, the peer review process has suffered several setbacks throughout its tenure. In the 1980s, abuse of peer review for personal economic interest led to a highly publicized multimillion-dollar verdict by the United States Supreme Court against the perpetrating physicians and hospital. The verdict led to decreased physician participation for fear of possible litigation. Believing that peer review was critical to quality medical care, Congress subsequently enacted the Health Care Quality Improvement Act (HCQIA) granting comprehensive legal immunity for peer reviewers to increase participation. While serving its intended goal, HCQIA has also granted peer reviewers significant immunity likely emboldening abuses resulting in Sham Peer Reviews. While legal reform of HCQIA is necessary to reduce sham peer reviews, further measures including the need for standardization of the peer review process alongside external organizational monitoring are critical to improving peer review and reducing the prevalence of sham peer reviews. PMID:24914357

A review of peer-assisted learning to deliver interprofessional supplementary image interpretation skills.

PubMed

Bain, P; Wareing, A; Henderson, I

2017-09-01

Peer-assisted learning provides a means through which individuals can learn from one another through a reciprocal process. Radiographic image interpretation skills are fundamental to both diagnostic radiography students and medical students due to their shared role in preliminary evaluation of conventional radiographic images. Medical students on graduation, may not be well prepared to carry out image interpretation, since evidence suggests that they perform less well than radiographers in e.g. Accident and Emergency situations. A review of literature was conducted exploring the application of peer-assisted learning within diagnostic radiography and health education more widely as well as the practice of initial image interpretation. An extensive and systematic search strategy was developed which provided a range of material related to the areas. An overview was obtained of the effectiveness of peer-assisted learning and the issues associated with development of image interpretation skills and a degree of discrepancy was identified between the two cohorts regarding their interpretative competence and confidence. This inconsistency may create an opportunity to apply peer-assisted learning, better preparing both disciplines for the practical application of image interpretation skills. The review identified the lack of a substantial evidence base relating to peer-assisted learning in radiography. Peer-assisted learning is not widely embraced in an interprofessional context. Multiple positive factors of such an intervention are identified which outweigh perceived negative issues. Student teacher and learner may benefit as should the clinical service from enhanced practitioner performance. The findings justify further research to develop the evidence base. Copyright © 2017 The College of Radiographers. Published by Elsevier Ltd. All rights reserved.

A Generalized Thurstonian Paired Comparison Multicriteria Heuristic Model for Peer Evaluation of Individual Performance on IS Team Projects

ERIC Educational Resources Information Center

Scher, Julian M.

2010-01-01

Information Systems instructors are generally encouraged to introduce team projects into their pedagogy, with a consequential issue of objectively evaluating the performance of each individual team member. The concept of "freeloading" is well-known for team projects, and for this, and other reasons, a peer review process of team members,…

Effects of peer review on communication skills and learning motivation among nursing students.

PubMed

Yoo, Moon Sook; Chae, Sun-Mi

2011-04-01

The purpose of this study was to investigate the effects of video-based peer review on communication skills and learning motivation among nursing students. A non-equivalent control with pretest-posttest design was used. The participants were 47 sophomore nursing students taking a fundamentals of nursing course at a nursing college in Korea. Communication with a standardized patient was videotaped for evaluation. The intervention group used peer reviews to evaluate the videotaped performance; a small group of four students watched the videotape of each student and then provided feedback. The control group assessed themselves alone after watching their own videos. Communication skills and learning motivation were measured. The intervention group showed significantly higher communication skills and learning motivation after the intervention than did the control group. The findings suggest that peer review is an effective learning method for nursing students to improve their communication skills and increase their motivation to learn. Copyright 2011, SLACK Incorporated.

Influence of an information literacy course on students' information search behavior.

PubMed

Weinert, Daniel J; Palmer, Erin M

2007-01-01

The purpose of this study was to determine the influence of an information literacy course on students' information gathering behavior. Two student groups, consisting of 69 (Group One) and 177 (Group Two) students, were compared in their performance on a literature review assignment. Group one did not have an information literacy course, while group two was the first class to receive a newly introduced course in information literacy. Assignment references served as the dependent variables and included the following categories: total number of references, number and percentage of peer reviewed journal references, number and percentage of non-peer reviewed journal references, number and percentage of website references, number and percentage of authority opinion references, and number and percentage of textbook references. Referenced websites were further divided into the following: .com, .org, .edu, .gov. for both total number and percent utilization.Independent T-tests were performed between the information literacy course status and each of the dependent variables. Descriptive data (prior education, cumulative GPA, average age of student groups) was similar for both groups. Independent T-test analysis revealed a strong association (p < .05) between increasing both the number and percentage of peer reviewed references and having the information literacy course. The introduction of an information literacy course did influence the information gathering behavior of students. Students showed an increased reliance on peer-reviewed references.

Improved patient notes from medical students during web-based teaching using faculty-calibrated peer review and self-assessment.

PubMed

McCarty, Teresita; Parkes, Marie V; Anderson, Teresa T; Mines, Jan; Skipper, Betty J; Grebosky, James

2005-10-01

This study examines the effectiveness of Calibrated Peer Review (CPR), a Web-based writing development program, to teach and assess medical students' patient note-writing skills in a standardized fashion. At the end of the clerkship year, 67 medical students were divided into three groups, introduced to CPR, and instructed in patient note-writing. Students then wrote notes for three clinical cases, presented in different order to each group. After training on faculty-calibrated standards, students evaluated their peers' notes and their own notes. Trained faculty, blinded to author, order, and group, also graded student notes. Faculty gave lower scores than students, but both groups found students' scores improved significantly from the first to the third note written. Student-written patient notes improved in quality while using CPR. The program uses approaches valued in medicine (accurate peer review and self-reflection) to enhance performance.

Open peer review at four STEM journals: an observational overview.

PubMed

Ford, Emily

2015-01-01

Open peer review, peer review where authors' and reviewers' identities are disclosed to one another, is a growing trend in scholarly publishing. Through observation of four journals in STEM disciplines, PLOS One, Atmospheric Chemistry & Physics, PeerJ, and F1000Research, an observational overview is conducted. The overview relies on defined characteristics of open peer review. Results show that despite differing open peer review implementations, each journal retains editorial involvement in scholarly publishing. Further, the analysis shows that only one of these implementations is fully transparent in its peer review and decision making process. Finally, the overview contends that journals should clearly outline peer review and editorial processes in order to allow for open peer review to be better understood and adopted by authors, reviewers, editors, and readers of science communications.

A protocol of a cross-sectional study evaluating an online tool for early career peer reviewers assessing reports of randomised controlled trials.

PubMed

Chauvin, Anthony; Moher, David; Altman, Doug; Schriger, David L; Alam, Sabina; Hopewell, Sally; Shanahan, Daniel R; Recchioni, Alessandro; Ravaud, Philippe; Boutron, Isabelle

2017-09-15

Systematic reviews evaluating the impact of interventions to improve the quality of peer review for biomedical publications highlighted that interventions were limited and have little impact. This study aims to compare the accuracy of early career peer reviewers who use an innovative online tool to the usual peer reviewer process in evaluating the completeness of reporting and switched primary outcomes in completed reports. This is a cross-sectional study of individual two-arm parallel-group randomised controlled trials (RCTs) published in the BioMed Central series medical journals, BMJ , BMJ Open and Annals of Emergency Medicine and indexed with the publication type 'Randomised Controlled Trial'. First, we will develop an online tool and training module based (a) on the Consolidated Standards of Reporting Trials (CONSORT) 2010 checklist and the Explanation and Elaboration document that would be dedicated to junior peer reviewers for assessing the completeness of reporting of key items and (b) the Centre for Evidence-Based Medicine Outcome Monitoring Project process used to identify switched outcomes in completed reports of the primary results of RCTs when initially submitted. Then, we will compare the performance of early career peer reviewers who use the online tool to the usual peer review process in identifying inadequate reporting and switched outcomes in completed reports of RCTs at initial journal submission. The primary outcome will be the mean number of items accurately classified per manuscript. The secondary outcomes will be the mean number of items accurately classified per manuscript for the CONSORT items and the sensitivity, specificity and likelihood ratio to detect the item as adequately reported and to identify a switch in outcomes. We aim to include 120 RCTs and 120 early career peer reviewers. The research protocol was approved by the ethics committee of the INSERM Institutional Review Board (21 January 2016). The study is based on voluntary participation and informed written consent. NCT03119376. © Article author(s) (or their employer(s) unless otherwise stated in the text of the article) 2017. All rights reserved. No commercial use is permitted unless otherwise expressly granted.

Peer review and the publication process.

PubMed

Ali, Parveen Azam; Watson, Roger

2016-10-01

To provide an overview of the peer review process, its various types, selection of peer reviewers, the purpose and significance of the peer review with regard to the assessment and management of quality of publications in academic journals. Discussion paper. This paper draws on information gained from literature on the peer review process and the authors' knowledge and experience of contributing as peer reviewers and editors in the field of health care, including nursing. There are various types of peer review: single blind; double blind; open; and post-publication review. The role of the reviewers in reviewing manuscripts and their contribution to the scientific and academic community remains important.

In-Suit Light Exercise (ISLE) Prebreathe Protocol Peer Review Assessment. Volume 1

NASA Technical Reports Server (NTRS)

Brady, Timothy K.; Polk, James D.

2011-01-01

The performance of extravehicular activity (EVA) by National Aeronautics and Space Administration astronauts involves the risk of decompression sickness. This risk has been mitigated by the use of oxygen "prebreathe" to effectively wash out tissue nitrogen prior to each EVA. Now that the Space Shuttle Program (SSP) is being retired, high-pressure oxygen will become a limited resource. The In-Suit Light Exercise (ISLE) Prebreathe Protocol offers several potential benefits including its potential to save 6 pounds of oxygen per EVA. At the request of the NASA Engineering and Safety Center, the peer review convened on October 14, 2010. The major recommendation of the Review Committee was that the ISLE protocol was acceptable for operational use as a prebreathe option prior to EVA. The results from the peer review are contained in this document.

The golden rule of reviewing

USGS Publications Warehouse

McPeek, Mark A.; DeAngelis, Donald L.; Shaw, Ruth G.; Moore, Allen J.; Rausher, Mark D.; Strong, Donald R.; Ellison, Aaron M.; Barrett, Louise; Rieseberg, Loren; Breed, Michael D.; Sullivan, Jack; Osenberg, Craig W.; Holyoak, Marcel; Elgar, Mark A.

2009-01-01

A major bottleneck in the time required to publish a scientific or scholarly paper is the speed with which reviews by peers are returned to journals. Peer review is a reciprocal altruistic system in which each individual may perform every task—editors, reviewers, and authors—at different times. Journals have no way to coerce reviewers to return their critiques faster. To greatly shorten the time to publication, all actors in this altruistic network should abide by the Golden Rule of Reviewing: review for others as you would have others review for you. Say yes to reviewing whenever your duties and schedule allow; provide a thorough, fair, and constructive critique of the work; and do it at your first opportunity regardless of the deadline.

Transition From Peer Review to Peer Learning: Experience in a Radiology Department.

PubMed

Donnelly, Lane F; Dorfman, Scott R; Jones, Jeremy; Bisset, George S

2017-10-18

To describe the process by which a radiology department moved from peer review to peer collaborative improvement (PCI) and review data from the first 16 months of the PCI process. Data from the first 16 months after PCI were reviewed: number of case reviews performed, number of learning opportunities identified, percentage yield of learning opportunities identified, type of learning opportunities identified, and comparison of the previous parameters between case randomly reviewed versus actively pushed (issues actively identified and entered). Changes in actively pushed cases were also assessed as volume per month over the 16 months (run chart). Faculty members were surveyed about their perception of the conversion to PCI. In all, 12,197 cases were peer reviewed, yielding 1,140 learning opportunities (9.34%). The most common types of learning opportunities for all reviewed cases included perception (5.1%) and reporting (1.9%). The yield of learning opportunities from actively pushed cases was 96.3% compared with 3.88% for randomly reviewed cases. The number of actively pushed cases per month increased over the course of the period and established two new confidence intervals. The faculty survey revealed that the faculty perceived the new PCI process as positive, nonpunitive, and focused on improvement. The study demonstrates that a switch to PCI is perceived as nonpunitive and associated with increased radiologist submission of learning opportunities. Active entering of identified learning opportunities had a greater yield and perceived value, compared with random review of cases. Copyright © 2017 American College of Radiology. Published by Elsevier Inc. All rights reserved.

Factors influencing pharmacist performance: a review of the peer-reviewed literature.

PubMed

Schafheutle, Ellen Ingrid; Seston, Elizabeth Mary; Hassell, Karen

2011-10-01

To undertake a review of peer-reviewed literature to explore factors affecting pharmacists' performance. The following databases were searched: Medline, Embase, Scopus, ISI Web of Knowledge and PsychInfo. Inclusion criteria were: English language only, published between 1990 and 2010 and published in the United Kingdom (UK), United States of America (USA), Canada, Australia, New Zealand or Europe. The search strategy identified 37 items. The review found that there was some evidence to suggest that pharmacists with certain characteristics (e.g. being male, being of ethnic minority origin, working in community pharmacy and having trained overseas) were more likely to experience performance problems. Factors relating to workload and work environment were associated with performance problems, particularly in relation to errors. There was some limited evidence to suggest that experiencing problems with alcohol or drugs could negatively impact on pharmacists' performance. The findings suggest that pharmacist performance may be affected by multiple factors, including personal characteristics such as age, gender, ethnicity, place of primary qualification, factors associated with the workplace and mental and physical health problems. The evidence is not unequivocal and gaps in the literature exist, suggesting that pharmacist performance is an under-researched area. Copyright © 2011 Elsevier Ireland Ltd. All rights reserved.

Redefining the Practice of Peer Review Through Intelligent Automation Part 2: Data-Driven Peer Review Selection and Assignment.

PubMed

Reiner, Bruce I

2017-12-01

In conventional radiology peer review practice, a small number of exams (routinely 5% of the total volume) is randomly selected, which may significantly underestimate the true error rate within a given radiology practice. An alternative and preferable approach would be to create a data-driven model which mathematically quantifies a peer review risk score for each individual exam and uses this data to identify high risk exams and readers, and selectively target these exams for peer review. An analogous model can also be created to assist in the assignment of these peer review cases in keeping with specific priorities of the service provider. An additional option to enhance the peer review process would be to assign the peer review cases in a truly blinded fashion. In addition to eliminating traditional peer review bias, this approach has the potential to better define exam-specific standard of care, particularly when multiple readers participate in the peer review process.

Group consensus peer review in radiation oncology: commitment to quality.

PubMed

Duggar, W Neil; Bhandari, Rahul; Yang, Chunli Claus; Vijayakumar, Srinivasan

2018-03-27

Peer review, especially prospective peer review, has been supported by professional organizations as an important element in optimal Radiation Oncology practice based on its demonstration of efficacy at detecting and preventing errors prior to patient treatment. Implementation of peer review is not without barriers, but solutions do exist to mitigate or eliminate some of those barriers. Peer review practice at our institution involves three key elements: new patient conference, treatment planning conference, and chart rounds. The treatment planning conference is an adaptation of the group consensus peer review model from radiology which utilizes a group of peers reviewing each treatment plan prior to implementation. The peer group in radiation oncology includes Radiation Oncologists, Physician Residents, Medical Physicists, Dosimetrists, and Therapists. Thus, technical and clinical aspects of each plan are evaluated simultaneously. Though peer review is held in high regard in Radiation Oncology, many barriers commonly exist preventing optimal implementation such as time intensiveness, repetition, and distraction from clinic time with patients. Through the use of automated review tools and commitment by individuals and administration in regards to staffing, scheduling, and responsibilities, these barriers have been mitigated to implement this Group Consensus Peer Review model into a Radiation Oncology Clinic. A Group Consensus Peer Review model has been implemented with strategies to address common barriers to effective and efficient peer review.

7 CFR 3401.8 - Grant awards.

Code of Federal Regulations, 2010 CFR

2010-01-01

... additional support at a future date. This type of research project grant is approved on the basis of peer... previous grant instrument. Such a renewal shall be based upon new application, de novo peer review and..., provided that performance has been satisfactory, appropriations are available for this purpose, and...

When learners become teachers: a review of peer teaching in medical student education.

PubMed

Benè, Kristen L; Bergus, George

2014-01-01

Peer teaching engages students as teachers and is widely used in K-12 education, many universities, and increasingly in medical schools. It draws on the social and cognitive congruence between learner and teacher and can be attractive to medical schools faced with a growing number of learners but a static faculty size. Peer teachers can give lectures on assigned topics, lead problem-based learning sessions, and provide one on one support to classmates in the form of tutoring. We undertook a narrative review of research on peer teachers in medical school, specifically investigating how medical students are impacted by being peer teachers and how having a peer teacher impacts learners. Studies have shown that peer teaching has a primarily positive impact on both the peer teacher and the learners. In the setting of problem-based learning courses or clinical skills instruction, medical students' performance on tests of knowledge or skills is similar whether they have faculty instructors or peer teachers. There is also strong evidence that being a peer teacher enhances the learning of the peer teacher relative to the content being taught. It is common for peer teachers to lack confidence in their abilities to successfully teach, and they appreciate receiving training related to their teaching role. We find evidence from several different educational settings that peer teaching benefits both the peer teachers and the learners. This suggests that peer teaching is a valuable methodology for medical schools to engage learners as teachers.

28 CFR 34.110 - Management of peer reviews.

Code of Federal Regulations, 2010 CFR

2010-07-01

... 28 Judicial Administration 1 2010-07-01 2010-07-01 false Management of peer reviews. 34.110 Section 34.110 Judicial Administration DEPARTMENT OF JUSTICE OJJDP COMPETITION AND PEER REVIEW PROCEDURES Peer Review § 34.110 Management of peer reviews. A technical support contractor may assist in managing...

28 CFR 34.102 - Peer review procedures.

Code of Federal Regulations, 2010 CFR

2010-07-01

...” describes a process that evolves in accordance with experience and opportunities to effect improvements. The... Review § 34.102 Peer review procedures. The OJJDP peer review process is contained in an OJJDP “Peer... substantive and procedural matters related to the peer review process, the “Guideline” addresses such issues...

Clinical Nurse Specialists Guide Staff Nurses to Promote Practice Accountability Through Peer Review.

PubMed

Semper, Julie; Halvorson, Betty; Hersh, Mary; Torres, Clare; Lillington, Linda

2016-01-01

The aim of the study was to describe the clinical nurse specialist role in developing and implementing a staff nurse education program to promote practice accountability using peer review principles. Peer review is essential for professional nursing practice demanding a significant culture change. Clinical nurse specialists in a Magnet-designated community hospital were charged with developing a staff nurse peer review education program. Peer review is a recognized mechanism of professional self-regulation to ensure delivery of quality care. The American Nurses Association strongly urges incorporating peer review in professional nursing practice models. Clinical nurse specialists play a critical role in educating staff nurses about practice accountability. Clinical nurse specialists developed an education program guided by the American Nurses Association's principles of peer review. A baseline needs assessment identified potential barriers and learning needs. Content incorporated tools and strategies to build communication skills, collaboration, practice change, and peer accountability. The education program resulted in increased staff nurse knowledge about peer review and application of peer review principles in practice. Clinical nurse specialists played a critical role in helping staff nurses understand peer review and its application to practice. The clinical nurse specialist role will continue to be important in sustaining the application of peer review principles in practice.

Mentored peer review of standardized manuscripts as a teaching tool for residents: a pilot randomized controlled multi-center study.

PubMed

Wong, Victoria S S; Strowd, Roy E; Aragón-García, Rebeca; Moon, Yeseon Park; Ford, Blair; Haut, Sheryl R; Kass, Joseph S; London, Zachary N; Mays, MaryAnn; Milligan, Tracey A; Price, Raymond S; Reynolds, Patrick S; Selwa, Linda M; Spencer, David C; Elkind, Mitchell S V

2017-01-01

There is increasing need for peer reviewers as the scientific literature grows. Formal education in biostatistics and research methodology during residency training is lacking. In this pilot study, we addressed these issues by evaluating a novel method of teaching residents about biostatistics and research methodology using peer review of standardized manuscripts. We hypothesized that mentored peer review would improve resident knowledge and perception of these concepts more than non-mentored peer review, while improving review quality. A partially blinded, randomized, controlled multi-center study was performed. Seventy-eight neurology residents from nine US neurology programs were randomized to receive mentoring from a local faculty member or not. Within a year, residents reviewed a baseline manuscript and four subsequent manuscripts, all with introduced errors designed to teach fundamental review concepts. In the mentored group, mentors discussed completed reviews with residents. Primary outcome measure was change in knowledge score between pre- and post-tests, measuring epidemiology and biostatistics knowledge. Secondary outcome measures included level of confidence in the use and interpretation of statistical concepts before and after intervention, and RQI score for baseline and final manuscripts. Sixty-four residents (82%) completed initial review with gradual decline in completion on subsequent reviews. Change in primary outcome, the difference between pre- and post-test knowledge scores, did not differ between mentored (-8.5%) and non-mentored (-13.9%) residents ( p  = 0.48). Significant differences in secondary outcomes (using 5-point Likert scale, 5 = strongly agree) included mentored residents reporting enhanced understanding of research methodology (3.69 vs 2.61; p  = 0.001), understanding of manuscripts (3.73 vs 2.87; p  = 0.006), and application of study results to clinical practice (3.65 vs 2.78; p  = 0.005) compared to non-mentored residents. There was no difference between groups in level of interest in peer review (3.00 vs 3.09; p  = 0.72) or the quality of manuscript review assessed by the Review Quality Instrument (RQI) (3.25 vs 3.06; p  = 0.50). We used mentored peer review of standardized manuscripts to teach biostatistics and research methodology and introduce the peer review process to residents. Though knowledge level did not change, mentored residents had enhanced perception in their abilities to understand research methodology and manuscripts and apply study results to clinical practice.

Peer review of RELAP5/MOD3 documentation

DOE Office of Scientific and Technical Information (OSTI.GOV)

Craddick, W.G.

1993-12-31

A peer review was performed on a portion of the documentation of the RELAP5/MOD3 computer code. The review was performed in two phases. The first phase was a review of Volume 3, Developmental Assessment problems, and Volume 4, Models and Correlations. The reviewers for this phase were Dr. Peter Griffith, Dr. Yassin Hassan, Dr. Gerald S. Lellouche, Dr. Marino di Marzo and Mr. Mark Wendel. The reviewers recommended a number of improvements, including using a frozen version of the code for assessment guided by a validation plan, better justification for flow regime maps and extension of models beyond their datamore » base. The second phase was a review of Volume 6, Quality Assurance of Numerical Techniques in RELAP5/MOD3. The reviewers for the second phase were Mr. Mark Wendel and Dr. Paul T. Williams. Recommendations included correction of numerous grammatical and typographical errors and better justification for the use of Lax`s Equivalence Theorem.« less

Policy, Practice, and Research Agenda for Emergency Medical Services Oversight: A Systematic Review and Environmental Scan.

PubMed

Taymour, Rekar K; Abir, Mahshid; Chamberlin, Margaret; Dunne, Robert B; Lowell, Mark; Wahl, Kathy; Scott, Jacqueline

2018-02-01

Introduction In a 2015 report, the Institute of Medicine (IOM; Washington, DC USA), now the National Academy of Medicine (NAM; Washington, DC USA), stated that the field of Emergency Medical Services (EMS) exhibits signs of fragmentation; an absence of system-wide coordination and planning; and a lack of federal, state, and local accountability. The NAM recommended clarifying what roles the federal government, state governments, and local communities play in the oversight and evaluation of EMS system performance, and how they may better work together to improve care. This systematic literature review and environmental scan addresses NAM's recommendations by answering two research questions: (1) what aspects of EMS systems are most measured in the peer-reviewed and grey literatures, and (2) what do these measures and studies suggest for high-quality EMS oversight? To answer these questions, a systematic literature review was conducted in the PubMed (National Center for Biotechnology Information, National Institutes of Health; Bethesda, Maryland USA), Web of Science (Thomson Reuters; New York, New York USA), SCOPUS (Elsevier; Amsterdam, Netherlands), and EMBASE (Elsevier; Amsterdam, Netherlands) databases for peer-reviewed literature and for grey literature; targeted web searches of 10 EMS-related government agencies and professional organizations were performed. Inclusion criteria required peer-reviewed literature to be published between 1966-2016 and grey literature to be published between 1996-2016. A total of 1,476 peer-reviewed titles were reviewed, 76 were retrieved for full-text review, and 58 were retained and coded in the qualitative software Dedoose (Manhattan Beach, California USA) using a codebook of themes. Categorizations of measure type and level of application were assigned to the extracted data. Targeted websites were systematically reviewed and 115 relevant grey literature documents were retrieved. A total of 58 peer-reviewed articles met inclusion criteria; 46 included process, 36 outcomes, and 18 structural measures. Most studies applied quality measures at the personnel level (40), followed by the agency (28) and system of care (28), and few at the oversight level (5). Numerous grey literature articles provided principles for high-quality EMS oversight. Limited quality measurement at the oversight level is an important gap in the peer-reviewed literature. The grey literature is ahead in this realm and can guide the policy and research agenda for EMS oversight quality measurement. Taymour RK , Abir M , Chamberlin M , Dunne RB , Lowell M , Wahl K , Scott J . Policy, practice, and research agenda for Emergency Medical Services oversight: a systematic review and environmental scan. Prehosp Disaster Med. 2018;33(1):89-97.

45 CFR 1388.9 - Peer review.

Code of Federal Regulations, 2010 CFR

2010-10-01

... 45 Public Welfare 4 2010-10-01 2010-10-01 false Peer review. 1388.9 Section 1388.9 Public Welfare... PROGRAM THE UNIVERSITY AFFILIATED PROGRAMS § 1388.9 Peer review. (a) The purpose of the peer review... D, Section 152 of the Act, must be evaluated through the peer review process. (c) Panels must be...

Peer Review in Higher Education: Student Perceptions before and after Participation

ERIC Educational Resources Information Center

Mulder, Raoul A.; Pearce, Jon M.; Baik, Chi

2014-01-01

Peer review is integral to academic endeavour, but opportunities for students to benefit from peer review in higher education remain limited, and relatively little is known about how student perceptions influence their appreciation of peer review. University student perceptions were examined before and after experiencing student peer review in…

Peer Review: Has It a Future?

ERIC Educational Resources Information Center

Soh, Kay Cheng

2013-01-01

Although its history is short, peer review has fast become a fixture of journal publications acquiring the status of a ritual in the academia. Many relevant and important issues have been raised leading to doubts about the value of peer review. The advent of electronic publishing further threatens the future of peer review. For peer review to…

40 CFR 194.27 - Peer review.

Code of Federal Regulations, 2010 CFR

2010-07-01

... 40 Protection of Environment 24 2010-07-01 2010-07-01 false Peer review. 194.27 Section 194.27... § 194.27 Peer review. (a) Any compliance application shall include documentation of peer review that has... barrier evaluation as required in § 194.44. (b) Peer review processes required in paragraph (a) of this...

Daily peer review of abnormal cervical smears in the assessment of individual practice as an additional method of internal quality control.

PubMed

Confortini, M; Di Stefano, C; Biggeri, A; Bulgaresi, P; Di Claudio, G; Grisotto, L; Maddau, C; Matucci, M; Petreschi, C; Troni, G M; Turco, P; Foxi, P

2016-02-01

An important internal quality control system used in the Cancer Prevention and Research Institute cytopathology laboratory in Florence is the peer review procedure, based on the review of all abnormal cytological smears which routinely emerge. Peer review is an important training opportunity for all cytologists, especially for those with less experience. This article shows the results of the peer review procedure. Of the 63 754 Papanicolaou (Pap) smears screened in 2011, 1086 were considered to be abnormal [at least atypical squamous cells of undetermined significance (ASC-US+)] on primary screening (selected by a single cytologist) and were subjected to the peer review procedure. The overall performance of the laboratory's cytologists was evaluated using a multiple rater analysis and the comparison of each cytologist with the final diagnosis. Further, the agreement was assessed by means of Cohen's kappa and weighted kappa statistics. In general, a moderate/substantial level of agreement between the ten cytologists and the final diagnoses was evident. Kappa values for each reader compared with the final diagnosis ranged from 0.54 to 0.69. The overall kappa value was 0.62 [95% confidence interval (CI), 0.58-0.66] and overall weighted kappa value was 0.76 (95% CI, 0.74-0.79). The category-specific agreement showed the lowest values for atypical squamous cells, cannot exclude high-grade squamous intraepithelial lesion (ASC-H). In summary, peer review represents an important internal quality control in the evaluation and improvement of inter-observer agreement and of the functioning of the laboratory as a whole. Multi-head microscope sessions may improve particularly the reproducibility of borderline diagnoses and, above all, can be an important training contribution for cytologists. © 2014 John Wiley & Sons Ltd.

A prospective study on an innovative online forum for peer reviewing of surgical science.

PubMed

Almquist, Martin; von Allmen, Regula S; Carradice, Dan; Oosterling, Steven J; McFarlane, Kirsty; Wijnhoven, Bas

2017-01-01

Peer review is important to the scientific process. However, the present system has been criticised and accused of bias, lack of transparency, failure to detect significant breakthrough and error. At the British Journal of Surgery (BJS), after surveying authors' and reviewers' opinions on peer review, we piloted an open online forum with the aim of improving the peer review process. In December 2014, a web-based survey assessing attitudes towards open online review was sent to reviewers with a BJS account in Scholar One. From April to June 2015, authors were invited to allow their manuscripts to undergo online peer review in addition to the standard peer review process. The quality of each review was evaluated by editors and editorial assistants using a validated instrument based on a Likert scale. The survey was sent to 6635 reviewers. In all, 1454 (21.9%) responded. Support for online peer review was strong, with only 10% stating that they would not subject their manuscripts to online peer review. The most prevalent concern was about intellectual property, being highlighted in 118 of 284 comments (41.5%). Out of 265 eligible manuscripts, 110 were included in the online peer review trial. Around 7000 potential reviewers were invited to review each manuscript. In all, 44 of 110 manuscripts (40%) received 100 reviews from 59 reviewers, alongside 115 conventional reviews. The quality of the open forum reviews was lower than for conventional reviews (2.13 (± 0.75) versus 2.84 (± 0.71), P<0.001). Open online peer review is feasible in this setting, but it attracts few reviews, of lower quality than conventional peer reviews.

Mechanism change in a simulation of peer review: from junk support to elitism.

PubMed

Paolucci, Mario; Grimaldo, Francisco

2014-01-01

Peer review works as the hinge of the scientific process, mediating between research and the awareness/acceptance of its results. While it might seem obvious that science would regulate itself scientifically, the consensus on peer review is eroding; a deeper understanding of its workings and potential alternatives is sorely needed. Employing a theoretical approach supported by agent-based simulation, we examined computational models of peer review, performing what we propose to call redesign , that is, the replication of simulations using different mechanisms . Here, we show that we are able to obtain the high sensitivity to rational cheating that is present in literature. In addition, we also show how this result appears to be fragile against small variations in mechanisms. Therefore, we argue that exploration of the parameter space is not enough if we want to support theoretical statements with simulation, and that exploration at the level of mechanisms is needed. These findings also support prudence in the application of simulation results based on single mechanisms, and endorse the use of complex agent platforms that encourage experimentation of diverse mechanisms.

A prospective study on an innovative online forum for peer reviewing of surgical science

PubMed Central

von Allmen, Regula S.; Carradice, Dan; Oosterling, Steven J.; McFarlane, Kirsty; Wijnhoven, Bas

2017-01-01

Background Peer review is important to the scientific process. However, the present system has been criticised and accused of bias, lack of transparency, failure to detect significant breakthrough and error. At the British Journal of Surgery (BJS), after surveying authors’ and reviewers’ opinions on peer review, we piloted an open online forum with the aim of improving the peer review process. Methods In December 2014, a web-based survey assessing attitudes towards open online review was sent to reviewers with a BJS account in Scholar One. From April to June 2015, authors were invited to allow their manuscripts to undergo online peer review in addition to the standard peer review process. The quality of each review was evaluated by editors and editorial assistants using a validated instrument based on a Likert scale. Results The survey was sent to 6635 reviewers. In all, 1454 (21.9%) responded. Support for online peer review was strong, with only 10% stating that they would not subject their manuscripts to online peer review. The most prevalent concern was about intellectual property, being highlighted in 118 of 284 comments (41.5%). Out of 265 eligible manuscripts, 110 were included in the online peer review trial. Around 7000 potential reviewers were invited to review each manuscript. In all, 44 of 110 manuscripts (40%) received 100 reviews from 59 reviewers, alongside 115 conventional reviews. The quality of the open forum reviews was lower than for conventional reviews (2.13 (± 0.75) versus 2.84 (± 0.71), P<0.001). Conclusion Open online peer review is feasible in this setting, but it attracts few reviews, of lower quality than conventional peer reviews. PMID:28662046

Variability in Students' Evaluating Processes in Peer Assessment with Calibrated Peer Review

ERIC Educational Resources Information Center

Russell, J.; Van Horne, S.; Ward, A. S.; Bettis, E. A., III; Gikonyo, J.

2017-01-01

This study investigated students' evaluating process and their perceptions of peer assessment when they engaged in peer assessment using Calibrated Peer Review. Calibrated Peer Review is a web-based application that facilitates peer assessment of writing. One hundred and thirty-two students in an introductory environmental science course…

Peer Review as a Strategy for Improving Students' Writing Process

ERIC Educational Resources Information Center

Baker, Kimberly M.

2016-01-01

Peer review is an established strategy for improving the quality of students' writing. This study moves beyond the focus on outcomes to assess the peer-review process. In particular, this study focuses on the timing of the peer review, a highly structured feedback form, and student writers' revisions after engaging in peer review. This study draws…

Designing Peer Review for Pedagogical Success: What Can We Learn from Professional Science?

ERIC Educational Resources Information Center

Trautmann, Nancy M.

2009-01-01

This article compares peer review in professional versus education settings, summarizing key aspects of scientific peer review and reflecting on how these relate to the process as experienced by students. Consideration of professional peer review benefits educators in two ways. First, systems used for student peer review can employ some of the…

34 CFR 350.50 - What is the peer review process for this Program?

Code of Federal Regulations, 2010 CFR

2010-07-01

... 34 Education 2 2010-07-01 2010-07-01 false What is the peer review process for this Program? 350... peer review process for this Program? (a) The Secretary refers each application for a grant governed by those regulations in this part to a peer review panel established by the Secretary. (b) Peer review...

The Power of Peer Reviewing to Enhance Writing in Horticulture: Greenhouse Management

ERIC Educational Resources Information Center

Anderson, Neil O.; Flash, Pamela

2014-01-01

Peer review is not included in undergraduate horticultural curricula. Our research objectives in an 8- year study, which ranged from 2000 to 2007 in two sections (2000-2002 non-peer reviewed and 2003-2007 peer-reviewed) of Greenhouse Management students at the University of Minnesota were to determine whether iterative peer reviews would result in…

28 CFR 34.102 - Peer review procedures.

Code of Federal Regulations, 2011 CFR

2011-07-01

... 28 Judicial Administration 1 2011-07-01 2011-07-01 false Peer review procedures. 34.102 Section 34.102 Judicial Administration DEPARTMENT OF JUSTICE OJJDP COMPETITION AND PEER REVIEW PROCEDURES Peer... substantive and procedural matters related to the peer review process, the “Guideline” addresses such issues...

28 CFR 34.102 - Peer review procedures.

Code of Federal Regulations, 2014 CFR

2014-07-01

... 28 Judicial Administration 1 2014-07-01 2014-07-01 false Peer review procedures. 34.102 Section 34.102 Judicial Administration DEPARTMENT OF JUSTICE OJJDP COMPETITION AND PEER REVIEW PROCEDURES Peer... substantive and procedural matters related to the peer review process, the “Guideline” addresses such issues...

28 CFR 34.102 - Peer review procedures.

Code of Federal Regulations, 2012 CFR

2012-07-01

... 28 Judicial Administration 1 2012-07-01 2012-07-01 false Peer review procedures. 34.102 Section 34.102 Judicial Administration DEPARTMENT OF JUSTICE OJJDP COMPETITION AND PEER REVIEW PROCEDURES Peer... substantive and procedural matters related to the peer review process, the “Guideline” addresses such issues...

28 CFR 34.102 - Peer review procedures.

Code of Federal Regulations, 2013 CFR

2013-07-01

... 28 Judicial Administration 1 2013-07-01 2013-07-01 false Peer review procedures. 34.102 Section 34.102 Judicial Administration DEPARTMENT OF JUSTICE OJJDP COMPETITION AND PEER REVIEW PROCEDURES Peer... substantive and procedural matters related to the peer review process, the “Guideline” addresses such issues...

A survey of radiation treatment planning peer-review activities in a provincial radiation oncology programme: current practice and future directions

PubMed Central

Brundage, Michael; Foxcroft, Sophie; McGowan, Tom; Gutierrez, Eric; Sharpe, Michael; Warde, Padraig

2013-01-01

Objectives To describe current patterns of practice of radiation oncology peer review within a provincial cancer system, identifying barriers and facilitators to its use with the ultimate aim of process improvement. Design A survey of radiation oncology programmes at provincial cancer centres. Setting All cancer centres within the province of Ontario, Canada (n=14). These are community-based outpatient facilities overseen by Cancer Care Ontario, the provincial cancer agency. Participants A delegate from each radiation oncology programme filled out a single survey based on input from their multidisciplinary team. Outcome measures Rated importance of peer review; current utilisation; format of the peer-review process; organisation and timing; case attributes; outcomes of the peer-review process and perceived barriers and facilitators to expanding peer-review processes. Results 14 (100%) centres responded. All rated the importance of peer review as at least 8/10 (10=extremely important). Detection of medical error and improvement of planning processes were the highest rated perceived benefits of peer review (each median 9/10). Six centres (43%) reviewed at least 50% of curative cases; four of these centres (29%) conducted peer review in more than 80% of cases treated with curative intent. Fewer than 20% of cases treated with palliative intent were reviewed in most centres. Five centres (36%) reported usually conducting peer review prior to the initiation of treatment. Five centres (36%) recorded the outcomes of peer review on the medical record. Thirteen centres (93%) planned to expand peer-review activities; a critical mass of radiation oncologists was the most important limiting factor (median 6/10). Conclusions Radiation oncology peer-review practices can vary even within a cancer system with provincial oversight. The application of guidelines and standards for peer-review processes, and monitoring of implementation and outcomes, will require effective knowledge translation activities. PMID:23903814

The UK National Chronic Obstructive Pulmonary Disease Resources and Outcomes Project--a feasibility study of large-scale clinical service peer review.

PubMed

Roberts, Christopher M; Buckingham, Rhona J; Stone, Robert A; Lowe, Derek; Pearson, Michael G

2010-10-01

Service provision and clinical outcomes for patients admitted with chronic obstructive pulmonary disease remain unacceptably variable despite guidelines and performance feedback of national audit, data. This study aims to assess the impact of mutual peer review on service improvement. The initial phase of this study was to assess the feasibility and determine the practicalities of delivering such a peer review programme on a large scale. All UK acute hospitals were invited to participate in a reciprocal peer review programme administered by a central team from three UK health organizations. Hospitals with the most resources were paired with those with the least (as defined in a baseline survey) and pairs randomized on a 3:2 basis into intervention or control groups. A number of key quality indicators were derived to measure service levels at the beginning and end of the study. Peer review teams included clinicians and managers from acute and primary care organizations and when possible a patient representative. Visits were focussed on four key areas of chronic obstructive pulmonary disease service. Teams were to agree service improvements and submit plans signed off by participants. Monthly change diaries were to be used to record progress towards agreed goals. A total of 100 hospitals participated in the programme. Overall, 52 of 54 peer review visits took place within a 4-week time frame and all units submitted service improvement plans within an agreed time frame. Secondary care representatives participated in all visits, primary care in 30 but patients in only 17. The mean number of diaries returned was 2, but 94% of units returned initial and final versions. It is possible to deliver successful large-scale mutual peer review using a limited but focussed programme. Participation of patients and use of change diaries requires further evaluation. © 2010 Blackwell Publishing Ltd.

28 CFR 34.108 - Selection of reviewers.

Code of Federal Regulations, 2010 CFR

2010-07-01

....108 Judicial Administration DEPARTMENT OF JUSTICE OJJDP COMPETITION AND PEER REVIEW PROCEDURES Peer Review § 34.108 Selection of reviewers. The Program Manager, through the Director of the OJJDP program... by the Administrator. The selection process for peer reviewers is detailed in the OJJDP “Peer Review...

7 CFR 3400.21 - Scientific peer review for research activities.

Code of Federal Regulations, 2011 CFR

2011-01-01

... 7 Agriculture 15 2011-01-01 2011-01-01 false Scientific peer review for research activities. 3400... § 3400.21 Scientific peer review for research activities. Scientific peer review is an evaluation of a... with the scientific knowledge and technical skills to conduct the proposed research work. Peer...

Peer Review in Scientific Publications: Benefits, Critiques, & A Survival Guide

PubMed Central

Kelly, Jacalyn; Sadeghieh, Tara

2014-01-01

Peer review has been defined as a process of subjecting an author’s scholarly work, research or ideas to the scrutiny of others who are experts in the same field. It functions to encourage authors to meet the accepted high standards of their discipline and to control the dissemination of research data to ensure that unwarranted claims, unacceptable interpretations or personal views are not published without prior expert review. Despite its wide-spread use by most journals, the peer review process has also been widely criticised due to the slowness of the process to publish new findings and due to perceived bias by the editors and/or reviewers. Within the scientific community, peer review has become an essential component of the academic writing process. It helps ensure that papers published in scientific journals answer meaningful research questions and draw accurate conclusions based on professionally executed experimentation. Submission of low quality manuscripts has become increasingly prevalent, and peer review acts as a filter to prevent this work from reaching the scientific community. The major advantage of a peer review process is that peer-reviewed articles provide a trusted form of scientific communication. Since scientific knowledge is cumulative and builds on itself, this trust is particularly important. Despite the positive impacts of peer review, critics argue that the peer review process stifles innovation in experimentation, and acts as a poor screen against plagiarism. Despite its downfalls, there has not yet been a foolproof system developed to take the place of peer review, however, researchers have been looking into electronic means of improving the peer review process. Unfortunately, the recent explosion in online only/electronic journals has led to mass publication of a large number of scientific articles with little or no peer review. This poses significant risk to advances in scientific knowledge and its future potential. The current article summarizes the peer review process, highlights the pros and cons associated with different types of peer review, and describes new methods for improving peer review. PMID:27683470

Random Versus Nonrandom Peer Review: A Case for More Meaningful Peer Review.

PubMed

Itri, Jason N; Donithan, Adam; Patel, Sohil H

2018-05-10

Random peer review programs are not optimized to discover cases with diagnostic error and thus have inherent limitations with respect to educational and quality improvement value. Nonrandom peer review offers an alternative approach in which diagnostic error cases are targeted for collection during routine clinical practice. The objective of this study was to compare error cases identified through random and nonrandom peer review approaches at an academic center. During the 1-year study period, the number of discrepancy cases and score of discrepancy were determined from each approach. The nonrandom peer review process collected 190 cases, of which 60 were scored as 2 (minor discrepancy), 94 as 3 (significant discrepancy), and 36 as 4 (major discrepancy). In the random peer review process, 1,690 cases were reviewed, of which 1,646 were scored as 1 (no discrepancy), 44 were scored as 2 (minor discrepancy), and none were scored as 3 or 4. Several teaching lessons and quality improvement measures were developed as a result of analysis of error cases collected through the nonrandom peer review process. Our experience supports the implementation of nonrandom peer review as a replacement to random peer review, with nonrandom peer review serving as a more effective method for collecting diagnostic error cases with educational and quality improvement value. Copyright © 2018 American College of Radiology. Published by Elsevier Inc. All rights reserved.

Peer Review Practices for Evaluating Biomedical Research Grants: A Scientific Statement From the American Heart Association.

PubMed

Liaw, Lucy; Freedman, Jane E; Becker, Lance B; Mehta, Nehal N; Liscum, Laura

2017-08-04

The biomedical research enterprise depends on the fair and objective peer review of research grants, leading to the distribution of resources through efficient and robust competitive methods. In the United States, federal funding agencies and foundations collectively distribute billions of dollars annually to support biomedical research. For the American Heart Association, a Peer Review Subcommittee is charged with establishing the highest standards for peer review. This scientific statement reviews the current literature on peer review practices, describes the current American Heart Association peer review process and those of other agencies, analyzes the strengths and weaknesses of American Heart Association peer review practices, and recommends best practices for the future. © 2017 American Heart Association, Inc.

The Impact of Peer Review on Writing in a Psychology Course: Lessons Learned

ERIC Educational Resources Information Center

Bhullar, Naureen; Rose, Karen C.; Utell, Janine M.; Healey, Kathryn N.

2014-01-01

The authors assessed the impact of peer review on student writing in four sections of an undergraduate Developmental Psychology course. They hypothesized that peer review would result in better writing in the peer review group compared to the group with no peer review. Writing was rated independently by two instructors who were blind to the…

Storm Water Management Model (SWMM): Performance Review and Gap Analysis

EPA Science Inventory

The Storm Water Management Model (SWMM) is a widely used tool for urban drainage design and planning. Hundreds of peer-reviewed articles and conference proceedings have been written describing applications of SWMM. This review focused on collecting information on model performanc...

28 CFR 34.111 - Compensation.

Code of Federal Regulations, 2010 CFR

2010-07-01

... Judicial Administration DEPARTMENT OF JUSTICE OJJDP COMPETITION AND PEER REVIEW PROCEDURES Peer Review § 34.111 Compensation. All peer reviewers will be eligible to be paid according to applicable regulations... provided in the OJJDP “Peer Review Guideline”. ...

Total Risk Integrated Methodology (TRIM) - Peer Review and Publications

EPA Pesticide Factsheets

Peer review: Consistent with Agency peer review policy, and the 1994 Agency Task Force on Environmental Regulatory Modeling, internal and external peer review has been an integral part of the TRIM development plan.

A novel program to improve patient safety by integrating peer review into the emergency medicine residency curriculum.

PubMed

Strayer, Reuben J; Shy, Bradley D; Shearer, Peter L

2014-12-01

Evaluating the quality of care as part of a quality improvement process is required in many clinical environments by accrediting bodies. It produces metrics used to evaluate department and individual provider performance, provides outcomes-based feedback to clinicians, and identifies ways to reduce error. To improve patient safety and train our residents to perform peer review, we expanded our quality assurance program from a narrow, administrative process carried out by a small number of attendings to an educationally focused activity of much greater scope incorporating all residents on a monthly basis. We developed an explicit system by which residents analyze sets of high-risk cases and record their impressions onto structured databases, which are reviewed by faculty. At monthly meetings, results from the month's case reviews are presented, learning points discussed, and corrective actions are proposed. By integrating Clinical Quality Review (CQR) as a core, continuous component of the residency curriculum, we increased the number of cases reviewed more than 10-fold and implemented a variety of clinical process improvements. An anonymous survey conducted after 2 years of resident-led CQR indicated that residents value their exposure to the peer review process and feel it benefits them as clinicians, but also that the program requires a significant investment of time that can be burdensome. Copyright © 2014 Elsevier Inc. All rights reserved.

Scholarly publishing depends on peer reviewers.

PubMed

Fernandez-Llimos, Fernando

2018-01-01

The peer-review crisis is posing a risk to the scholarly peer-reviewed journal system. Journals have to ask many potential peer reviewers to obtain a minimum acceptable number of peers accepting reviewing a manuscript. Several solutions have been suggested to overcome this shortage. From reimbursing for the job, to eliminating pre-publication reviews, one cannot predict which is more dangerous for the future of scholarly publishing. And, why not acknowledging their contribution to the final version of the article published? PubMed created two categories of contributors: authors [AU] and collaborators [IR]. Why not a third category for the peer-reviewer?

Incorporating Self and Peer Assessment in Reflective Teaching Practices

ERIC Educational Resources Information Center

Ratminingsih, Ni Made; Artini, Luh Putu; Padmadewi, Ni Nyoman

2017-01-01

More currently literature reviews suggests the use of authentic assessment, which aims to involve students to be more responsible with their learning. This article reports the findings of a descriptive study on student teachers' perception on the use of self and peer assessment to give evaluation on planning the lesson and teaching performance in…

Analysis of Atmospheric Aerosol Data Sets and Application of Radiative Transfer Models to Compute Aerosol Effects

NASA Technical Reports Server (NTRS)

Schmid, Beat; Bergstrom, Robert W.; Redemann, Jens

2002-01-01

This report is the final report for "Analysis of Atmospheric Aerosol Data Sets and Application of Radiative Transfer Models to Compute Aerosol Effects". It is a bibliographic compilation of 29 peer-reviewed publications (published, in press or submitted) produced under this Cooperative Agreement and 30 first-authored conference presentations. The tasks outlined in the various proposals are listed below with a brief comment as to the research performed. Copies of title/abstract pages of peer-reviewed publications are attached.

How long is too long in contemporary peer review? Perspectives from authors publishing in conservation biology journals.

PubMed

Nguyen, Vivian M; Haddaway, Neal R; Gutowsky, Lee F G; Wilson, Alexander D M; Gallagher, Austin J; Donaldson, Michael R; Hammerschlag, Neil; Cooke, Steven J

2015-01-01

Delays in peer reviewed publication may have consequences for both assessment of scientific prowess in academics as well as communication of important information to the knowledge receptor community. We present an analysis on the perspectives of authors publishing in conservation biology journals regarding their opinions on the importance of speed in peer-review as well as how to improve review times. Authors were invited to take part in an online questionnaire, of which the data was subjected to both qualitative (open coding, categorizing) and quantitative analyses (generalized linear models). We received 637 responses to a total of 6,547 e-mail invitations sent. Peer-review speed was generally perceived as slow, with authors experiencing a typical turnaround time of 14 weeks while their perceived optimal review time is six weeks. Male and younger respondents seem to have higher expectations of review speed than females and older respondents. Majority of participants attributed lengthy review times to the 'stress' on the peer-review system (i.e., reviewer and editor fatigue), while editor persistence and journal prestige were believed to speed up the review process. Negative consequences of lengthy review times appear to be greater for early career researchers and can also have impact on author morale (e.g. motivation or frustration). Competition among colleagues were also of concern to respondents. Incentivizing peer review was among the top suggested alterations to the system along with training graduate students in peer review, increased editorial persistence, and changes to the norms of peer-review such as opening the peer-review process to the public. It is clear that authors surveyed in this study view the peer-review system as under stress and we encourage scientists and publishers to push the envelope for new peer review models.

Medical journal peer review: process and bias.

PubMed

Manchikanti, Laxmaiah; Kaye, Alan D; Boswell, Mark V; Hirsch, Joshua A

2015-01-01

Scientific peer review is pivotal in health care research in that it facilitates the evaluation of findings for competence, significance, and originality by qualified experts. While the origins of peer review can be traced to the societies of the eighteenth century, it became an institutionalized part of the scholarly process in the latter half of the twentieth century. This was a response to the growth of research and greater subject specialization. With the current increase in the number of specialty journals, the peer review process continues to evolve to meet the needs of patients, clinicians, and policy makers. The peer review process itself faces challenges. Unblinded peer review might suffer from positive or negative bias towards certain authors, specialties, and institutions. Peer review can also suffer when editors and/or reviewers might be unable to understand the contents of the submitted manuscript. This can result in an inability to detect major flaws, or revelations of major flaws after acceptance of publication by the editors. Other concerns include potentially long delays in publication and challenges uncovering plagiarism, duplication, corruption and scientific misconduct. Conversely, a multitude of these challenges have led to claims of scientific misconduct and an erosion of faith. These challenges have invited criticism of the peer review process itself. However, despite its imperfections, the peer review process enjoys widespread support in the scientific community. Peer review bias is one of the major focuses of today's scientific assessment of the literature. Various types of peer review bias include content-based bias, confirmation bias, bias due to conservatism, bias against interdisciplinary research, publication bias, and the bias of conflicts of interest. Consequently, peer review would benefit from various changes and improvements with appropriate training of reviewers to provide quality reviews to maintain the quality and integrity of research without bias. Thus, an appropriate, transparent peer review is not only ideal, but necessary for the future to facilitate scientific progress.

Peer Review and the Assessment of Higher Education Quality: An International Perspective. Higher Education Report No. 3.

ERIC Educational Resources Information Center

Brennan, John; And Others

This report examines the practices of 19 peer review agencies in the United States, Britain, Denmark, Germany, France, the Netherlands, and Hong Kong to determine variations in peer review in the field of higher education. The report addresses: (1) the sources of authority for peer review; (2) the types and status of peer reviewers; (3) the…

Re-Viewing Peer Review

ERIC Educational Resources Information Center

Flynn, Elizabeth A.

2011-01-01

In this article, the author revisits her essay, "Students as Readers of Their Classmates' Writing," by providing a review of the literature on peer review over the past three decades and comments on patterns she sees in waves of peer review research and theorizing. She describes her subsequent experience with peer review in her own classes, and…

Comparison of self-citation by peer reviewers in a journal with single-blind peer review versus a journal with open peer review.

PubMed

Levis, Alexander W; Leentjens, Albert F G; Levenson, James L; Lumley, Mark A; Thombs, Brett D

2015-12-01

Some peer reviewers may inappropriately, or coercively request that authors include references to the reviewers' own work. The objective of this study was to evaluate whether, compared to reviews for a journal with single-blind peer review, reviews for a journal with open peer review included (1) fewer self-citations; (2) a lower proportion of self-citations without a rationale; and (3) a lower ratio of proportions of citations without a rationale in self-citations versus citations to others' work. Peer reviews for published manuscripts submitted in 2012 to a single-blind peer review journal, the Journal of Psychosomatic Research, were previously evaluated (Thombs et al., 2015). These were compared to publically available peer reviews of manuscripts published in 2012 in an open review journal, BMC Psychiatry. Two investigators independently extracted data for both journals. There were no significant differences between journals in the proportion of all reviewer citations that were self-citations (Journal of Psychosomatic Research: 71/225, 32%; BMC Psychiatry: 90/315, 29%; p=.50), or in the proportion of self-citations without a rationale (Journal of Psychosomatic Research: 15/71, 21%; BMC Psychiatry: 12/90, 13%; p=.21). There was no significant difference between journals in the proportion of self-citations versus citations to others' work without a rationale (p=.31). Blind and open peer review methodologies have distinct advantages and disadvantages. The present study found that, in reasonably similar journals that use single-blind and open review, there were no substantive differences in the pattern of peer reviewer self-citations. Copyright © 2015 Elsevier Inc. All rights reserved.

Advancing Kinesiology through Improved Peer Review

ERIC Educational Resources Information Center

Knudson, Duane V.; Morrow, James R., Jr.; Thomas, Jerry R.

2014-01-01

Peer review of scholarship is essential to journal quality, evidence, knowledge advancement, and application of that knowledge in any field. This commentary summarizes recent literature on issues related to peer-review quality and current review practice in kinesiology and provides recommendations to improve peer review in kinesiology journals. We…

Demystifying the peer-review process - workshop

EPA Science Inventory

Scientific writing and peer-review are integral parts of the publishing process. This workshop aims to demystify the peer-review process for early career scientists and provide insightful tips for streamlining the submission and peer review process for all researchers. Providing ...

Academic Primer Series: Key Papers About Peer Review.

PubMed

Yarris, Lalena M; Gottlieb, Michael; Scott, Kevin; Sampson, Christopher; Rose, Emily; Chan, Teresa M; Ilgen, Jonathan

2017-06-01

Peer review, a cornerstone of academia, promotes rigor and relevance in scientific publishing. As educators are encouraged to adopt a more scholarly approach to medical education, peer review is becoming increasingly important. Junior educators both receive the reviews of their peers, and are also asked to participate as reviewers themselves. As such, it is imperative for junior clinician educators to be well-versed in the art of peer reviewing their colleagues' work. In this article, our goal was to identify and summarize key papers that may be helpful for faculty members interested in learning more about the peer-review process and how to improve their reviewing skills. The online discussions of the 2016-17 Academic Life in Emergency Medicine (ALiEM) Faculty Incubator program included a robust discussion about peer review, which highlighted a number of papers on that topic. We sought to augment this list with further suggestions by guest experts and by an open call on Twitter for other important papers. Via this process, we created a list of 24 total papers on the topic of peer review. After gathering these papers, our authorship group engaged in a consensus-building process incorporating Delphi methods to identify the papers that best described peer review, and also highlighted important tips for new reviewers. We found and reviewed 24 papers. In our results section, we present our authorship group's top five most highly rated papers on the topic of peer review. We also summarize these papers with respect to their relevance to junior faculty members and to faculty developers. We present five key papers on peer review that can be used for faculty development for novice writers and reviewers. These papers represent a mix of foundational and explanatory papers that may provide some basis from which junior faculty members might build upon as they both undergo the peer-review process and act as reviewers in turn.

Academic Primer Series: Key Papers About Peer Review

PubMed Central

Yarris, Lalena M.; Gottlieb, Michael; Scott, Kevin; Sampson, Christopher; Rose, Emily; Chan, Teresa M.; Ilgen, Jonathan

2017-01-01

Introduction Peer review, a cornerstone of academia, promotes rigor and relevance in scientific publishing. As educators are encouraged to adopt a more scholarly approach to medical education, peer review is becoming increasingly important. Junior educators both receive the reviews of their peers, and are also asked to participate as reviewers themselves. As such, it is imperative for junior clinician educators to be well-versed in the art of peer reviewing their colleagues’ work. In this article, our goal was to identify and summarize key papers that may be helpful for faculty members interested in learning more about the peer-review process and how to improve their reviewing skills. Methods The online discussions of the 2016–17 Academic Life in Emergency Medicine (ALiEM) Faculty Incubator program included a robust discussion about peer review, which highlighted a number of papers on that topic. We sought to augment this list with further suggestions by guest experts and by an open call on Twitter for other important papers. Via this process, we created a list of 24 total papers on the topic of peer review. After gathering these papers, our authorship group engaged in a consensus-building process incorporating Delphi methods to identify the papers that best described peer review, and also highlighted important tips for new reviewers. Results We found and reviewed 24 papers. In our results section, we present our authorship group’s top five most highly rated papers on the topic of peer review. We also summarize these papers with respect to their relevance to junior faculty members and to faculty developers. Conclusion We present five key papers on peer review that can be used for faculty development for novice writers and reviewers. These papers represent a mix of foundational and explanatory papers that may provide some basis from which junior faculty members might build upon as they both undergo the peer-review process and act as reviewers in turn. PMID:28611894

Conflicts of interest in medical science: peer usage, peer review and 'CoI consultancy'.

PubMed

Charlton, Bruce G

2004-01-01

In recent years, the perception has grown that conflicts of interest are having a detrimental effect on medical science as it influences health policy and clinical practice, leading medical journals to enforce self-declaration of potential biases in the attempt to counteract or compensate for the problem. Conflict of interest (CoI) declarations have traditionally been considered inappropriate in pure science since its evaluation systems themselves constitute a mechanism for eliminating the effect of individual biases. Pure science is primarily evaluated by 'peer usage', in which scientific information is 'replicated' by being incorporated in the work of other scientists, and tested by further observation of the natural world. Over the long-term, the process works because significant biases impair the quality of science, and bad science tends to be neglected or refuted. However, scientific evaluation operates slowly over years and decades, and only a small proportion of published work is ever actually evaluated. But most of modern medical science no longer conforms to the model of pure science, and may instead be conceptualized as a system of 'applied' science having different aims and evaluation processes. The aim of applied medical science is to solve pre-specified problems, and to provide scientific information ready for implementation immediately following publication. The primary evaluation process of applied science is peer review, not peer usage. Peer review is much more rapid (with a timescale of weeks or months) and cheaper than peer usage and (consequently) has a much wider application: peer review is a prospective validation while peer usage is retrospective. Since applied science consists of incremental advances on existing knowledge achieved using established techniques, its results can usually be reliably evaluated by peer review. However, despite its considerable convenience, peer review has significant limitations related to its reliance on opinion. One major limitation of peer review has proved to be its inability to deal with conflicts of interest, especially in a 'big science' context when prestigious scientists may have similar biases, and conflicts of interest are widely shared among peer reviewers. When applied medical science has been later checked against the slower but more valid processes of peer usage, it seems that reliance on peer review may allow damaging distortions to become 'locked-in' to clinical practice and health policy for considerable periods. Scientific progress is generally underpinned by increasing specialization. Medical journals should specialize in the communication of scientific information, and they have neither the resources nor the motivation to investigate and measure conflicts of interest. Effectively dealing with the problem of conflicts of interest in applied medical science firstly requires a more explicit demarcation between the communications media of pure medical science and applied medical science. Greater specialization of these activities would then allow distinctive aims and evaluation systems to evolve with the expectation of improved performance in both pure and applied systems. In future, applied medical science should operate with an assumption of bias, with the onus of proof on applied medical scientists to facilitate the 'data transparency' necessary to validate their research. Journals of applied medical science will probably require more rigorous processes of peer review than at present, since their publications are intended to be ready for implementation. But since peer review does not adequately filter-out conflicts of interest in applied medical science, there is a need for the evolution of specialist post-publication institutional mechanisms. The suggested solution is to encourage the establishment of independent 'CoI consultancy' services, whose role would be to evaluate conflicts of interest and other biases in published applied medical science prior to their implementation. Such services would be paid-for by the groups who intend to implement applied medical research.

Paired peer review of university classroom teaching in a school of nursing and midwifery.

PubMed

Bennett, Paul N; Parker, Steve; Smigiel, Heather

2012-08-01

Peer review of university classroom teaching can increase the quality of teaching but is not universally practiced in Australian universities. To report an evaluation of paired peer-review process using both paper and web based teaching evaluation tools. Twenty university teachers in one metropolitan Australian School of Nursing and Midwifery were randomly paired and then randomly assigned to a paper based or web-based peer review tool. Each teacher reviewed each other's classroom teaching as part of a peer review program. The participants then completed an 18 question survey evaluating the peer review tool and paired evaluation process. Responses were analyzed using frequencies and percentages. Regardless of the tool used, participants found this process of peer review positive (75%), collegial (78%), supportive (61%) and non-threatening (71%). Participants reported that the peer review will improve their own classroom delivery (61%), teaching evaluation (61%) and planning (53%). The web-based tool was found to be easier to use and allowed more space than the paper-based tool. Implementation of a web-based paired peer review system can be a positive method of peer review of university classroom teaching. Pairing of teachers to review each other's classroom teaching is a promising strategy and has the potential to improve teaching in teaching universities. Copyright © 2011 Elsevier Ltd. All rights reserved.

"I sleep better at night:" How peer review of radiation treatment plans indirectly improves quality of care across radiation treatment programs.

PubMed

Brundage, Michael D; Hart, Margaret; O'Donnell, Jennifer; Reddeman, Lindsay; Gutierrez, Eric; Foxcroft, Sophie; Warde, Padraig

Peer review of radiation oncology treatment plans is increasingly recognized as an important component of quality assurance in radiation treatment planning and delivery. Peer review of treatment plans can directly improve the quality of those plans and can also have indirect effects on radiation treatment programs. We undertook a systematic, qualitative approach to describing the indirect benefits of peer review, factors that were seen to facilitate or act as barriers to the implementation of peer review, and strategies to address these barriers across a provincial jurisdiction of radiation oncology programs (ROPs). Semistructured qualitative interviews were held with radiation oncology department heads and radiation therapy managers (or delegates) in all 14 ROPs in Ontario, Canada. We used a theoretically guided phenomenological qualitative approach to design and analyze the interview content. Themes were recorded by 2 independent reviewers, and any discordance was resolved by consensus. A total of 28 interviews were completed with 32 interviewees. Twenty-two unique themes addressed perceived benefits of peer review, relating to either peer review structure (n = 3), process (n = 9), or outcome (n = 10). Of these 22 themes, 19 related to indirect benefits to ROPs. In addition, 18 themes related to factors that facilitated peer review activities and 30 themes related to key barriers to implementing peer review were identified. Findings were consistent with, and enhanced the understanding of, previous survey-based assessments of the benefits and challenges of implementing peer review programs. Although challenges and concerns regarding the implementation of peer review were evident, the indirect benefits to radiation programs are numerous, far outweigh the implementation challenges, and strongly complement the direct individual-patient benefits that result from peer review quality assurance of radiation treatment plans. Copyright © 2016. Published by Elsevier Inc.

Peer review versus editorial review and their role in innovative science.

PubMed

Steinhauser, Georg; Adlassnig, Wolfram; Risch, Jesaka Ahau; Anderlini, Serena; Arguriou, Petros; Armendariz, Aaron Zolen; Bains, William; Baker, Clark; Barnes, Martin; Barnett, Jonathan; Baumgartner, Michael; Baumgartner, Thomas; Bendall, Charles A; Bender, Yvonne S; Bichler, Max; Biermann, Teresa; Bini, Ronaldo; Blanco, Eduardo; Bleau, John; Brink, Anthony; Brown, Darin; Burghuber, Christopher; Calne, Roy; Carter, Brian; Castaño, Cesar; Celec, Peter; Celis, Maria Eugenia; Clarke, Nicky; Cockrell, David; Collins, David; Coogan, Brian; Craig, Jennifer; Crilly, Cal; Crowe, David; Csoka, Antonei B; Darwich, Chaza; Del Kebos, Topiciprin; Derinaldi, Michele; Dlamini, Bongani; Drewa, Tomasz; Dwyer, Michael; Eder, Fabienne; de Palma, Raúl Ehrichs; Esmay, Dean; Rött, Catherine Evans; Exley, Christopher; Falkov, Robin; Farber, Celia Ingrid; Fearn, William; Felsmann, Sophie; Flensmark, Jarl; Fletcher, Andrew K; Foster, Michaela; Fountoulakis, Kostas N; Fouratt, Jim; Blanca, Jesus Garcia; Sotelo, Manuel Garrido; Gittler, Florian; Gittler, Georg; Gomez, Juan; Gomez, Juan F; Polar, Maria Grazia Gonzales; Gonzalez, Jossina; Gösselsberger, Christoph; Habermacher, Lynn; Hajek, Michael; Hakala, Faith; Haliburton, Mary-Sue; Hankins, John Robert; Hart, Jason; Hasslberger, Sepp; Hennessey, Donalyn; Herrmann, Andrea; Hersee, Mike; Howard, Connie; Humphries, Suzanne; Isharc, Laeeth; Ivanovski, Petar; Jenuth, Stephen; Jerndal, Jens; Johnson, Christine; Keleta, Yonas; Kenny, Anna; Kidd, Billie; Kohle, Fritz; Kolahi, Jafar; Koller-Peroutka, Marianne; Kostova, Lyubov; Kumar, Arunachalam; Kurosawa, Alejandro; Lance, Tony; Lechermann, Michael; Lendl, Bernhard; Leuchters, Michael; Lewis, Evan; Lieb, Edward; Lloyd, Gloria; Losek, Angelika; Lu, Yao; Maestracci, Saadia; Mangan, Dennis; Mares, Alberto W; Barnett, Juan Mazar; McClain, Valerie; McNair, John Sydney; Michael, Terry; Miller, Lloyd; Monzani, Partizia; Moran, Belen; Morris, Mike; Mößmer, Georg; Mountain, Johny; Phuthe, Onnie Mary Moyo; Muñoz, Marcos; Nakken, Sheri; Wambui, Anne Nduta; Neunteufl, Bettina; Nikolić, Dimitrije; Oberoi, Devesh V; Obmode, Gregory; Ogar, Laura; Ohara, Jo; Rybine, Naion Olej; Owen, Bryan; Owen, Kim Wilson; Parikh, Rakesh; Pearce, Nicholas J G; Pemmer, Bernhard; Piper, Chris; Prince, Ian; Reid, Terence; Rindermann, Heiner; Risch, Stefan; Robbins, Josh; Roberts, Seth; Romero, Ajeandro; Rothe, Michael Thaddäus; Ruiz, Sergio; Sacher, Juliane; Sackl, Wolfgang; Salletmaier, Markus; Sanand, Jairaj; Sauerzopf, Clemens; Schwarzgruber, Thomas; Scott, David; Seegers, Laura; Seppi, David; Shields, Kyle; Siller-Matula, Jolanta; Singh, Beldeu; Sithole, Sibusio; Six, Florian; Skoyles, John R; Slofstra, Jildou; Sole, Daphne Anne; Sommer, Werner F; Sonko, Mels; Starr-Casanova, Chrislie J; Steakley, Marjorie Elizabeth; Steinhauser, Wolfgang; Steinhoff, Konstantin; Sterba, Johannes H; Steppan, Martin; Stindl, Reinhard; Stokely, Joe; Stokely, Karri; St-Pierre, Gilles; Stratford, James; Streli, Christina; Stryg, Carl; Sullivan, Mike; Summhammer, Johann; Tadesse, Amhayes; Tavares, David; Thompson, Laura; Tomlinson, Alison; Tozer, Jack; Trevisanato, Siro I; Trimmel, Michaela; Turner, Nicole; Vahur, Paul; van der Byl, Jennie; van der Maas, Tine; Varela, Leo; Vega, Carlos A; Vermaak, Shiloh; Villasenor, Alex; Vogel, Matt; von Wintzigerode, Georg; Wagner, Christoph; Weinberger, Manuel; Weinberger, Peter; Wilson, Nick; Wolfe, Jennifer Finocchio; Woodley, Michael A; Young, Ian; Zuraw, Glenn; Zwiren, Nicole

2012-10-01

Peer review is a widely accepted instrument for raising the quality of science. Peer review limits the enormous unstructured influx of information and the sheer amount of dubious data, which in its absence would plunge science into chaos. In particular, peer review offers the benefit of eliminating papers that suffer from poor craftsmanship or methodological shortcomings, especially in the experimental sciences. However, we believe that peer review is not always appropriate for the evaluation of controversial hypothetical science. We argue that the process of peer review can be prone to bias towards ideas that affirm the prior convictions of reviewers and against innovation and radical new ideas. Innovative hypotheses are thus highly vulnerable to being "filtered out" or made to accord with conventional wisdom by the peer review process. Consequently, having introduced peer review, the Elsevier journal Medical Hypotheses may be unable to continue its tradition as a radical journal allowing discussion of improbable or unconventional ideas. Hence we conclude by asking the publisher to consider re-introducing the system of editorial review to Medical Hypotheses.

On the evolving open peer review culture for chemical information science.

PubMed

Walters, W Patrick; Bajorath, Jürgen

2015-01-01

Compared to the traditional anonymous peer review process, open post-publication peer review provides additional opportunities -and challenges- for reviewers to judge scientific studies. In this editorial, we comment on the open peer review culture and provide some guidance for reviewers of manuscripts submitted to the Chemical Information Science channel of F1000Research.

Online peer support interventions for chronic conditions: a scoping review protocol.

PubMed

Munce, Sarah Elizabeth Patricia; Shepherd, John; Perrier, Laure; Allin, Sonya; Sweet, Shane N; Tomasone, Jennifer R; Nelson, Michelle L A; Guilcher, Sara J T; Hossain, Saima; Jaglal, Susan

2017-09-24

Peer support is receiving increasing attention as both an effective and cost-effective intervention method to support the self-management of chronic health conditions. Given that an increasing proportion of Canadians have internet access and the increasing implementation of web-based interventions, online peer support interventions are a promising option to address the burden of chronic diseases. Thus, the specific research question of this scoping review is the following: What is known from the existing literature about the key characteristics of online peer support interventions for adults with chronic conditions? METHODS AND ANALYSIS: We will use the methodological frameworks used by Arksey and O'Malley as well as Levac and colleagues for the current scoping review. To be eligible for inclusion, studies must report on adults (≥18 years of age) with one of the Public Health Agency of Canada chronic conditions or HIV/AIDS. We will limit our review to peer support interventions delivered through online formats. All study designs will be included. Only studies published from 2012 onwards will be included to ensure relevance to the current healthcare context and feasibility. Furthermore, only English language studies will be included. Studies will be identified by searching a variety of databases. Two reviewers will independently screen the titles and abstracts identified by the literature search for inclusion (ie, level 1 screening), the full text articles (ie, level 2 screening) and then perform data abstraction. Abstracted data will include study characteristics, participant population, key characteristics of the intervention and outcomes collected. This review will identify the key features of online peer support interventions and could assist in the future development of other online peer support programmes so that effective and sustainable programmes can be developed. © Article author(s) (or their employer(s) unless otherwise stated in the text of the article) 2017. All rights reserved. No commercial use is permitted unless otherwise expressly granted.

A novel approach to quality improvement in a safety-net practice: concurrent peer review visits.

PubMed

Fiscella, Kevin; Volpe, Ellen; Winters, Paul; Brown, Melissa; Idris, Amna; Harren, Tricia

2010-12-01

Concurrent peer review visits are structured office visits conducted by clinician peers of the primary care clinician that are specifically designed to reduce competing demands, clinical inertia, and bias. We assessed whether a single concurrent peer review visit reduced clinical inertia and improved control of hypertension, hyperlipidemia, and diabetes control among underserved patients. We conducted a randomized encouragement trial to evaluate concurrent peer review visits with a community health center. Seven hundred twenty-seven patients with hypertension, hyperlipidemia, and/or diabetes who were not at goal for systolic blood pressure (SBP), low-density lipoprotein cholesterol (LDL-C), and/or glycated hemoglobin (A1c) were randomly assigned to an invitation to participate in a concurrent peer review visit or to usual care. We compared change in these measures using mixed models and rates of therapeutic intensification during concurrent peer review visits with control visits. One hundred seventy-one patients completed a concurrent peer review visit. SBP improved significantly (p < .01) more among those completing concurrent peer review visits than among those who failed to respond to a concurrent peer review invitation or those randomized to usual care. There were no differences seen for changes in LDL-C or A1c. Concurrent peer review visits were associated with statistically significant greater clinician intensification of blood pressure (p < .001), lipid (p < .001), and diabetes (p < .005) treatment than either for control visits for patients in either the nonresponse group or usual care group. Concurrent peer review visits represent a promising strategy for improving blood pressure control and improving therapeutic intensification in community health centers.

Peer Review of a Formal Verification/Design Proof Methodology

NASA Technical Reports Server (NTRS)

1983-01-01

The role of formal verification techniques in system validation was examined. The value and the state of the art of performance proving for fault-tolerant compuers were assessed. The investigation, development, and evaluation of performance proving tools were reviewed. The technical issues related to proof methodologies are examined. The technical issues discussed are summarized.

Why Participate in Peer Review as a Journal Manuscript Reviewer: What's in It for You?

PubMed

Pytynia, Kristen B

2017-06-01

The peer review process for scientific journals relies on the efforts of volunteer reviewers. Reviewers are selected due to their expertise in their fields. With so many demands on professional time, the benefits of participating in peer review may not be obvious. However, reviewers benefit by exposure to the latest developments in their fields, facilitating their keeping up-to-date with the latest publications. Tenure committees look favorably on participation in peer review, and invitations to review underscore that the reviewer is a respected subject matter expert. Contacts made during the peer review process can lead to long-lasting collaboration. Continuing medical education credit can be obtained through various mechanisms. Overall, participating in peer review is an important part of career development and should be viewed as a critical component of advancement.

Subspecialty Influence on Scientific Peer Review for an Obstetrics and Gynecology Journal With a High Impact Factor.

PubMed

Parikh, Laura I; Benner, Rebecca S; Riggs, Thomas W; Hazen, Nicholas; Chescheir, Nancy C

2017-02-01

To evaluate whether quality of peer review and reviewer recommendation differ based on reviewer subspecialty in obstetrics and gynecology and to determine the role of experience on reviewer recommendation. We performed a retrospective cohort study of reviews submitted to Obstetrics & Gynecology between January 2010 and December 2014. Subspecialties were determined based on classification terms selected by each reviewer and included all major obstetrics and gynecology subspecialties, general obstetrics and gynecology, and nonobstetrics and gynecology categories. Review quality (graded on a 5-point Likert scale by the journal's editors) and reviewer recommendation of "reject" were compared across subspecialties using χ, analysis of variance, and multivariate logistic regression. There were 20,027 reviews from 1,889 individual reviewers. Reviewers with family planning subspecialty provided higher-quality peer reviews compared with reviewers with gynecology only, reproductive endocrinology and infertility, gynecologic oncology, and general obstetrics and gynecology specialties (3.61±0.75 compared with 3.44±0.78, 3.42±0.72, 3.35±0.75, and 3.32±0.81, respectively, P<.05). Reviewers with gynecology-only subspecialty recommended rejection more often compared with reviewers with a nonobstetrics and gynecology subspecialty (57.7% compared with 38.7%, P<.05). Editorial Board members recommended rejection more often than new reviewers (68.0% compared with 41.5%, P<.05). Increased adjusted odds of manuscript rejection recommendation were associated with reproductive endocrinology, female pelvic medicine and reconstructive surgery, and gynecology-only reviewer subspecialty (adjusted odds ratio [OR] 1.23 [1.07-1.41], 1.21 [1.05-1.39], and 1.11 [1.02-1.20]). Manuscript rejection recommendation rate was also increased for reviewers who had completed the highest quintile of peer reviews (greater than 195) compared with the lowest quintile (one to seven) (adjusted OR 2.85 [2.60-3.12]). Peer review quality differs based on obstetrics and gynecology subspecialty. Obstetrics and gynecology subspecialty and reviewer experience have implications for manuscript rejection recommendation. Reviewer assignment is pivotal to maintaining a rigorous manuscript selection process.

48 CFR 215.270 - Peer Reviews.

Code of Federal Regulations, 2010 CFR

2010-10-01

... 48 Federal Acquisition Regulations System 3 2010-10-01 2010-10-01 false Peer Reviews. 215.270 Section 215.270 Federal Acquisition Regulations System DEFENSE ACQUISITION REGULATIONS SYSTEM, DEPARTMENT... of Proposals and Information 215.270 Peer Reviews. Agency officials shall conduct Peer Reviews in...

Lessons from Peer Support Among Individuals with Mental Health Difficulties: A Review of the Literature

PubMed Central

Miyamoto, Yuki; Sono, Tamaki

2012-01-01

We conducted a comprehensive narrative review and used a systematic search strategy to identify studies related to peer support among adults with mental health difficulties. The purposes of this review were to describe the principles, effects and benefits of peer support documented in the published literature, to discuss challenging aspects of peer support and to investigate lessons from peer support. Fifty-one studies, including 8 review articles and 19 qualitative studies, met the inclusion criteria for this review. Most of the challenges for peer support were related to “role” and “relationship” issues; that is, how peer support providers relate to people who receive peer support and how peer support providers are treated in the system. The knowledge gained from peer support relationships, such as mutual responsibility and interdependence, might be a clue toward redefining the helper-helper relationship as well as the concepts of help and support. PMID:22563347

Retrospective analysis of the quality of reports by author-suggested and non-author-suggested reviewers in journals operating on open or single-blind peer review models

PubMed Central

Kowalczuk, Maria K; Dudbridge, Frank; Nanda, Shreeya; Harriman, Stephanie L; Patel, Jigisha; Moylan, Elizabeth C

2015-01-01

Objectives To assess whether reports from reviewers recommended by authors show a bias in quality and recommendation for editorial decision, compared with reviewers suggested by other parties, and whether reviewer reports for journals operating on open or single-blind peer review models differ with regard to report quality and reviewer recommendations. Design Retrospective analysis of the quality of reviewer reports using an established Review Quality Instrument, and analysis of reviewer recommendations and author satisfaction surveys. Setting BioMed Central biology and medical journals. BMC Infectious Diseases and BMC Microbiology are similar in size, rejection rates, impact factors and editorial processes, but the former uses open peer review while the latter uses single-blind peer review. The Journal of Inflammation has operated under both peer review models. Sample Two hundred reviewer reports submitted to BMC Infectious Diseases, 200 reviewer reports submitted to BMC Microbiology and 400 reviewer reports submitted to the Journal of Inflammation. Results For each journal, author-suggested reviewers provided reports of comparable quality to non-author-suggested reviewers, but were significantly more likely to recommend acceptance, irrespective of the peer review model (p<0.0001 for BMC Infectious Diseases, BMC Microbiology and the Journal of Inflammation). For BMC Infectious Diseases, the overall quality of reviewer reports measured by the Review Quality Instrument was 5% higher than for BMC Microbiology (p=0.042). For the Journal of Inflammation, the quality of reports was the same irrespective of the peer review model used. Conclusions Reviewers suggested by authors provide reports of comparable quality to non-author-suggested reviewers, but are significantly more likely to recommend acceptance. Open peer review reports for BMC Infectious Diseases were of higher quality than single-blind reports for BMC Microbiology. There was no difference in quality of peer review in the Journal of Inflammation under open peer review compared with single blind. PMID:26423855

42 CFR 24.5 - Peer review.

Code of Federal Regulations, 2010 CFR

2010-10-01

... 42 Public Health 1 2010-10-01 2010-10-01 false Peer review. 24.5 Section 24.5 Public Health PUBLIC....5 Peer review. An individual may not be considered for appointment into the SBRS unless his/her qualifications have been reviewed by a PHS peer review committee and the committee has recommended appointment to...

Rethinking Feedback Practices in Higher Education: A Peer Review Perspective

ERIC Educational Resources Information Center

Nicol, David; Thomson, Avril; Breslin, Caroline

2014-01-01

Peer review is a reciprocal process whereby students produce feedback reviews on the work of peers and receive feedback reviews from peers on their own work. Prior research has primarily examined the learning benefits that result from the receipt of feedback reviews, with few studies specifically exploring the merits of producing feedback reviews…

32 CFR 199.15 - Quality and utilization review peer review organization program.

Code of Federal Regulations, 2013 CFR

2013-07-01

... Director, OCHAMPUS. These contractors may include contractors that have exclusive functions in the area of utilization and quality review, fiscal intermediary contractors (which perform these functions along with a... functions concerning management of the delivery and financing of health care services under CHAMPUS...

What is open peer review? A systematic review.

PubMed

Ross-Hellauer, Tony

2017-01-01

Background : "Open peer review" (OPR), despite being a major pillar of Open Science, has neither a standardized definition nor an agreed schema of its features and implementations. The literature reflects this, with numerous overlapping and contradictory definitions. While for some the term refers to peer review where the identities of both author and reviewer are disclosed to each other, for others it signifies systems where reviewer reports are published alongside articles. For others it signifies both of these conditions, and for yet others it describes systems where not only "invited experts" are able to comment. For still others, it includes a variety of combinations of these and other novel methods. Methods : Recognising the absence of a consensus view on what open peer review is, this article undertakes a systematic review of definitions of "open peer review" or "open review", to create a corpus of 122 definitions. These definitions are systematically analysed to build a coherent typology of the various innovations in peer review signified by the term, and hence provide the precise technical definition currently lacking. Results : This quantifiable data yields rich information on the range and extent of differing definitions over time and by broad subject area. Quantifying definitions in this way allows us to accurately portray exactly how ambiguously the phrase "open peer review" has been used thus far, for the literature offers 22 distinct configurations of seven traits, effectively meaning that there are 22 different definitions of OPR in the literature reviewed. Conclusions : I propose a pragmatic definition of open peer review as an umbrella term for a number of overlapping ways that peer review models can be adapted in line with the aims of Open Science, including making reviewer and author identities open, publishing review reports and enabling greater participation in the peer review process.

Emerging Evidence on the Use of Big Data and Analytics in Workplace Learning: A Systematic Literature Review

ERIC Educational Resources Information Center

Giacumo, Lisa A.; Breman, Jeroen

2016-01-01

This article provides a systematic literature review about nonprofit and for-profit organizations using "big data" to inform performance improvement initiatives. The review of literature resulted in 4 peer-reviewed articles and an additional 33 studies covering the topic for these contexts. The review found that big data and analytics…

The Value of Peer Feedback Opportunities for Students in Writing Intensive Classes

ERIC Educational Resources Information Center

Kennette, Lynne N.; Frank, Nichole M.

2013-01-01

The present study was conducted to examine the usefulness of peer feedback on APA-style research papers in a writing-intensive class. Subsequent to APA training, students were asked to review and provide feedback on a classmate's APA-style research report for both content and formatting. Performance on this research report was then compared to…

Peer Review Quality and Transparency of the Peer-Review Process in Open Access and Subscription Journals.

PubMed

Wicherts, Jelte M

2016-01-01

Recent controversies highlighting substandard peer review in Open Access (OA) and traditional (subscription) journals have increased the need for authors, funders, publishers, and institutions to assure quality of peer-review in academic journals. I propose that transparency of the peer-review process may be seen as an indicator of the quality of peer-review, and develop and validate a tool enabling different stakeholders to assess transparency of the peer-review process. Based on editorial guidelines and best practices, I developed a 14-item tool to rate transparency of the peer-review process on the basis of journals' websites. In Study 1, a random sample of 231 authors of papers in 92 subscription journals in different fields rated transparency of the journals that published their work. Authors' ratings of the transparency were positively associated with quality of the peer-review process but unrelated to journal's impact factors. In Study 2, 20 experts on OA publishing assessed the transparency of established (non-OA) journals, OA journals categorized as being published by potential predatory publishers, and journals from the Directory of Open Access Journals (DOAJ). Results show high reliability across items (α = .91) and sufficient reliability across raters. Ratings differentiated the three types of journals well. In Study 3, academic librarians rated a random sample of 140 DOAJ journals and another 54 journals that had received a hoax paper written by Bohannon to test peer-review quality. Journals with higher transparency ratings were less likely to accept the flawed paper and showed higher impact as measured by the h5 index from Google Scholar. The tool to assess transparency of the peer-review process at academic journals shows promising reliability and validity. The transparency of the peer-review process can be seen as an indicator of peer-review quality allowing the tool to be used to predict academic quality in new journals.

Peer Review Quality and Transparency of the Peer-Review Process in Open Access and Subscription Journals

PubMed Central

Wicherts, Jelte M.

2016-01-01

Background Recent controversies highlighting substandard peer review in Open Access (OA) and traditional (subscription) journals have increased the need for authors, funders, publishers, and institutions to assure quality of peer-review in academic journals. I propose that transparency of the peer-review process may be seen as an indicator of the quality of peer-review, and develop and validate a tool enabling different stakeholders to assess transparency of the peer-review process. Methods and Findings Based on editorial guidelines and best practices, I developed a 14-item tool to rate transparency of the peer-review process on the basis of journals’ websites. In Study 1, a random sample of 231 authors of papers in 92 subscription journals in different fields rated transparency of the journals that published their work. Authors’ ratings of the transparency were positively associated with quality of the peer-review process but unrelated to journal’s impact factors. In Study 2, 20 experts on OA publishing assessed the transparency of established (non-OA) journals, OA journals categorized as being published by potential predatory publishers, and journals from the Directory of Open Access Journals (DOAJ). Results show high reliability across items (α = .91) and sufficient reliability across raters. Ratings differentiated the three types of journals well. In Study 3, academic librarians rated a random sample of 140 DOAJ journals and another 54 journals that had received a hoax paper written by Bohannon to test peer-review quality. Journals with higher transparency ratings were less likely to accept the flawed paper and showed higher impact as measured by the h5 index from Google Scholar. Conclusions The tool to assess transparency of the peer-review process at academic journals shows promising reliability and validity. The transparency of the peer-review process can be seen as an indicator of peer-review quality allowing the tool to be used to predict academic quality in new journals. PMID:26824759

Detailed prospective peer review in a community radiation oncology clinic.

PubMed

Mitchell, James D; Chesnut, Thomas J; Eastham, David V; Demandante, Carlo N; Hoopes, David J

In 2012, we instituted detailed prospective peer review of new cases. We present the outcomes of peer review on patient management and time required for peer review. Peer review rounds were held 3 to 4 days weekly and required 2 physicians to review pertinent information from the electronic medical record and treatment planning system. Eight aspects were reviewed for each case: 1) workup and staging; 2) treatment intent and prescription; 3) position, immobilization, and simulation; 4) motion assessment and management; 5) target contours; 6) normal tissue contours; 7) target dosimetry; and 8) normal tissue dosimetry. Cases were marked as, "Meets standard of care," "Variation," or "Major deviation." Changes in treatment plan were noted. As our process evolved, we recorded the time spent reviewing each case. From 2012 to 2014, we collected peer review data on 442 of 465 (95%) radiation therapy patients treated in our hospital-based clinic. Overall, 91 (20.6%) of the cases were marked as having a variation, and 3 (0.7%) as major deviation. Forty-two (9.5%) of the cases were altered after peer review. An overall peer review score of "Variation" or "Major deviation" was highly associated with a change in treatment plan (P < .01). Changes in target contours were recommended in 10% of cases. Gastrointestinal cases were significantly associated with a change in treatment plan after peer review. Indicators on position, immobilization, simulation, target contours, target dosimetry, motion management, normal tissue contours, and normal tissue dosimetry were significantly associated with a change in treatment plan. The mean time spent on each case was 7 minutes. Prospective peer review is feasible in a community radiation oncology practice. Our process led to changes in 9.5% of cases. Peer review should focus on technical factors such as target contours and dosimetry. Peer review required 7 minutes per case. Published by Elsevier Inc.

Peer-Mediated Theatrical Engagement for Improving Reciprocal Social Interaction in Autism Spectrum Disorder

PubMed Central

Corbett, Blythe A.; Qualls, Lydia R.; Valencia, Blythe; Fecteau, Stéphanie-M.; Swain, Deanna M.

2014-01-01

The hallmark characteristic of autism spectrum disorder (ASD) is poor reciprocal social communication. Interventions designed to improve this core deficit are critically needed. Social skills interventions such as direct training, peer mediation, and video modeling have contributed to improvements in various social skills in children with ASD. This paper reviews existing social competence interventions available for children with ASD while highlighting hypothesized critical components for advancing, maintaining, and generalizing skills, which include (1) peer mediation, (2) active learning, and (3) implementation in supportive, natural contexts. As a framework for these approaches, this conceptual paper describes SENSE Theatre, a novel intervention that combines trained peers that facilitate the performance-based theatrical treatment delivered in a supportive, community-based environment. A review of previous research shows early feasibility, setting the stage for more rigorous studies to aid in developing a standardized intervention package. PMID:25346926

Using a Teaching Intervention and Calibrated Peer Review™ Diagnostics to Improve Visual Communication Skills.

PubMed

Saterbak, Ann; Moturu, Anoosha; Volz, Tracy

2018-03-01

Rice University's bioengineering department incorporates written, oral, and visual communication instruction into its undergraduate curriculum to aid student learning and to prepare students to communicate their knowledge and discoveries precisely and persuasively. In a tissue culture lab course, we used a self- and peer-review tool called Calibrated Peer Review™ (CPR) to diagnose student learning gaps in visual communication skills on a poster assignment. We then designed an active learning intervention that required students to practice the visual communication skills that needed improvement and used CPR to measure the changes. After the intervention, we observed that students performed significantly better in their ability to develop high quality graphs and tables that represent experimental data. Based on these outcomes, we conclude that guided task practice, collaborative learning, and calibrated peer review can be used to improve engineering students' visual communication skills.

How Long Is Too Long in Contemporary Peer Review? Perspectives from Authors Publishing in Conservation Biology Journals

PubMed Central

Nguyen, Vivian M.; Haddaway, Neal R.; Gutowsky, Lee F. G.; Wilson, Alexander D. M.; Gallagher, Austin J.; Donaldson, Michael R.; Hammerschlag, Neil; Cooke, Steven J.

2015-01-01

Delays in peer reviewed publication may have consequences for both assessment of scientific prowess in academia as well as communication of important information to the knowledge receptor community. We present an analysis on the perspectives of authors publishing in conservation biology journals regarding their opinions on the importance of speed in peer-review as well as how to improve review times. Authors were invited to take part in an online questionnaire, of which the data was subjected to both qualitative (open coding, categorizing) and quantitative analyses (generalized linear models). We received 637 responses to 6,547 e-mail invitations sent. Peer-review speed was generally perceived as slow, with authors experiencing a typical turnaround time of 14 weeks while their perceived optimal review time was six weeks. Male and younger respondents seem to have higher expectations of review speed than females and older respondents. The majority of participants attributed lengthy review times to reviewer and editor fatigue, while editor persistence and journal prestige were believed to speed up the review process. Negative consequences of lengthy review times were perceived to be greater for early career researchers and to have impact on author morale (e.g. motivation or frustration). Competition among colleagues was also of concern to respondents. Incentivizing peer-review was among the top suggested alterations to the system along with training graduate students in peer-review, increased editorial persistence, and changes to the norms of peer-review such as opening the peer-review process to the public. It is clear that authors surveyed in this study viewed the peer-review system as under stress and we encourage scientists and publishers to push the envelope for new peer-review models. PMID:26267491

Connecting Technological Innovation in Artificial Intelligence to Real-world Medical Practice through Rigorous Clinical Validation: What Peer-reviewed Medical Journals Could Do

PubMed Central

2018-01-01

Artificial intelligence (AI) is projected to substantially influence clinical practice in the foreseeable future. However, despite the excitement around the technologies, it is yet rare to see examples of robust clinical validation of the technologies and, as a result, very few are currently in clinical use. A thorough, systematic validation of AI technologies using adequately designed clinical research studies before their integration into clinical practice is critical to ensure patient benefit and safety while avoiding any inadvertent harms. We would like to suggest several specific points regarding the role that peer-reviewed medical journals can play, in terms of study design, registration, and reporting, to help achieve proper and meaningful clinical validation of AI technologies designed to make medical diagnosis and prediction, focusing on the evaluation of diagnostic accuracy efficacy. Peer-reviewed medical journals can encourage investigators who wish to validate the performance of AI systems for medical diagnosis and prediction to pay closer attention to the factors listed in this article by emphasizing their importance. Thereby, peer-reviewed medical journals can ultimately facilitate translating the technological innovations into real-world practice while securing patient safety and benefit. PMID:29805337

Connecting Technological Innovation in Artificial Intelligence to Real-world Medical Practice through Rigorous Clinical Validation: What Peer-reviewed Medical Journals Could Do.

PubMed

Park, Seong Ho; Kressel, Herbert Y

2018-05-28

Artificial intelligence (AI) is projected to substantially influence clinical practice in the foreseeable future. However, despite the excitement around the technologies, it is yet rare to see examples of robust clinical validation of the technologies and, as a result, very few are currently in clinical use. A thorough, systematic validation of AI technologies using adequately designed clinical research studies before their integration into clinical practice is critical to ensure patient benefit and safety while avoiding any inadvertent harms. We would like to suggest several specific points regarding the role that peer-reviewed medical journals can play, in terms of study design, registration, and reporting, to help achieve proper and meaningful clinical validation of AI technologies designed to make medical diagnosis and prediction, focusing on the evaluation of diagnostic accuracy efficacy. Peer-reviewed medical journals can encourage investigators who wish to validate the performance of AI systems for medical diagnosis and prediction to pay closer attention to the factors listed in this article by emphasizing their importance. Thereby, peer-reviewed medical journals can ultimately facilitate translating the technological innovations into real-world practice while securing patient safety and benefit.

Peer-supported review of teaching: making the grade in midwifery and nursing education.

PubMed

Murphy Tighe, Sylvia; Bradshaw, Carmel

2013-11-01

This paper outlines the value of peer-supported review of teaching for nurse and midwifery educators in an academic environment. Reflection and continuing professional development are important tenets of an educators' practice and can be addressed via peer observation. Definitions and models of peer observation are presented. The strengths and challenges associated with peer-supported review of teaching are discussed. The reasons why peer observation is underutilised are explored with some suggestions on how to overcome these challenges. Recent developments in relation to peer observation and peer-supported review are outlined. The need for tangible evidence of development and enhancement of existing teaching expertise is very pronounced in the current economic climate, it is concluded that peer-supported review of teaching can provide such evidence. Copyright © 2012 Elsevier Ltd. All rights reserved.

Peer review in hematopoietic cell transplantation: are we doing our fair share?

PubMed

Giralt, S; Korngold, R; Lazarus, H M

2016-09-01

Peer review is believed to be important in maintaining the quality and integrity of research in academic endeavors. Recently, the value of the current peer review process, which is more than 100 years old has come into question. In the field of hematopoietic cell transplantation (HCT), peer review was unable to prevent the publication of the largest and most notorious scientific fraud in our field. In order to assess how the HCT community views and how engaged it is with the peer review process, the American Society of Blood and Marrow Transplantation conducted a survey of all of its members in 2014. The survey was sent to all active members through multiple email communications in August and September 2014. Of a total of 1183 members, 149 responded. Almost all of the respondents had participated in the peer review process, with few respondents declining ever to review manuscripts. The most common cause for declining review requests was lack of time. Most respondents (68%) thought that the current peer review process was relatively fair and unbiased, whereas only 9% of the respondents stated that they did not believe in the peer review process. In conclusion, among the respondents of this survey most felt the peer review process to be valuable and fair, however, the lack of response suggests that further study into improving the peer review process in the field of HCT is warranted in the era of electronic publishing and communication.

The Potential of Peer Review

ERIC Educational Resources Information Center

Johnson, Susan Moore; Fiarman, Sarah E.

2012-01-01

Peer review of teachers is controversial for several reasons. Some say peer reviewers encroach on the rightful domain of the principal as instructional leader. Others argue that, because peer evaluators are fellow teachers, they may be biased or unwilling to make hard decisions. Many teachers find the prospect of peer evaluation unsettling because…

28 CFR 34.105 - Peer review methods.

Code of Federal Regulations, 2010 CFR

2010-07-01

... 28 Judicial Administration 1 2010-07-01 2010-07-01 false Peer review methods. 34.105 Section 34... Review § 34.105 Peer review methods. (a) For both competitive and noncompetitive applications, peer... announcement or otherwise established by the Administrator, together with the assignment of numerical values...

7 CFR 3400.21 - Scientific peer review for research activities.

Code of Federal Regulations, 2010 CFR

2010-01-01

... 7 Agriculture 15 2010-01-01 2010-01-01 false Scientific peer review for research activities. 3400... STATE RESEARCH, EDUCATION, AND EXTENSION SERVICE, DEPARTMENT OF AGRICULTURE SPECIAL RESEARCH GRANTS PROGRAM Peer and Merit Review Arranged by Grantees § 3400.21 Scientific peer review for research...

28 CFR 34.109 - Qualifications of peer reviewers.

Code of Federal Regulations, 2014 CFR

2014-07-01

... be used in the selection of peer reviewers are: (a) Generalized knowledge of juvenile justice or... 28 Judicial Administration 1 2014-07-01 2014-07-01 false Qualifications of peer reviewers. 34.109 Section 34.109 Judicial Administration DEPARTMENT OF JUSTICE OJJDP COMPETITION AND PEER REVIEW PROCEDURES...

28 CFR 34.109 - Qualifications of peer reviewers.

Code of Federal Regulations, 2013 CFR

2013-07-01

... be used in the selection of peer reviewers are: (a) Generalized knowledge of juvenile justice or... 28 Judicial Administration 1 2013-07-01 2013-07-01 false Qualifications of peer reviewers. 34.109 Section 34.109 Judicial Administration DEPARTMENT OF JUSTICE OJJDP COMPETITION AND PEER REVIEW PROCEDURES...

28 CFR 34.109 - Qualifications of peer reviewers.

Code of Federal Regulations, 2012 CFR

2012-07-01

... be used in the selection of peer reviewers are: (a) Generalized knowledge of juvenile justice or... 28 Judicial Administration 1 2012-07-01 2012-07-01 false Qualifications of peer reviewers. 34.109 Section 34.109 Judicial Administration DEPARTMENT OF JUSTICE OJJDP COMPETITION AND PEER REVIEW PROCEDURES...

28 CFR 34.109 - Qualifications of peer reviewers.

Code of Federal Regulations, 2011 CFR

2011-07-01

... be used in the selection of peer reviewers are: (a) Generalized knowledge of juvenile justice or... 28 Judicial Administration 1 2011-07-01 2011-07-01 false Qualifications of peer reviewers. 34.109 Section 34.109 Judicial Administration DEPARTMENT OF JUSTICE OJJDP COMPETITION AND PEER REVIEW PROCEDURES...

Commercial Lighting Solutions Webtool Peer Review Report, Office Solutions

DOE Office of Scientific and Technical Information (OSTI.GOV)

Beeson, Tracy A.; Jones, Carol C.

2010-02-01

The Commercial Lighting Solutions (CLS) project directly supports the U.S. Department of Energy’s Commercial Building Energy Alliance efforts to design high performance buildings. CLS creates energy efficient best practice lighting designs for widespread use, and they are made available to users via an interactive webtool that both educates and guides the end user through the application of the Lighting Solutions. This report summarizes the peer review of the CLS webtool for offices. The methodology for the peer review process included data collection (stakeholder input), analysis of the comments, and organization of the input into categories for prioritization of the commentsmore » against a set of criteria. Based on this process, recommendations were developed for the release of version 2.0 of the webtool at the Lightfair conference in Las Vegas in May 2010. The report provides a list of the top ten most significant and relevant improvements that will be made within the webtool for version 2.0 as well as appendices containing the comments and short-term priorities in additional detail. Peer review comments that are considered high priority by the reviewers and the CLS team but cannot be completed for Version 2.0 are listed as long-term recommendations.« less

Peer Review of Teaching: Sharing Best Practices

ERIC Educational Resources Information Center

Golparian, Shaya; Chan, Judy; Cassidy, Alice

2015-01-01

In this paper, we share examples of best peer review of teaching practices, drawing on our involvement in the design and implementation of the Peer Review of Teaching program at the Centre for Teaching, Learning and Technology. We review the history of the Peer Review of Teaching Initiative at the University of British Columbia and explain key…

Adolescent peer group identification and characteristics: A review of the literature

PubMed Central

Sussman, Steve; Pokhrel, Pallav; Ashmore, Richard D.; Brown, B. Bradford

2011-01-01

This study provides an exhaustive review of 44 peer-reviewed quantitative or qualitative data-based peer-reviewed studies completed on adolescent peer group identification. Adolescent peer group identification is one’s self-perceived or other-perceived membership in discrete teenage peer groups. The studies reviewed suggest that adolescent peer groups consist of five general categories differentiable by lifestyle characteristics: Elites, Athletes, Academics, Deviants, and Others. We found that the Deviant adolescent group category reported relatively greater participation in drug use and other problem behaviors across studies, whereas Academics and Athletes exhibited the least participation in these problem behaviors. Additional research is needed in this arena to better understand the operation of adolescent group labels. PMID:17188815

A survey of quality assurance practices in biomedical open source software projects.

PubMed

Koru, Günes; El Emam, Khaled; Neisa, Angelica; Umarji, Medha

2007-05-07

Open source (OS) software is continuously gaining recognition and use in the biomedical domain, for example, in health informatics and bioinformatics. Given the mission critical nature of applications in this domain and their potential impact on patient safety, it is important to understand to what degree and how effectively biomedical OS developers perform standard quality assurance (QA) activities such as peer reviews and testing. This would allow the users of biomedical OS software to better understand the quality risks, if any, and the developers to identify process improvement opportunities to produce higher quality software. A survey of developers working on biomedical OS projects was conducted to examine the QA activities that are performed. We took a descriptive approach to summarize the implementation of QA activities and then examined some of the factors that may be related to the implementation of such practices. Our descriptive results show that 63% (95% CI, 54-72) of projects did not include peer reviews in their development process, while 82% (95% CI, 75-89) did include testing. Approximately 74% (95% CI, 67-81) of developers did not have a background in computing, 80% (95% CI, 74-87) were paid for their contributions to the project, and 52% (95% CI, 43-60) had PhDs. A multivariate logistic regression model to predict the implementation of peer reviews was not significant (likelihood ratio test = 16.86, 9 df, P = .051) and neither was a model to predict the implementation of testing (likelihood ratio test = 3.34, 9 df, P = .95). Less attention is paid to peer review than testing. However, the former is a complementary, and necessary, QA practice rather than an alternative. Therefore, one can argue that there are quality risks, at least at this point in time, in transitioning biomedical OS software into any critical settings that may have operational, financial, or safety implications. Developers of biomedical OS applications should invest more effort in implementing systemic peer review practices throughout the development and maintenance processes.

28 CFR 34.104 - Use of peer review.

Code of Federal Regulations, 2010 CFR

2010-07-01

... 28 Judicial Administration 1 2010-07-01 2010-07-01 false Use of peer review. 34.104 Section 34.104 Judicial Administration DEPARTMENT OF JUSTICE OJJDP COMPETITION AND PEER REVIEW PROCEDURES Peer Review § 34... programs for which a large number of applications is expected, preapplications (concept papers) may be...

The Potential of Dual-Language Cross-Cultural Peer Review

ERIC Educational Resources Information Center

Ruecker, Todd

2011-01-01

This article explores the potential of dual-language cross-cultural peer review and how it improves on traditional monolingual and monocultural peer review. Drawing on scholarship related to international exchange programmes, peer review, and two-way immersion programmes in the United States as well as data collected while facilitating the…

7 CFR 550.17 - Peer review.

Code of Federal Regulations, 2010 CFR

2010-01-01

... 7 Agriculture 6 2010-01-01 2010-01-01 false Peer review. 550.17 Section 550.17 Agriculture... § 550.17 Peer review. Upon request of the REE Agency, cooperators may be requested to provide documentation in support of peer review activities and cooperator personnel may be requested to participate in...

7 CFR 3411.10 - Establishment and operation of peer review groups.

Code of Federal Regulations, 2011 CFR

2011-01-01

... INSTITUTE OF FOOD AND AGRICULTURE NATIONAL RESEARCH INITIATIVE COMPETITIVE GRANTS PROGRAM Scientific Peer Review of Research Grant Applications § 3411.10 Establishment and operation of peer review groups. Subject to § 3411.5, the Administrator shall adopt procedures for the conduct of peer reviews and the...

Toward the Integration of Peer Reviewing and Computational Linguistics Approaches

ERIC Educational Resources Information Center

Park, Juhwa; Cho, Kwangsu

2017-01-01

Previous research has shown the effectiveness of peer reviewing on the improvement of writing quality. However, the fact that students themselves, arguably novices, judged the improvement leads to concerns about the validity of peer reviewing. We measured writing quality before and after peer reviewing using Coh-Metrix, which computationally…

Protecting the pipeline of science: openness, scientific methods and the lessons from ticagrelor and the PLATO trial.

PubMed

Coats, Andrew J Stewart; Nijjer, Sukhjinder S; Francis, Darrel P

2014-10-20

Ticagrelor, a potent antiplatelet, has been shown to be beneficial in patients with acute coronary syndromes in a randomised controlled trial published in a highly ranked peer reviewed journal. Accordingly it has entered guidelines and has been approved for clinical use by authorities. However, there remains a controversy regarding aspects of the PLATO trial, which are not immediately apparent from the peer-reviewed publications. A number of publications have sought to highlight potential discrepancies, using data available in publicly published documents from the US Food and Drug Administration (FDA) leading to disagreement regarding the value of open science and data sharing. We reflect upon potential sources of bias present in even rigorously performed randomised controlled trials, on whether peer review can establish the presence of bias and the need to constantly challenge and question even accepted data. Copyright © 2014 Elsevier Ireland Ltd. All rights reserved.

Collaborative Learning through Formative Peer Review: Pedagogy, Programs and Potential

ERIC Educational Resources Information Center

Sondergaard, Harald; Mulder, Raoul A.

2012-01-01

We examine student peer review, with an emphasis on formative practice and collaborative learning, rather than peer grading. Opportunities to engage students in such formative peer assessment are growing, as a range of online tools become available to manage and simplify the process of administering student peer review. We consider whether…

Writing to Learn: An Evaluation of the Calibrated Peer Review™ Program in Two Neuroscience Courses

PubMed Central

Prichard, J. Roxanne

2005-01-01

Although the majority of scientific information is communicated in written form, and peer review is the primary process by which it is validated, undergraduate students may receive little direct training in science writing or peer review. Here, I describe the use of Calibrated Peer Review™ (CPR), a free, web-based writing and peer review program designed to alleviate instructor workload, in two undergraduate neuroscience courses: an upper- level sensation and perception course (41 students, three assignments) and an introductory neuroscience course (50 students; two assignments). Using CPR online, students reviewed primary research articles on assigned ‘hot’ topics, wrote short essays in response to specific guiding questions, reviewed standard ‘calibration’ essays, and provided anonymous quantitative and qualitative peer reviews. An automated grading system calculated the final scores based on a student’s essay quality (as determined by the average of three peer reviews) and his or her accuracy in evaluating 1) three standard calibration essays, 2) three anonymous peer reviews, and 3) his or her self review. Thus, students were assessed not only on their skill at constructing logical, evidence-based arguments, but also on their ability to accurately evaluate their peers’ writing. According to both student self-reports and instructor observation, students’ writing and peer review skills improved over the course of the semester. Student evaluation of the CPR program was mixed; while some students felt like the peer review process enhanced their understanding of the material and improved their writing, others felt as though the process was biased and required too much time. Despite student critiques of the program, I still recommend the CPR program as an excellent and free resource for incorporating more writing, peer review, and critical thinking into an undergraduate neuroscience curriculum. PMID:23493247

The evolution of peer review as a basis for scientific publication: directional selection towards a robust discipline?

PubMed

Ferreira, Catarina; Bastille-Rousseau, Guillaume; Bennett, Amanda M; Ellington, E Hance; Terwissen, Christine; Austin, Cayla; Borlestean, Adrian; Boudreau, Melanie R; Chan, Kevin; Forsythe, Adrian; Hossie, Thomas J; Landolt, Kristen; Longhi, Jessica; Otis, Josée-Anne; Peers, Michael J L; Rae, Jason; Seguin, Jacob; Watt, Cristen; Wehtje, Morgan; Murray, Dennis L

2016-08-01

Peer review is pivotal to science and academia, as it represents a widely accepted strategy for ensuring quality control in scientific research. Yet, the peer-review system is poorly adapted to recent changes in the discipline and current societal needs. We provide historical context for the cultural lag that governs peer review that has eventually led to the system's current structural weaknesses (voluntary review, unstandardized review criteria, decentralized process). We argue that some current attempts to upgrade or otherwise modify the peer-review system are merely sticking-plaster solutions to these fundamental flaws, and therefore are unlikely to resolve them in the long term. We claim that for peer review to be relevant, effective, and contemporary with today's publishing demands across scientific disciplines, its main components need to be redesigned. We propose directional changes that are likely to improve the quality, rigour, and timeliness of peer review, and thereby ensure that this critical process serves the community it was created for. © 2015 Cambridge Philosophical Society.

Meeting the challenge of assessing clinical competence of occupational therapists within a program management environment.

PubMed

Salvatori, Penny; Simonavicius, Nijole; Moore, Joan; Rimmer, Georgina; Patterson, Michele

2008-02-01

Program management models have raised concerns among occupational therapists about professional standards related to clinical competence, performance review procedures, and quality improvement initiatives. This paper describes how a chart-stimulated recall (CSR) peer-review process and interview tool was revised, implemented, and evaluated as a pilot project to assess the clinical competence of occupational therapy staff at a large urban health centre in southern Ontario. Fourteen pairs (n=28) of occupational therapists representing various practice areas participated in this project. Half served as peer assessors and half as interviewees. Peer assessors conducted an independent chart review followed by a one-hour personal interview with a peer partner to discuss clinical management issues related to the client cases. Each interviewer rated his or her partner's clinical competence in eight areas of performance using a 7-point Likert scale. Results indicated that the CSR tool could discriminate among occupational therapists in terms of overall levels of clinical competence and also identify specific areas of concern that could be targeted for professional development. Feedback from participants was positive. The CSR tool was found to be useful for assessing clinical competence of occupational therapists in this large health centre as a quality improvement initiative within that discipline group. Further research is needed to establish the reliability and validity of the CSR tool.

Implementing Head and Neck Contouring Peer Review without Pathway Delay: The On-demand Approach.

PubMed

Fong, C; Sanghera, P; Good, J; Nightingale, P; Hartley, A

2017-12-01

Peer review of contour volume is a priority in the radiotherapy treatment quality assurance process for head and neck cancer. It is essential that incorporation of peer review activity does not introduce additional delays. An on-demand peer review process was piloted to assess the feasibility and efficiency of this approach, as compared with a historic scheduled weekly approach. Between November 2016 and April 2017 four head and neck clinicians in one centre took part in an on-demand peer review process. Cases were of radical or adjuvant intent of any histology and submitted on a voluntary basis. The outcome of contour peer review would be one of unchanged (UC), unchanged with variation or discretion noted (UV), minor change (M) or significant change (S). The time difference between the completion of the on-demand peer review was compared with the time difference to a hypothetical next Monday or Tuesday weekly peer review meeting. The time taken to review each case was also documented in the latter period of the pilot project. In total, 62 cases underwent peer review. Peer review on-demand provided dosimetrists with an average of an extra two working days available per case to meet treatment start dates. The proportion of cases with outcomes UC, UV, M and S were 45%, 16%, 26% and 13%, respectively. The mean peer review time spent per case was 17 min (12 cases). The main reason for S was discrepancy in imaging interpretation (4/8 cases). A lower proportion of oropharyngeal cases were submitted and had S outcomes. A higher proportion of complex cases, e.g. sinonasal/nasopharynx location or previous downstaging chemotherapy had S outcomes. The distribution of S outcomes appears to be similar regardless of clinician experience. The level of peer review activity among individuals differed by workload and job timetable. On-demand peer review of the head and neck contour volume is feasible, reduces delay to the start of dosimetry planning and bypasses the logistical barriers of weekly meetings. An audit of participation will be required to ensure successful implementation. Copyright © 2017 The Royal College of Radiologists. Published by Elsevier Ltd. All rights reserved.

Ancient texts to PubMed: a brief history of the peer-review process.

PubMed

Farrell, P R; Magida Farrell, L; Farrell, M K

2017-01-01

The formal evaluation of scientific literature by invited referees (peer reviewers) is a relatively recent phenomenon and now is considered a cornerstone of modern science. However, its roots can be traced back to antiquity. As the speed and complexity of scientific information and publishing increases in the digital age, peer review must continue to evolve. To understand the future direction of peer review, we must understand its past. Here, we briefly explore the history of scientific peer review. This may help us predict and design appropriate peer review for the new era. This work was originally presented at the Pediatric Academic Societies Annual Meeting in Baltimore, Maryland in the Spring of 2016.

Final Report from the External Peer Review of the IRIS ...

EPA Pesticide Factsheets

This document is the final report for the 2004 external peer review for the EPA IRIS Reassessment of the Inhalation Carcinogenicity of Naphthalene, prepared by the Office of Research and Development's National Center for Environmental Assessment (NCEA), for the Integrated Risk Information System (IRIS) Database. A panel of external peer reviewers met to discuss the IRIS report and their responses to the charge questions on July 30, 2004. This document contains the final written comments of the external peer reviewers. This document is the final report for the 2004 external peer review for the IRIS Reassessment of the Inhalation Carcinogenicity of Naphthalene, prepared by the U.S. Environmental Protection Agency (EPA), National Center for Environmental Assessment (NCEA), for the Integrated Risk Information System (IRIS). A panel of external peer reviewers met to discuss their responses to the charge questions on July 30, 2004. This document contains the final written comments of the external peer reviewers.

Collegiate Aviation Review 1998.

ERIC Educational Resources Information Center

Carney, Thomas Q., Ed.; Luedtke, Jacqueline R., Ed.; Johnson, Jeffrey A., Ed.

1998-01-01

This document contains four peer-reviewed papers about university-level aviation education that were presented at the 1998 Fall Education Conference of the University Aviation Association. "Setting the Foundation for Effective Learning: Utilizing the Cognitive, Affective, and Psychomotor Domains to Establish Rigorous Performance Learning…

Technology-Enhanced Peer Review: Benefits and Implications of Providing Multiple Reviews

ERIC Educational Resources Information Center

Papadopoulos, Pantelis M.; Lagkas, Thomas D.; Demetriadis, Stavros N.

2017-01-01

This study analyses the impact of self and peer feedback in technology-enhanced peer review settings. The impact of receiving peer comments ("receiver" perspective) is compared to that of reaching own insights by reviewing others' work ("giver" perspective). In this study, 38 sophomore students were randomly assigned in two…

Undergraduate Essay Writing: Online and Face-to-Face Peer Reviews

ERIC Educational Resources Information Center

Chong, Mike R.; Goff, Lori; Dej, Kimberly

2012-01-01

We implemented two different approaches of using peer review to support undergraduate essay assignments for students taking large second-year courses in life sciences and biology: a web-based online peer review (OPR) approach and a more traditional face-to-face peer review (FPR) approach that was conducted in tutorial settings. The essays…

7 CFR 3401.12 - Establishment and operation of peer review groups.

Code of Federal Regulations, 2010 CFR

2010-01-01

... 7 Agriculture 15 2010-01-01 2010-01-01 false Establishment and operation of peer review groups... GRANTS PROGRAM Scientific Peer Review of Research Applications for Funding § 3401.12 Establishment and operation of peer review groups. Subject to § 3401.7, the Administrator will adopt procedures for the...

The Importance of Peer Review: Thoughts on Knudson, Morrow, and Thomas (2014)

ERIC Educational Resources Information Center

Fischman, Mark G.

2014-01-01

Knudson, Morrow, and Thomas (2014) recently summarized a number of important issues related to the quality of peer review and current peer-review practice in kinesiology. This writer endorses their six recommendations for improving peer review in kinesiology journals. The purpose of this commentary is to further highlight the importance of…

Focusing on Content: Discourse in L2 Peer Review Groups

ERIC Educational Resources Information Center

Vorobel, Oksana; Kim, Deoksoon

2014-01-01

Recent studies on peer review groups in second language classes have focused on various topics, including collaboration (Carr, 2008) and the effect of peer review versus teacher feedback on students' writing (Zhang, 1995). One area that has received little attention is the content of students' speech during peer review. This longitudinal case…

Peer Reviewers Learn from Giving Comments

ERIC Educational Resources Information Center

Cho, Young Hoan; Cho, Kwangsu

2011-01-01

Research on peer reviewing has revealed that comments received from peer reviewers are helpful when it comes to making revisions in an individual's writing, but the role of providing comments to peer writers has been little explored despite the potential value of such research. In this study, we explored how student reviewers learn by reviewing…

Analysis of Peer Review Comments: QM Recommendations and Feedback Intervention Theory

ERIC Educational Resources Information Center

Schwegler, Andria F.; Altman, Barbara W.

2015-01-01

Because feedback is a critical component of the continuous improvement cycle of the Quality Matters (QM) peer review process, the present research analyzed the feedback that peer reviewers provided to course developers after a voluntary, nonofficial QM peer review of online courses. Previous research reveals that the effects of feedback on…

Pre-University Chemistry Students in a Mimicked Scholarly Peer Review

ERIC Educational Resources Information Center

van Rens, Lisette; Hermarij, Philip; Pilot, Albert; Beishuizen, Jos; Hofman, Herman; Wal, Marjolein

2014-01-01

Peer review is a significant component in scientific research. Introducing peer review into inquiry processes may be regarded as an aim to develop student understanding regarding quality in inquiries. This study examines student understanding in inquiry peer reviews among pre-university chemistry students, aged 16-17, when they enact a design of a…

Assessing RN-to-RN peer review on clinical units.

PubMed

Pfeiffer, Judith A; Wickline, Mary A; Deetz, Jill; Berry, Elise S

2012-04-01

The primary purpose of this study was to measure informal registered nurse (RN)-to-RN peer review (defined as collegial communication about the quality of nursing care) at the work-unit level. Survey design with cluster sampling of 28 hospital or ambulatory care units (n = 541 respondents). Results were compared with existing patient safety and satisfaction data. A chi-squared test was used to compare responses against nurse characteristics. Nurses agreed that RN-to-RN peer review takes place on their units, but no correlation with patient safety and satisfaction data was found. Misunderstandings about the meaning of peer review were evident. Open-ended comments revealed barriers to peer review: fear of retribution, language barriers and lack of professionalism. Nurses need clarification of peer review. Issues with common language in a professional environment need to be addressed and nurses can learn collaboration from each other's cultures. Managers should support RN-to-RN peer review on clinical units. Methods used here may be useful to assess current departmental nurse peer review. © 2011 Blackwell Publishing Ltd.

Peer Review in Radiology: A Resident and Fellow Perspective.

PubMed

Grenville, Jeffrey; Doucette-Preville, David; Vlachou, Paraskevi A; Mnatzakanian, Gevork N; Raikhlin, Antony; Colak, Errol

2016-02-01

The purpose of this study was to explore Canadian radiology residents' and fellows' understanding, attitudes, opinions, and preferences toward peer review. An Internet-based anonymous questionnaire designed to understand one's familiarity, attitudes, opinions, and preferences toward peer review was distributed to radiology residents and fellows across Canada. Data were analyzed using descriptive statistics, and answers were stratified by level of training. A total of 136 trainees responded to the survey with 92 completed survey responses available for descriptive statistics. Approximately half of respondents are familiar with peer review (49%), and 39% of trainees are involved in peer review. Most respondents (92%) expressed an interest in learning more about peer review; believe that it should be incorporated into the residency training curriculum (86%), be mandatory (72%), and that current participation will increase odds of future participation (91%). Most trainees (80%) are comfortable advising one another about errors, but less comfortable advising staff (21%). Residents and fellows welcome the opportunity to learn more about peer review and believe it should be incorporated into the residency training curriculum. Understanding the attitudes and perceptions held by trainees regarding peer review is important, as a means to optimize education and maximize current and future participation in peer review. Copyright © 2016 American College of Radiology. Published by Elsevier Inc. All rights reserved.

Peer Assessment in MOOCs: The Relationship between Peer Reviewers' Ability and Authors' Essay Performance

ERIC Educational Resources Information Center

Huisman, Bart; Admiraal, Wilfried; Pilli, Olga; van de Ven, Maarten; Saab, Nadira

2018-01-01

In a relatively short period of time, massive open online courses (MOOCs) have become a considerable topic of research and debate, and the number of available MOOCs is rapidly growing. Along with issues of formal recognition and accreditation, this growth in the number of MOOCs being developed increases the relevance of assessment quality. Within…

Retrospective analysis of the quality of reports by author-suggested and non-author-suggested reviewers in journals operating on open or single-blind peer review models.

PubMed

Kowalczuk, Maria K; Dudbridge, Frank; Nanda, Shreeya; Harriman, Stephanie L; Patel, Jigisha; Moylan, Elizabeth C

2015-09-29

To assess whether reports from reviewers recommended by authors show a bias in quality and recommendation for editorial decision, compared with reviewers suggested by other parties, and whether reviewer reports for journals operating on open or single-blind peer review models differ with regard to report quality and reviewer recommendations. Retrospective analysis of the quality of reviewer reports using an established Review Quality Instrument, and analysis of reviewer recommendations and author satisfaction surveys. BioMed Central biology and medical journals. BMC Infectious Diseases and BMC Microbiology are similar in size, rejection rates, impact factors and editorial processes, but the former uses open peer review while the latter uses single-blind peer review. The Journal of Inflammation has operated under both peer review models. Two hundred reviewer reports submitted to BMC Infectious Diseases, 200 reviewer reports submitted to BMC Microbiology and 400 reviewer reports submitted to the Journal of Inflammation. For each journal, author-suggested reviewers provided reports of comparable quality to non-author-suggested reviewers, but were significantly more likely to recommend acceptance, irrespective of the peer review model (p<0.0001 for BMC Infectious Diseases, BMC Microbiology and the Journal of Inflammation). For BMC Infectious Diseases, the overall quality of reviewer reports measured by the Review Quality Instrument was 5% higher than for BMC Microbiology (p=0.042). For the Journal of Inflammation, the quality of reports was the same irrespective of the peer review model used. Reviewers suggested by authors provide reports of comparable quality to non-author-suggested reviewers, but are significantly more likely to recommend acceptance. Open peer review reports for BMC Infectious Diseases were of higher quality than single-blind reports for BMC Microbiology. There was no difference in quality of peer review in the Journal of Inflammation under open peer review compared with single blind. Published by the BMJ Publishing Group Limited. For permission to use (where not already granted under a licence) please go to http://group.bmj.com/group/rights-licensing/permissions.

Early stages of development of a peer specialist fidelity measure

PubMed Central

Chinman, Matthew; McCarthy, Sharon; Mitchell-Miland, Chantele; Daniels, Karin; Youk, Ada; Edelen, Maria

2017-01-01

OBJECTIVE Research on peer specialists (individuals with serious mental illness supporting others with serious mental illness in clinical and other settings), has not yet included the measurement of fidelity. Without measuring fidelity, it’s unclear if the absence of impact in some studies is attributable to ineffective peer specialist services or because the services were not true to the intended role. This paper describes the initial development of a peer specialist fidelity measure for two content areas: services provided by peer specialists and factors that either support or hamper the performance of those services. METHODS A literature search identified 40 domains; an expert panel narrowed the number of domains and helped generate and then review survey items to operationalize those domains. Twelve peer specialists, individuals with whom they work, and their supervisors participated in a pilot test and cognitive interviews regarding item content. RESULTS Peer specialists tended to rate themselves as having engaged in various peer service activities more than supervisors and individuals with whom they work. A subset of items tapping peer specialist services “core” to the role regardless of setting had higher ratings. Participants stated the measure was clear, appropriate, and could be useful in performance improvement. CONCLUSIONS AND IMPLICATIONS FOR PRACTICE Although preliminary, findings were consistent with organizational research on performance ratings of supervisors and employees made in the workplace. Several changes in survey content and administration were identified. With continued work, the measure could crystalize the role of peer specialists and aid in research and clinical administration. PMID:27618462

Peer Portal: Quality Enhancement in Thesis Writing Using Self-Managed Peer Review on a Mass Scale

ERIC Educational Resources Information Center

Aghaee, Naghmeh; Hansson, Henrik

2013-01-01

This paper describes a specially developed online peer-review system, the Peer Portal, and the first results of its use for quality enhancement of bachelor's and master's thesis manuscripts. The peer-review system is completely student driven and therefore saves time for supervisors and creates a direct interaction between students without…

Gender bias in scholarly peer review.

PubMed

Helmer, Markus; Schottdorf, Manuel; Neef, Andreas; Battaglia, Demian

2017-03-21

Peer review is the cornerstone of scholarly publishing and it is essential that peer reviewers are appointed on the basis of their expertise alone. However, it is difficult to check for any bias in the peer-review process because the identity of peer reviewers generally remains confidential. Here, using public information about the identities of 9000 editors and 43000 reviewers from the Frontiers series of journals, we show that women are underrepresented in the peer-review process, that editors of both genders operate with substantial same-gender preference (homophily), and that the mechanisms of this homophily are gender-dependent. We also show that homophily will persist even if numerical parity between genders is reached, highlighting the need for increased efforts to combat subtler forms of gender bias in scholarly publishing.

Meaningful Peer Review in Radiology: A Review of Current Practices and Potential Future Directions.

PubMed

Moriarity, Andrew K; Hawkins, C Matthew; Geis, J Raymond; Dreyer, Keith J; Kamer, Aaron P; Khandheria, Paras; Morey, Jose; Whitfill, James; Wiggins, Richard H; Itri, Jason N

2016-12-01

The current practice of peer review within radiology is well developed and widely implemented compared with other medical specialties. However, there are many factors that limit current peer review practices from reducing diagnostic errors and improving patient care. The development of "meaningful peer review" requires a transition away from compliance toward quality improvement, whereby the information and insights gained facilitate education and drive systematic improvements that reduce the frequency and impact of diagnostic error. The next generation of peer review requires significant improvements in IT functionality and integration, enabling features such as anonymization, adjudication by multiple specialists, categorization and analysis of errors, tracking, feedback, and easy export into teaching files and other media that require strong partnerships with vendors. In this article, the authors assess various peer review practices, with focused discussion on current limitations and future needs for meaningful peer review in radiology. Copyright © 2016 American College of Radiology. Published by Elsevier Inc. All rights reserved.

Research Integrity and Peer Review-past highlights and future directions.

PubMed

Boughton, Stephanie L; Kowalczuk, Maria K; Meerpohl, Joerg J; Wager, Elizabeth; Moylan, Elizabeth C

2018-01-01

In May 2016, we launched Research Integrity and Peer Review , an international, open access journal with fully open peer review (reviewers are identified on their reports and named reports are published alongside the article) to provide a home for research on research and publication ethics, research reporting, and research on peer review. As the journal enters its third year, we reflect on recent events and highlights for the journal and explore how the journal is faring in terms of gender and diversity in peer review. We also share the particular interests of our Editors-in-Chief regarding models of peer review, reporting quality, common research integrity issues that arise during the publishing process, and how people interact with the published literature. We continue to encourage further research into peer review, research and publication ethics and research reporting, as we believe that all new initiatives should be evidence-based. We also remain open to constructive discussions of the developments in the field that offer new solutions.

Making the First Cut: An Analysis of Academic Medicine Editors' Reasons for Not Sending Manuscripts Out for External Peer Review.

PubMed

Meyer, Holly S; Durning, Steven J; Sklar, David P; Maggio, Lauren A

2018-03-01

Manuscripts submitted to Academic Medicine (AM) undergo an internal editor review to determine whether they will be sent for external peer review. Increasingly, manuscripts are rejected at this early stage. This study seeks to inform scholars about common reasons for internal editor review rejections, increase transparency of the process, and provide suggestions for improving submissions. A mixed-methods approach was used to retrospectively analyze editors' free-text comments. Descriptive content analysis was performed of editors' comments for 369 manuscripts submitted between December 2014 and December 2015, and rejected prior to external peer review from AM. Comments were analyzed, categorized, and counted for explicit reasons for rejection. Nine categories of rejection reasons were identified: ineffective study question and/or design (338; 92%); suboptimal data collection process (180; 49%); weak discussion and/or conclusions (139; 37%); unimportant or irrelevant topic to the journal's mission (137; 37%); weak data analysis and/or presentation of results (120; 33%); text difficult to follow, to understand (89; 24%); inadequate or incomplete introduction (67; 18%); other publishing considerations (42; 11%); and issues with scientific conduct (20; 5%). Manuscripts had, on average, three or more reasons for rejection. Findings suggest that clear identification of a research question that is addressed by a well-designed study methodology on a topic aligned with the mission of the journal would address many of the problems that lead to rejection through the internal review process. The findings also align with research on external peer review.

On the Nature and Role of Peer Review in Mathematics.

PubMed

Andersen, Line Edslev

2017-01-01

For the past three decades, peer review practices have received much attention in the literature. But although this literature covers many research fields, only one previous systematic study has been devoted to the practice of peer review in mathematics, namely a study by Geist, Löwe, and Van Kerkhove from 2010. This lack of attention may be due to a view that peer review in mathematics is more reliable, and therefore less interesting as an object of study, than peer review in other fields. In fact, Geist, Löwe, and Van Kerkhove argue that peer review in mathematics is relatively reliable. At the same time, peer review in mathematics differs from peer review in most, if not all, other fields in that papers submitted to mathematical journals are usually only reviewed by a single referee. Furthermore, recent empirical studies indicate that the referees do not check the papers line by line. I argue that, in spite of this, mathematical practice in general and refereeing practices in particular are such that the common practice of mathematical journals of using just one referee is justified from the point of view of proof validity assessment. The argument is based on interviews I conducted with seven mathematicians.

How Does Student Peer Review Influence Perceptions, Engagement and Academic Outcomes? A Case Study

ERIC Educational Resources Information Center

Mulder, Raoul; Baik, Chi; Naylor, Ryan; Pearce, Jon

2014-01-01

Involving students in peer review has many pedagogical benefits, but few studies have explicitly investigated relationships between the content of peer reviews, student perceptions and assessment outcomes. We conducted a case study of peer review within a third-year undergraduate subject at a research-intensive Australian university, in which we…

Do Peer Reviews Help Improve Student Writing Abilities in an EFL High School Classroom?

ERIC Educational Resources Information Center

Kurihara, Noriko

2017-01-01

Several studies have reported the benefits of peer reviews in English as a second language (ESL) and English as a foreign language (EFL) writing classrooms. However, there has been little empirical research on whether such peer reviews improve students' writing abilities. The current study investigated the effects of peer review on the development…

Predicting Academics' Willingness to Participate in Peer Review of Teaching: A Quantitative Investigation

ERIC Educational Resources Information Center

White, Kiri; Boehm, Emilia; Chester, Andrea

2014-01-01

Peer review of teaching is a collegial process designed to help academics reflect on and improve their teaching practice. Considerable research supports the value of peer review of teaching. However, uptake of voluntary programs is typically low. Few studies have examined the predictors of engagement in voluntary peer review. This study surveyed…

LeaD-In: A Cultural Change Model for Peer Review of Teaching in Higher Education

ERIC Educational Resources Information Center

Barnard, A.; Nash, R.; McEvoy, K.; Shannon, S.; Waters, C.; Rochester, S.; Bolt, S.

2015-01-01

Peer review of teaching is recognized increasingly as one strategy for academic development even though historically peer review of teaching is often unsupported by policy, action and culture in many Australian universities. Higher education leaders report that academics generally do not engage with peer review of teaching in a systematic or…

Building Scholarly Writers: Student Perspectives on Peer Review in a Doctoral Writing Seminar

ERIC Educational Resources Information Center

Adamek, Margaret Ellen

2015-01-01

Peer review was used as a primary pedagogical tool in a scholarly writing course for social work doctoral students. To gauge student response to peer review and learning as a result of peer review, the instructor used narrative analysis to organize student comments into themes. Themes identified included initial trepidation, "no pain, no…

34 CFR 359.30 - How is peer review conducted under this program?

Code of Federal Regulations, 2010 CFR

2010-07-01

... 34 Education 2 2010-07-01 2010-07-01 false How is peer review conducted under this program? 359.30 Section 359.30 Education Regulations of the Offices of the Department of Education (Continued) OFFICE OF...? § 359.30 How is peer review conducted under this program? Peer review is conducted under this program in...

Don't Tell It Like It Is: Preserving Collegiality in the Summative Peer Review of Teaching

ERIC Educational Resources Information Center

Iqbal, Isabeau A.

2014-01-01

While much literature has considered feedback and professional growth in formative peer reviews of teaching, there has been little empirical research conducted on these issues in the context of summative peer reviews. This article explores faculty members' perceptions of feedback practices in the summative peer review of teaching and reports on…

75 FR 24568 - Notice of Intent To Seek OMB Approval To Collect Information: Revision of a Form Pertaining to...

Federal Register 2010, 2011, 2012, 2013, 2014

2010-05-05

... Peer Review of ARS Research Projects AGENCY: Agricultural Research Service (ARS), USDA. ACTION: Notice... scientific peer reviews of all research activities conducted by the USDA. The Office manages the ARS peer review system by centrally planning peer panel reviews for ARS research projects on a five-year cycle...

Students' Collaborative Peer Reviewing in an Online Writing Environment

ERIC Educational Resources Information Center

Bradley, Linda; Thouësny, Sylvie

2017-01-01

Peer review is applied as a powerful tool to enhance student collaboration online writing. The purpose of this paper is to analyse learners' mechanisms of peer reviewing in the nature of student interventions and interactions in written online peer reviewing and how categorization of student comments can be used as a means for analysing student…

Adapting Peer Review to an Online Course: An Exploratory Case Study

ERIC Educational Resources Information Center

Knight, Linda V.; Steinbach, Theresa A.

2011-01-01

With demonstrated benefits to higher level learning, peer review in the classroom has been well researched and popular since at least the 1990s. However, little or no prior studies exist into the peer review process for online courses. Further, we found no prior research specifically addressing the operational aspects of online peer review. This…

Evaluation of the Inhalation Carcinogenicity of Ethylene Oxide ...

EPA Pesticide Factsheets

EPA is seeking peer review of the scientific basis supporting the human health hazard and dose-response assessment of ethylene oxide (cancer) that will appear in the Integrated Risk Information System (IRIS) database. EPA seeks external peer review on how the Agency responded to the SAB panel recommendations, the exposure-response modeling of epidemiologic data, including new analyses since the 2007 external peer review, and on the adequacy, transparency, and clarity of the revised draft. The peer review will include an opportunity for the public to address the peer reviewers.

Evaluating the Effect of Virtual Reality Temporal Bone Simulation on Mastoidectomy Performance: A Meta-analysis.

PubMed

Lui, Justin T; Hoy, Monica Y

2017-06-01

Background The increasing prevalence of virtual reality simulation in temporal bone surgery warrants an investigation to assess training effectiveness. Objectives To determine if temporal bone simulator use improves mastoidectomy performance. Data Sources Ovid Medline, Embase, and PubMed databases were systematically searched per the PRISMA guidelines. Review Methods Inclusion criteria were peer-reviewed publications that utilized quantitative data of mastoidectomy performance following the use of a temporal bone simulator. The search was restricted to human studies published in English. Studies were excluded if they were in non-peer-reviewed format, were descriptive in nature, or failed to provide surgical performance outcomes. Meta-analysis calculations were then performed. Results A meta-analysis based on the random-effects model revealed an improvement in overall mastoidectomy performance following training on the temporal bone simulator. A standardized mean difference of 0.87 (95% CI, 0.38-1.35) was generated in the setting of a heterogeneous study population ( I 2 = 64.3%, P < .006). Conclusion In the context of a diverse population of virtual reality simulation temporal bone surgery studies, meta-analysis calculations demonstrate an improvement in trainee mastoidectomy performance with virtual simulation training.

External Peer Review Report on the Defense Contract Management Agency Office of Independent Assessment Internal Review Team

DTIC Science & Technology

2015-11-02

External Peer Review Report on the Defense Contract Management Agency Office of Independent Assessment Internal Review Team N O V E M B E R 2 , 2 0 1 5... MANAGEMENT AGENCY SUBJECT: External Peer Review Report on the Defense Contract Management Agency Office of Independent Assessment Internal Review Team...Report No. DODIG-2016-007) Attached is the External Peer Review Report on the Defense Contract Management Agency Office of Independent Assessment

AQUATOX Peer Review Documents

EPA Pesticide Factsheets

AQUATOX Release 2 underwent an external peer review in early 2003, and Release 3 underwent an external peer review in late 2008. Reviewers stated model enhancements have made AQUATOX one of the most exciting tools in aquatic ecosystem management.

Peer Feedback in Anonymous Peer Review in an EFL Writing Class in Spain

ERIC Educational Resources Information Center

Coté, Robert A.

2014-01-01

The present study reports the results of a process of peer feedback through anonymous peer review in an EFL writing class. Numerous studies have reported on the benefits of peer review (PR) in the ESL/EFL writing classroom. However, the literature also identifies social issues that can negatively affect the outcome of face-to-face PR. In this…

Expanding Group Peer Review: A Proposal for Medical Education Scholarship.

PubMed

Dumenco, Luba; Engle, Deborah L; Goodell, Kristen; Nagler, Alisa; Ovitsh, Robin K; Whicker, Shari A

2017-02-01

After participating in a group peer-review exercise at a workshop presented by Academic Medicine and MedEdPORTAL editors at the 2015 Association of American Medical Colleges Medical Education Meeting, the authors realized that the way their work group reviewed a manuscript was very different from the way by which they each would have reviewed the paper as an individual. Further, the group peer-review process yielded more robust feedback for the manuscript's authors than did the traditional individual peer-review process. This realization motivated the authors to reconvene and collaborate to write this Commentary to share their experience and propose the expanded use of group peer review in medical education scholarship.The authors consider the benefits of a peer-review process for reviewers, including learning how to improve their own manuscripts. They suggest that the benefits of a team review model may be similar to those of teamwork and team-based learning in medicine and medical education. They call for research to investigate this, to provide evidence to support group review, and to determine whether specific paper types would benefit most from team review (e.g., particularly complex manuscripts, those receiving widely disparate initial individual reviews). In addition, the authors propose ways in which a team-based approach to peer review could be expanded by journals and institutions. They believe that exploring the use of group peer review potentially could create a new methodology for skill development in research and scholarly writing and could enhance the quality of medical education scholarship.

Effectiveness of Interventions to Improve Occupational Performance for People With Psychosocial, Behavioral, and Emotional Impairments After Brain Injury: A Systematic Review.

PubMed

Wheeler, Steven; Acord-Vira, Amanda; Davis, Diana

2016-01-01

This systematic review evaluates the effectiveness of interventions to improve occupational performance for people with psychosocial, behavioral, or emotional impairments after traumatic brain injury (TBI). Medline, PsycINFO, CINAHL, OTseeker, and the Cochrane Database of Systematic Reviews were searched. Of the 1,512 articles initially identified, 35 met the inclusion criteria. Six types of interventions were identified: (1) education, (2) peer mentoring, (3) goal-directed therapy, (4) physical activity, (5) skills training, and (6) cognitive-behavioral therapy (CBT). Strong evidence from well-conducted research supports the use of CBT in individual and group settings. Moderate evidence supports goal-directed interventions, aquatic exercise, and functional skills training. Limited evidence supports peer mentoring, aerobic exercise, educational interventions, and various skills training. An increasing body of evidence supports specific interventions to improve occupational performance and participation for people with psychosocial, behavioral, or emotional impairments after TBI. Copyright © 2016 by the American Occupational Therapy Association, Inc.

7 CFR 3400.14 - Proposal review.

Code of Federal Regulations, 2010 CFR

2010-01-01

... SERVICE, DEPARTMENT OF AGRICULTURE SPECIAL RESEARCH GRANTS PROGRAM Scientific Peer Review of Research... employees of the Department, the respective peer review group, and ad hoc reviewers, as required. Written...-depth discussions will be provided by peer review group members prior to recommending applications for...

How peer-review constrains cognition: on the frontline in the knowledge sector.

PubMed

Cowley, Stephen J

2015-01-01

Peer-review is neither reliable, fair, nor a valid basis for predicting 'impact': as quality control, peer-review is not fit for purpose. Endorsing the consensus, I offer a reframing: while a normative social process, peer-review also shapes the writing of a scientific paper. In so far as 'cognition' describes enabling conditions for flexible behavior, the practices of peer-review thus constrain knowledge-making. To pursue cognitive functions of peer-review, however, manuscripts must be seen as 'symbolizations', replicable patterns that use technologically enabled activity. On this bio-cognitive view, peer-review constrains knowledge-making by writers, editors, reviewers. Authors are prompted to recursively re-aggregate symbolizations to present what are deemed acceptable knowledge claims. How, then, can recursive re-embodiment be explored? In illustration, I sketch how the paper's own content came to be re-aggregated: agonistic review drove reformatting of argument structure, changes in rhetorical ploys and careful choice of wordings. For this reason, the paper's knowledge-claims can be traced to human activity that occurs in distributed cognitive systems. Peer-review is on the frontline in the knowledge sector in that it delimits what can count as knowing. Its systemic nature is therefore crucial to not only discipline-centered 'real' science but also its 'post-academic' counterparts.

Real-Time Peer Review: An Innovative Feature to an Evidence-Based Practice Conference

PubMed Central

Eldredge, Jonathan D.; Phillips, Holly E.; Kroth, Philip J.

2013-01-01

Many health sciences librarians as well as other professionals attend conferences on a regular basis. This study sought to link an innovative peer review process of presented research papers to long-term conference outcomes in the peer-reviewed professional journal literature. An evidence-based conference included a proof-of-concept study to gauge the long-term outcomes from research papers presented during the program. Real-time peer review recommendations from the conference were linked to final versions of articles published in the peer-reviewed literature. The real-time peer review feedback served as the basis for further mentoring to guide prospective authors toward publishing their research results. These efforts resulted in the publication of two of the four research papers in the peer-viewed literature. A third presented paper appeared in a blog because the authors wanted to disseminate their findings more quickly than through the journal literature. The presenters of the fourth paper never published their study. Real-time peer review from this study can be adapted to other professional conferences that include presented research papers. PMID:24180649

Peer Review for EPA's Biologically Based Dose-Response ...

EPA Pesticide Factsheets

EPA is developing a regulation for perchlorate in drinking water. As part the regulatory process EPA must develop a Maximum Contaminant Level Goal (MCLG). FDA and EPA scientists developed a biologically based dose-response (BBDR) model to assist in deriving the MCLG. This model is designed to determine under what conditions of iodine nutrition and exposure to perchlorate across sensitive lifestages would result in low serum free and total thyroxine (hypothyroxinemia). EPA is undertaking a peer review to provide a focused, objective independent peer evaluation of the draft model and its model results report. EPA is undertaking a peer review to provide a focused, objective independent peer evaluation of the draft model and its model results report. Peer review is an important component of the scientific process. The criticism, suggestions, and new ideas provided by the peer reviewers stimulate creative thought, strengthen the interpretation of the reviewed material, and confer credibility on the product. The peer review objective is to provide advice to EPA on steps that will yield a highly credible scientific product that is supported by the scientific community and a defensible perchlorate MCLG.

Navigating manuscript assessment: The new practitioner's guide to primary literature peer review.

PubMed

Smith, Devlin V; Stokes, Laura B; Marx, Kayleigh; Aitken, Samuel L

2018-01-01

For pharmacists, the first years after graduation are spent developing their knowledge base, advancing as a practitioner, and honing their abilities as healthcare providers and drug information experts. New practitioners encounter many challenges during this time, which for many include publishing original research or reviewing manuscripts for colleagues and medical journals. Inexperience navigating the publication process, from submission to receipt of (and response to) peer review commentary, is often cited as a major barrier to timely publication of resident and new practitioner research. Serving as a peer reviewer in turn provides the new practitioner with insight on this process and can be an enlightening experience used to garner confidence in subsequently submitting their own formal manuscripts. A number of publications describing steps for peer review are available, however, many of these articles address more experienced reviewers or critique the peer review process itself. No definitive resource exists for new pharmacy practitioners interested in developing their peer review skills. The information presented in this summative guide should be used in conjunction with practice opportunities to help new practitioners develop proficiency at peer review.

The effect of peer review on mortality rates.

PubMed

Krahwinkel, W; Schuler, E; Liebetrau, M; Meier-Hellmann, A; Zacher, J; Kuhlen, R

2016-10-01

Lowering of mortality rates in hospitals with mortality rates higher than accepted reference values for acute myocardial infarction (AMI), congestive heart failure (CHF), pneumonia, stroke, mechanical ventilation (MV) and colorectal surgery by using an external peer review process that identifies areas requiring rectification and implements protocols directed at improving these areas. Retrospective, observational, quality management study using administrative data to compare in-hospital mortality rates (pre and post an external peer review process that included adoption of improvement protocols) with reference values. German general hospitals of a large, private group. Hospitals with mortality rates higher than reference values. Peer review of medical records by experienced, outside physicians triggered by in-hospital mortality rates higher than expected. Inadequacies were identified, improvement protocols enforced and mortality rates subsequently re-examined. Mortality rates 1 year before and 1 year after peer review and protocol use. For AMI, CHF, pneumonia, stroke, MV and colorectal surgery, the mortality rates 1 year post-peer review were significantly decreased as compared to pre-peer review mortality rates. The standardized mortality ratio for all of the above diagnoses was 1.45, 1 year before peer review, and 0.97, 1 year after peer review. The absolute risk reduction of 7.3% translates into 710 deaths in this population which could have been prevented. Peer review triggered and conducted in the manner described here is associated with a significant lowering of in-hospital mortality rates in hospitals that previously had higher than expected mortality rates. © The Author 2016. Published by Oxford University Press in association with the International Society for Quality in Health Care.

Examining the Predictive Validity of NIH Peer Review Scores

PubMed Central

Lindner, Mark D.; Nakamura, Richard K.

2015-01-01

The predictive validity of peer review at the National Institutes of Health (NIH) has not yet been demonstrated empirically. It might be assumed that the most efficient and expedient test of the predictive validity of NIH peer review would be an examination of the correlation between percentile scores from peer review and bibliometric indices of the publications produced from funded projects. The present study used a large dataset to examine the rationale for such a study, to determine if it would satisfy the requirements for a test of predictive validity. The results show significant restriction of range in the applications selected for funding. Furthermore, those few applications that are funded with slightly worse peer review scores are not selected at random or representative of other applications in the same range. The funding institutes also negotiate with applicants to address issues identified during peer review. Therefore, the peer review scores assigned to the submitted applications, especially for those few funded applications with slightly worse peer review scores, do not reflect the changed and improved projects that are eventually funded. In addition, citation metrics by themselves are not valid or appropriate measures of scientific impact. The use of bibliometric indices on their own to measure scientific impact would likely increase the inefficiencies and problems with replicability already largely attributed to the current over-emphasis on bibliometric indices. Therefore, retrospective analyses of the correlation between percentile scores from peer review and bibliometric indices of the publications resulting from funded grant applications are not valid tests of the predictive validity of peer review at the NIH. PMID:26039440

77 FR 19126 - Defense Federal Acquisition Regulation Supplement: New Threshold for Peer Reviews of...

Federal Register 2010, 2011, 2012, 2013, 2014

2012-03-30

... Federal Acquisition Regulation Supplement: New Threshold for Peer Reviews of Noncompetitive Contracts... Regulation Supplement (DFARS) to modify the threshold for noncompetitive contract peer reviews. DATES...-6088. SUPPLEMENTARY INFORMATION: I. Background This final rule reduces the threshold for DoD peer...

Gender bias in scholarly peer review

PubMed Central

Helmer, Markus; Schottdorf, Manuel; Neef, Andreas; Battaglia, Demian

2017-01-01

Peer review is the cornerstone of scholarly publishing and it is essential that peer reviewers are appointed on the basis of their expertise alone. However, it is difficult to check for any bias in the peer-review process because the identity of peer reviewers generally remains confidential. Here, using public information about the identities of 9000 editors and 43000 reviewers from the Frontiers series of journals, we show that women are underrepresented in the peer-review process, that editors of both genders operate with substantial same-gender preference (homophily), and that the mechanisms of this homophily are gender-dependent. We also show that homophily will persist even if numerical parity between genders is reached, highlighting the need for increased efforts to combat subtler forms of gender bias in scholarly publishing. DOI: http://dx.doi.org/10.7554/eLife.21718.001 PMID:28322725

Quality assurance in radiology: peer review and peer feedback.

PubMed

Strickland, N H

2015-11-01

Peer review in radiology means an assessment of the accuracy of a report issued by another radiologist. Inevitably, this involves a judgement opinion from the reviewing radiologist. Peer feedback is the means by which any form of peer review is communicated back to the original author of the report. This article defines terms, discusses the current status, identifies problems, and provides some recommendations as to the way forward, concentrating upon the software requirements for efficient peer review and peer feedback of reported imaging studies. Radiologists undertake routine peer review in their everyday clinical practice, particularly when reporting and preparing for multidisciplinary team meetings. More formal peer review of reported imaging studies has been advocated as a quality assurance measure to promote good clinical practice. It is also a way of assessing the competency of reporting radiologists referred for investigation to bodies such as the General Medical Council (GMC). The literature shows, firstly, that there is a very wide reported range of discrepancy rates in many studies, which have used a variety of non-comparable methodologies; and secondly, that applying scoring systems in formal peer review is often meaningless, unhelpful, and can even be detrimental. There is currently a lack of electronic peer feedback system software on the market to inform radiologists of any review of their work that has occurred or to provide them with clinical outcome information on cases they have previously reported. Learning opportunities are therefore missed. Radiologists should actively engage with the medical informatics industry to design optimal peer review and feedback software with features to meet their needs. Such a system should be easy to use, be fully integrated with the radiological information and picture archiving systems used clinically, and contain a free-text comment box, without a numerical scoring system. It should form a temporary record that cannot be permanently archived. It must provide automated feedback to the original author. Peer feedback, as part of everyday reporting, should enhance daily learning for radiologists. Software requirements for everyday peer feedback differ from those needed for a formal peer review process, which might only be necessary in the setting of a formal GMC enquiry into a particular radiologist's reporting competence, for example. Copyright © 2015 The Royal College of Radiologists. Published by Elsevier Ltd. All rights reserved.

Doing Peer Review: Reflections from an International Group of Postdoctoral Fellows

ERIC Educational Resources Information Center

Merry, Lisa; Jarvis, Kimberly; Kupoluyi, Joseph; Lual, Jomama One Jomama

2017-01-01

There is very little written regarding developing the skills of doing peer reviews. In this piece we use our own experience as postdoctoral fellows to offer our reflections on how to get the most out of doing peer reviews as a trainee researcher. We touch upon the variety and complexity of peer reviews, the debates concerning the nature and…

A proposal for an 'equal peer-review' statement.

PubMed

Moustafa, Khaled

2015-08-01

To make the peer-review process as objective as possible, I suggest the introduction of an 'equal peer-review' statement that preserves author anonymity across the board, thus removing any potential bias related to nominal or institutional 'prestige'; this would guarantee an equal peer-review process for all authors and grant applicants. Copyright © 2015 Elsevier Ltd. All rights reserved.

Love Canal Emergency Declaration Area habitability study. Volume 5. Peer review summary: TRC (Technical Review Committee) responses. Final report

DOE Office of Scientific and Technical Information (OSTI.GOV)

Not Available

Environmental studies were conducted to provide data that could be used by the Commissioner of Health for the State of New York in determining whether the Emergency Declaration Area surrounding the Love Canal hazardous-waste site is habitable. These volumes (II through IV) were reviewed by a peer-review panel of expert scientists. The scientists concluded that each of the three environmental studies was well planned and well executed. Volume V summarizes the peer review and gives additional information or clarifications as requested during the peer review. Volume V also provides additional supplemental statistical analyses requested by the peer reviewer panel.

VERIFYING THE VOC CONTROL PERFORMANCE OF BIOREACTORS

EPA Science Inventory

The paper describes the verification testing approach used to collect high-quality, peer-reviewed data on the performance of bioreaction-based technologies for the control of volatile organic compounds (VOCs). The verification protocol that describes the approach for these tests ...

A randomised trial of peer review: the UK National Chronic Obstructive Pulmonary Disease Resources and Outcomes Project.

PubMed

Roberts, C M; Stone, R A; Buckingham, R J; Pursey, N A; Harrison, B D W; Lowe, D; Potter, J M

2010-06-01

Peer review has been widely employed within the NHS to facilitate health quality improvement but has not been rigorously evaluated. This article reports the largest randomised trial of peer review ever conducted in the UK. The peer review intervention was a reciprocal supportive exercise that included clinicians, hospital management, commissioners and patients which focused on the quality of the provision of four specific evidence-based aspects of chronic obstructive pulmonary disease care. Follow up at 12 months demonstrated few quantitative differences in the number or quality of services offered in the two groups. Qualitative data in contrast suggested many benefits of peer review in most but not all intervention units and some control teams. Findings suggest peer review in this format is a positive experience for most participants but is ineffective in some situations. Its longer term benefits and cost effectiveness require further study. The generic findings of this study have potential implications for the application of peer review throughout the NHS.

Use of Activity Schedule to Promote Independent Performance of Individuals with Autism and Other Intellectual Disabilities: A Review

ERIC Educational Resources Information Center

Koyama, Takanori; Wang, Hui-Ting

2011-01-01

A literature review was conducted on the effectiveness of activity schedules. Twenty three studies that a) were peer-reviewed, b) were experimental, c) implemented activity schedule as a primary intervention, d) incorporated multiple activities, and e) aimed to teach learners to self-manage individual schedules were included in the review. The…

Mentored peer reviewing for PhD faculty and students.

PubMed

Xu, Jiayun; Kim, Kyounghae; Kurtz, Melissa; Nolan, Marie T

2016-02-01

There is a need for scholars to be prepared as peer reviewers in order to ensure the continual publication of quality science. However, developing the skills to craft a constructive critique can be difficult. In this commentary, we discuss the use of a group peer review mentoring model for PhD students to gain experience in peer review from a faculty member who is experienced in peer review. Central to this model, was the opportunity for each student and faculty mentor to openly discuss their critique of the manuscript. Through this enriching experience, novice researchers were able to learn the elements of a good peer review, better determine a manuscript's substantive contribution to science, and advance the quality of their own manuscript writing. Copyright © 2015 Elsevier Ltd. All rights reserved.

Improving the peer review skills of young rheumatologists and researchers in rheumatology: the EMEUNET Peer Review Mentoring Program.

PubMed

Rodríguez-Carrio, Javier; Putrik, Polina; Sepriano, Alexandre; Moltó, Anna; Nikiphorou, Elena; Gossec, Laure; Kvien, Tore K; Ramiro, Sofia

2018-01-01

Although peer review plays a central role in the maintenance of high standards in scientific research, training of reviewing skills is not included in the common education programmes. The Emerging EULAR (European League Against Rheumatism) Network (EMEUNET) developed a programme to address this unmet need. The EMEUNET Peer Review Mentoring Program for Rheumatology Journals promotes a systematic training of reviewing skills by engaging mentees in a 'real world' peer review experience supervised by experienced mentors with support from rheumatology journals. This viewpoint provides an overview of this initiative and its outcomes, and discusses its potential limitations. Over 4 years, 18 mentors and 86 mentees have participated. Among the 33 participants who have completed the programme, 13 (39.3%) have become independent reviewers for Annals of the Rheumatic Diseases after the training. This programme has been recently evaluated by a survey and qualitative interviews, revealing a high interest in this initiative. The main strengths (involvement of a top journal and learning opportunities) and weaknesses of the programme (limited number of places and insufficient dissemination) were identified. Overall, this programme represents an innovative and successful approach to peer review training. Continuous evaluation and improvement are key to its functioning. The EMEUNET Peer Review Mentoring Program may be used as a reference for peer review training in areas outside rheumatology.

Sex Differences in the Determination of Adolescent Aspirations: A Review of Research.

ERIC Educational Resources Information Center

Marini, Margaret Mooney

1978-01-01

Factors influencing levels of adolescent aspiration are reviewed, including socioeconomic background, academic ability, number of siblings, parental encouragement, mother's employment, academic performance, peer aspirations, dating, and participation in school activities. Although sex differences affect the formation of both educational and…

The effects of an editor serving as one of the reviewers during the peer-review process.

PubMed

Giordan, Marco; Csikasz-Nagy, Attila; Collings, Andrew M; Vaggi, Federico

2016-01-01

Background Publishing in scientific journals is one of the most important ways in which scientists disseminate research to their peers and to the wider public. Pre-publication peer review underpins this process, but peer review is subject to various criticisms and is under pressure from growth in the number of scientific publications. Methods Here we examine an element of the editorial process at eLife , in which the Reviewing Editor usually serves as one of the referees, to see what effect this has on decision times, decision type, and the number of citations. We analysed a dataset of 8,905 research submissions to eLife since June 2012, of which 2,747 were sent for peer review. This subset of 2747 papers was then analysed in detail.   Results The Reviewing Editor serving as one of the peer reviewers results in faster decision times on average, with the time to final decision ten days faster for accepted submissions (n=1,405) and five days faster for papers that were rejected after peer review (n=1,099). Moreover, editors acting as reviewers had no effect on whether submissions were accepted or rejected, and a very small (but significant) effect on citation rates. Conclusions An important aspect of eLife 's peer-review process is shown to be effective, given that decision times are faster when the Reviewing Editor serves as a reviewer. Other journals hoping to improve decision times could consider adopting a similar approach.

Evaluation of the Inhalation Carcinogenicity of Ethylene Oxide ...

EPA Pesticide Factsheets

EPA is initiating a public comment period prior to peer review of the scientific basis supporting the human health hazard and dose-response assessment of ethylene oxide (cancer) that will appear in the Integrated Risk Information System (IRIS) database. EPA seeks external peer review on how the Agency responded to the SAB panel recommendations, the exposure-response modeling of epidemiologic data, including new analyses since the 2007 external peer review, and on the adequacy, transparency, and clarity of the revised draft. The peer review will include an opportunity for the public to address the peer reviewers.

What is open peer review? A systematic review

PubMed Central

Ross-Hellauer, Tony

2017-01-01

Background: “Open peer review” (OPR), despite being a major pillar of Open Science, has neither a standardized definition nor an agreed schema of its features and implementations. The literature reflects this, with numerous overlapping and contradictory definitions. While for some the term refers to peer review where the identities of both author and reviewer are disclosed to each other, for others it signifies systems where reviewer reports are published alongside articles. For others it signifies both of these conditions, and for yet others it describes systems where not only “invited experts” are able to comment. For still others, it includes a variety of combinations of these and other novel methods. Methods: Recognising the absence of a consensus view on what open peer review is, this article undertakes a systematic review of definitions of “open peer review” or “open review”, to create a corpus of 122 definitions. These definitions are systematically analysed to build a coherent typology of the various innovations in peer review signified by the term, and hence provide the precise technical definition currently lacking. Results: This quantifiable data yields rich information on the range and extent of differing definitions over time and by broad subject area. Quantifying definitions in this way allows us to accurately portray exactly how ambiguously the phrase “open peer review” has been used thus far, for the literature offers 22 distinct configurations of seven traits, effectively meaning that there are 22 different definitions of OPR in the literature reviewed. Conclusions: I propose a pragmatic definition of open peer review as an umbrella term for a number of overlapping ways that peer review models can be adapted in line with the aims of Open Science, including making reviewer and author identities open, publishing review reports and enabling greater participation in the peer review process. PMID:28580134

45 CFR 1388.9 - Peer review.

Code of Federal Regulations, 2014 CFR

2014-10-01

... PROGRAM THE UNIVERSITY AFFILIATED PROGRAMS § 1388.9 Peer review. (a) The purpose of the peer review..., including on-site visits or inspections as necessary. (b) Applications for funding opportunities under part...

45 CFR 1388.9 - Peer review.

Code of Federal Regulations, 2013 CFR

2013-10-01

... PROGRAM THE UNIVERSITY AFFILIATED PROGRAMS § 1388.9 Peer review. (a) The purpose of the peer review..., including on-site visits or inspections as necessary. (b) Applications for funding opportunities under part...

45 CFR 1388.9 - Peer review.

Code of Federal Regulations, 2011 CFR

2011-10-01

... PROGRAM THE UNIVERSITY AFFILIATED PROGRAMS § 1388.9 Peer review. (a) The purpose of the peer review..., including on-site visits or inspections as necessary. (b) Applications for funding opportunities under part...

45 CFR 1388.9 - Peer review.

Code of Federal Regulations, 2012 CFR

2012-10-01

... PROGRAM THE UNIVERSITY AFFILIATED PROGRAMS § 1388.9 Peer review. (a) The purpose of the peer review..., including on-site visits or inspections as necessary. (b) Applications for funding opportunities under part...

How peer-review constrains cognition: on the frontline in the knowledge sector

PubMed Central

Cowley, Stephen J.

2015-01-01

Peer-review is neither reliable, fair, nor a valid basis for predicting ‘impact’: as quality control, peer-review is not fit for purpose. Endorsing the consensus, I offer a reframing: while a normative social process, peer-review also shapes the writing of a scientific paper. In so far as ‘cognition’ describes enabling conditions for flexible behavior, the practices of peer-review thus constrain knowledge-making. To pursue cognitive functions of peer-review, however, manuscripts must be seen as ‘symbolizations’, replicable patterns that use technologically enabled activity. On this bio-cognitive view, peer-review constrains knowledge-making by writers, editors, reviewers. Authors are prompted to recursively re-aggregate symbolizations to present what are deemed acceptable knowledge claims. How, then, can recursive re-embodiment be explored? In illustration, I sketch how the paper’s own content came to be re-aggregated: agonistic review drove reformatting of argument structure, changes in rhetorical ploys and careful choice of wordings. For this reason, the paper’s knowledge-claims can be traced to human activity that occurs in distributed cognitive systems. Peer-review is on the frontline in the knowledge sector in that it delimits what can count as knowing. Its systemic nature is therefore crucial to not only discipline-centered ‘real’ science but also its ‘post-academic’ counterparts. PMID:26579064

Journal peer review: a bar or bridge? An analysis of a paper's revision history and turnaround time, and the effect on citation.

PubMed

Rigby, J; Cox, D; Julian, K

2018-01-01

Journal peer review lies at the heart of academic quality control. This article explores the journal peer review process and seeks to examine how the reviewing process might itself contribute to papers, leading them to be more highly cited and to achieve greater recognition. Our work builds on previous observations and views expressed in the literature about (a) the role of actors involved in the research and publication process that suggest that peer review is inherent in the research process and (b) on the contribution reviewers themselves might make to the content and increased citation of papers. Using data from the journal peer review process of a single journal in the Social Sciences field (Business, Management and Accounting), we examine the effects of peer review on papers submitted to that journal including the effect upon citation, a novel step in the study of the outcome of peer review. Our detailed analysis suggests, contrary to initial assumptions, that it is not the time taken to revise papers but the actual number of revisions that leads to greater recognition for papers in terms of citation impact. Our study provides evidence, albeit limited to the case of a single journal, that the peer review process may constitute a form of knowledge production and is not the simple correction of errors contained in submitted papers.

Peer Review: Promoting Efficient School District Operations

ERIC Educational Resources Information Center

Hale, Jason S.

2010-01-01

Many professions recognize the benefits of peer reviews to assess processes and operations because peers can more easily identify one another's inefficiencies and provide some kind of intervention. Generally, the goal of the peer review process is to verify whether the work satisfies the standards set by the industry. A number of states have begun…

Using Calibrated Peer Review to Teach Basic Research Skills

ERIC Educational Resources Information Center

Bracke, Marianne S.; Graveel, John G.

2014-01-01

Calibrated Peer Review (CPR) is an online tool being used in the class Introduction to Agriculture and Purdue University (AGR 10100) to integrate a writing and research component (http://cpr.molsci.ucla.edu/Home.aspx). Calibrated Peer Review combines the ability to create writing intensive assignments with an introduction to the peer-review…

Acknowledging Students' Collaborations through Peer Review: A Footnoting Practice

ERIC Educational Resources Information Center

Poe, Shelli M.; Gravett, Emily O.

2016-01-01

Student-to-student peer review or peer feedback is commonly used in student-centered or active-learning classrooms. In this article, we describe a footnoting exercise that we implemented in two of our undergraduate courses as one way to encourage students to acknowledge collaborations and contributions made during peer-review processes. This…

Predicting doctor performance outcomes of curriculum interventions: problem-based learning and continuing competence.

PubMed

Norman, Geoffrey R; Wenghofer, Elizabeth; Klass, Daniel

2008-08-01

Problem-based learning (PBL) is an educational strategy designed to enhance self-assessment, self-directed learning and lifelong learning. The present study examines a peer review programme to determine whether the impact of PBL on continuing competence can be detected in practice. This study aimed to establish whether McMaster graduates who graduated between 1972 and 1991 were any less likely to be identified as having issues of competence by a systematic peer review programme than graduates of other Ontario medical schools. We identified a total of 1166 doctors who had graduated after 1972 and had completed a mandated peer review programme. Of these, 108 had graduated from McMaster and 857 from other Canadian schools. School of graduation was cross-tabulated against peer rating. A secondary analysis examined predictors of ratings using multiple regression. We found that 4% of McMaster graduates and 5% of other graduates were deemed to demonstrate cause for concern or serious concern, and that 24% of McMaster doctors and 28% of other doctors were rated as excellent. These differences were not significant. Multiple regression indicated that certification by family medicine or a specialty, female gender and younger age were all predictors of practice outcomes, but school of graduation was not. There is no evidence from this study that PBL graduates are better able to maintain competence than graduates of conventional schools. The study highlights potential problems in attempting to link undergraduate educational interventions to doctor performance outcomes.

A Method for Improving the Integrity of Peer Review.

PubMed

Dadkhah, Mehdi; Kahani, Mohsen; Borchardt, Glenn

2017-08-15

Peer review is the most important aspect of reputable journals. Without it, we would be unsure about whether the material published was as valid and reliable as is possible. However, with the advent of the Internet, scientific literature has now become subject to a relatively new phenomenon: fake peer reviews. Some dishonest researchers have been manipulating the peer review process to publish what are often inferior papers. There are even papers that explain how to do it. This paper discusses one of those methods and how editors can defeat it by using a special review ID. This method is easy to understand and can be added to current peer review systems easily.

Measuring the effectiveness of scientific gatekeeping.

PubMed

Siler, Kyle; Lee, Kirby; Bero, Lisa

2015-01-13

Peer review is the main institution responsible for the evaluation and gestation of scientific research. Although peer review is widely seen as vital to scientific evaluation, anecdotal evidence abounds of gatekeeping mistakes in leading journals, such as rejecting seminal contributions or accepting mediocre submissions. Systematic evidence regarding the effectiveness--or lack thereof--of scientific gatekeeping is scant, largely because access to rejected manuscripts from journals is rarely available. Using a dataset of 1,008 manuscripts submitted to three elite medical journals, we show differences in citation outcomes for articles that received different appraisals from editors and peer reviewers. Among rejected articles, desk-rejected manuscripts, deemed as unworthy of peer review by editors, received fewer citations than those sent for peer review. Among both rejected and accepted articles, manuscripts with lower scores from peer reviewers received relatively fewer citations when they were eventually published. However, hindsight reveals numerous questionable gatekeeping decisions. Of the 808 eventually published articles in our dataset, our three focal journals rejected many highly cited manuscripts, including the 14 most popular; roughly the top 2 percent. Of those 14 articles, 12 were desk-rejected. This finding raises concerns regarding whether peer review is ill--suited to recognize and gestate the most impactful ideas and research. Despite this finding, results show that in our case studies, on the whole, there was value added in peer review. Editors and peer reviewers generally--but not always-made good decisions regarding the identification and promotion of quality in scientific manuscripts.

A Review of the Effects of Self-Monitoring on Reading Performance of Students with Disabilities

ERIC Educational Resources Information Center

Joseph, Laurice M.; Eveleigh, Elisha L.

2011-01-01

The purpose of this review was to synthesize the effects of self-monitoring methods on reading achievement for students with disabilities. Studies examining the self-monitoring of reading behaviors that were published in peer-reviewed journals from 1987 to 2008 were synthesized with regard to types of participants, settings, research designs,…

Context-Aware Reviewer Assignment for Trust Enhanced Peer Review

PubMed Central

Li, Lei; Wang, Yan; Liu, Guanfeng; Wang, Meng; Wu, Xindong

2015-01-01

Reviewer assignment is critical to peer review systems, such as peer-reviewed research conferences or peer-reviewed funding applications, and its effectiveness is a deep concern of all academics. However, there are some problems in existing peer review systems during reviewer assignment. For example, some of the reviewers are much more stringent than others, leading to an unfair final decision, i.e., some submissions (i.e., papers or applications) with better quality are rejected. In this paper, we propose a context-aware reviewer assignment for trust enhanced peer review. More specifically, in our approach, we first consider the research area specific expertise of reviewers, and the institution relevance and co-authorship between reviewers and authors, so that reviewers with the right expertise are assigned to the corresponding submissions without potential conflict of interest. In addition, we propose a novel cross-assignment paradigm, and reviewers are cross-assigned in order to avoid assigning a group of stringent reviewers or a group of lenient reviewers to the same submission. More importantly, on top of them, we propose an academic CONtext-aware expertise relevanCe oriEnted Reviewer cross-assignmenT approach (CONCERT), which aims to effectively estimate the “true” ratings of submissions based on the ratings from all reviewers, even though no prior knowledge exists about the distribution of stringent reviewers and lenient reviewers. The experiments illustrate that compared with existing approaches, our proposed CONCERT approach can less likely assign more than one stringent reviewers or lenient reviewers to a submission simultaneously and significantly reduce the influence of ratings from stringent reviewers and lenient reviewers, leading to trust enhanced peer review and selection, no matter what kind of distributions of stringent reviewers and lenient reviewers are. PMID:26090849

International Conference in Computational Cell Biology: From the Past to the Future

DTIC Science & Technology

2016-09-12

24061 -0001 ABSTRACT Number of Papers published in peer -reviewed journals: Number of Papers published in non peer -reviewed journals: Final Report...present their latest research and discussed challenges in computational cell biology research and education. (a) Papers published in peer -reviewed...List the papers, including journal references, in the following categories: (b) Papers published in non- peer -reviewed journals (N/A for none) (c

Evidence-based Peer Review for Radiation Therapy - Updated Review of the Literature with a Focus on Tumour Subsite and Treatment Modality.

PubMed

Huo, M; Gorayski, P; Poulsen, M; Thompson, K; Pinkham, M B

2017-10-01

Technological advances in radiation therapy permit steep dose gradients from the target to spare normal tissue, but increase the risk of geographic miss. Suboptimal target delineation adversely affects clinical outcomes. Prospective peer review is a method for quality assurance of oncologists' radiotherapy plans. Published surveys suggest it is widely implemented. However, it may not be feasible to review every case before commencement of radiation therapy in all departments. The rate of plan changes following peer review of cases without a specific subsite or modality is typically around 10%. Stereotactic body radiation therapy, head and neck, gynaecological, gastrointestinal, haematological and lung cases are associated with higher rates of change of around 25%. These cases could thus be prioritised for peer review. Other factors may limit peer review efficacy including organisational culture, time constraints and the physical environment in which sessions are held. Recommendations for peer review endorsed by the American Society for Radiation Oncology were made available in 2013, but a number of relevant studies have been published since. Here we review and update the literature, and provide an updated suggestion for the implementation of peer review to serve as an adjunct to published guidelines. This may help practitioners evaluate their current processes and maximise the utility and effectiveness of peer review sessions. Copyright © 2017 The Royal College of Radiologists. Published by Elsevier Ltd. All rights reserved.

Coached Peer Review: Developing the Next Generation of Authors.

PubMed

Sidalak, Daniel; Purdy, Eve; Luckett-Gatopoulos, S; Murray, Heather; Thoma, Brent; Chan, Teresa M

2017-02-01

Publishing in academic journals is challenging for learners. Those who pass the initial stages of internal review by an editor often find the anonymous peer review process harsh. Academic blogs offer alternate avenues for publishing medical education material. Many blogs, however, lack a peer review process, which some consumers argue compromises the quality of materials published. CanadiEM (formerly BoringEM) is an academic educational emergency medicine blog dedicated to publishing high-quality materials produced by learners (i.e., residents and medical students). The editorial team has designed and implemented a collaborative "coached peer review" process that comprises an open exchange among the learner-author, editors, and reviewers. The goal of this process is to facilitate the publication of high-quality academic materials by learner-authors while providing focused feedback to help them develop academic writing skills. The authors of this Innovation Report surveyed (February-June 2015) their blog's learner-authors and external expert "staff" reviewers who had participated in coached peer review for their reactions to the process. The survey results revealed that participants viewed the process positively compared with both traditional journal peer review and academic blog publication processes. Participants found the process friendly, easy, efficient, and transparent. Learner-authors also reported increased confidence in their published material. These outcomes met the goals of coached peer review. CanadiEM aims to inspire continued participation in, exposure to, and high-quality production of academic writing by promoting the adoption of coached peer review for online educational resources produced by learners.

Improving your journal article using feedback from peer review.

PubMed

Price, Bob

2014-09-30

While preparation of a journal article for submission may often include informal review by colleagues, an article is not accepted for publication until it has been formally peer reviewed. Peer review is the process whereby journal editors ask expert reviewers to examine the work submitted and prepare a report on its suitability for publication. Two or more revisions of the article may be required following peer review, with the author reworking the article in the light of feedback received on each occasion. This can be challenging for some authors, but used well, it offers a chance to improve the work to the required standard of the journal, and help the author present a more precise and coherent account of the arguments. The extent to which the author responds to the critical commentary of peer reviewers is important, because this may determine whether or not the article is published. This article explores the aims of peer reviewers and recommends ways in which authors can respond to the feedback provided.

Peer Collaboration: Improving Teaching through Comprehensive Peer Review

ERIC Educational Resources Information Center

Smith, Shelley L.

2014-01-01

This article includes a brief rationale and review of the literature on peer review of teaching (PRT). Based on that literature review, it offers a proposal for an optimal formative review process that results in a teaching portfolio that would reflect a faculty member's efforts and successes in a critically reflective PRT process, and contributes…

42 CFR 52h.9 - What matters must be reviewed for unsolicited contract proposals?

Code of Federal Regulations, 2010 CFR

2010-10-01

... SERVICES GRANTS SCIENTIFIC PEER REVIEW OF RESEARCH GRANT APPLICATIONS AND RESEARCH AND DEVELOPMENT CONTRACT... covered by this part unless the proposal has been reviewed by a peer review group in accordance with the... proposal. (b) Except to the extent otherwise provided by law, peer review group recommendations are...

Peer review.

PubMed

Twaij, H; Oussedik, S; Hoffmeyer, P

2014-04-01

The maintenance of quality and integrity in clinical and basic science research depends upon peer review. This process has stood the test of time and has evolved to meet increasing work loads, and ways of detecting fraud in the scientific community. However, in the 21st century, the emphasis on evidence-based medicine and good science has placed pressure on the ways in which the peer review system is used by most journals. This paper reviews the peer review system and the problems it faces in the digital age, and proposes possible solutions.

7 CFR 3400.10 - Establishment and operation of peer review groups.

Code of Federal Regulations, 2011 CFR

2011-01-01

... INSTITUTE OF FOOD AND AGRICULTURE SPECIAL RESEARCH GRANTS PROGRAM Scientific Peer Review of Research Grant Applications § 3400.10 Establishment and operation of peer review groups. Subject to § 3400.5, the...

28 CFR 34.104 - Use of peer review.

Code of Federal Regulations, 2013 CFR

2013-07-01

... the peer review process. (c) Ratings will be in the form of numerical scores assigned by individual... results of peer review for a noncompetitive new or continuation project will be in the form of numerical...

28 CFR 34.104 - Use of peer review.

Code of Federal Regulations, 2014 CFR

2014-07-01

... the peer review process. (c) Ratings will be in the form of numerical scores assigned by individual... results of peer review for a noncompetitive new or continuation project will be in the form of numerical...

28 CFR 34.104 - Use of peer review.

Code of Federal Regulations, 2011 CFR

2011-07-01

... the peer review process. (c) Ratings will be in the form of numerical scores assigned by individual... results of peer review for a noncompetitive new or continuation project will be in the form of numerical...

28 CFR 34.104 - Use of peer review.

Code of Federal Regulations, 2012 CFR

2012-07-01

... the peer review process. (c) Ratings will be in the form of numerical scores assigned by individual... results of peer review for a noncompetitive new or continuation project will be in the form of numerical...

An approach to peer review in forensic pathology.

PubMed

Sims, D Noel; Langlois, Neil E I; Byard, Roger W

2013-07-01

Peer review in forensic pathology has been a long time in evolution but may provide a very useful mechanism to check for, and to correct, errors, in addition to establishing an important educative vehicle for pathologists. A process is reported that has been established at our institution that involves both informal peer review in the mortuary and formal auditing of a set number of cases. Every autopsy case is discussed at a daily meeting of pathologists before a provisional cause of death is released. In addition, one in ten cases including all homicides, deaths in custody, suspicious and paediatric cases, and randomly selected additional cases undergo formal auditing by a second pathologist. Finally, administrative staff check the completed report. This formalized process, in a jurisdiction where autopsies are usually performed by only one pathologist, has been extremely useful in standardizing autopsy reports and in enabling pathologists to discuss cases and associated issues on a regular basis. Copyright © 2013 Elsevier Ltd and Faculty of Forensic and Legal Medicine. All rights reserved.

Effectiveness of community-based peer-led diabetes self-management programmes (COMP-DSMP) for improving clinical outcomes and quality of life of adults with diabetes in primary care settings in low and middle-income countries (LMIC): a systematic review and meta-analysis.

PubMed

Werfalli, Mahmoud; Raubenheimer, Peter; Engel, Mark; Peer, Nasheeta; Kalula, Sebastiana; Kengne, Andre P; Levitt, Naomi S

2015-07-15

Globally, an estimated 380 million people live with diabetes today--80% in low-income and middle-income countries. The Middle East, Western Pacific, Sub-Saharan Africa and South-East Asia remain the most affected regions where economic development has transformed lifestyles, people live longer and there is an increase in the adult population. Although peer support has been used in different conditions with varied results, yet there is limited evidence to date supporting its effectiveness, particularly for individuals with diabetes. In this review, we will focus on community-based peer-led diabetes self-management programmes (COMP-DSMP) and examine the implementation strategies and diabetes-related health outcomes associated with them in LMIC primary healthcare settings. In accordance with reporting equity-focused systematic reviews PRISMA-P (preferred reporting items for systematic review and meta-analysis protocols 2015 checklist) guidelines, a systematic review with meta-analysis of randomised controlled trials (RCTs), non-randomised controlled trials, quasi-randomised controlled trials (CCTs) that involve contact with an individual or group of peers (paid or voluntary). Electronic searches will be performed in The Cochrane Library, MEDLINE, PubMed, SCOUPS, CINAHL and PsycINFO Database for the period January up to July 2000 along with manual searches in the reference lists of relevant papers. The analyses will be performed based on baseline data from RCTs, CCTs and preintervention and postintervention means or proportions will be reported for both intervention and control groups, and the absolute change from baseline will be calculated, together with 95% CIs. For dichotomous outcomes, the relative risk of the outcome will be presented compared to the control group. The risk difference will be calculated, which is the absolute difference in the proportions in each treatment group. Ethics is not required for this study, given that this is a protocol for a systematic review, which utilises published data. The findings of this study will be widely disseminated through peer-reviewed publications and conference presentations. PROSPERO (2014:CRD42014007531). Published by the BMJ Publishing Group Limited. For permission to use (where not already granted under a licence) please go to http://group.bmj.com/group/rights-licensing/permissions.

Effectiveness of community-based peer-led diabetes self-management programmes (COMP-DSMP) for improving clinical outcomes and quality of life of adults with diabetes in primary care settings in low and middle-income countries (LMIC): a systematic review and meta-analysis

PubMed Central

Werfalli, Mahmoud; Raubenheimer, Peter; Engel, Mark; Peer, Nasheeta; Kalula, Sebastiana; Kengne, Andre P; Levitt, Naomi S

2015-01-01

Introduction Globally, an estimated 380 million people live with diabetes today—80% in low-income and middle-income countries. The Middle East, Western Pacific, Sub-Saharan Africa and South-East Asia remain the most affected regions where economic development has transformed lifestyles, people live longer and there is an increase in the adult population. Although peer support has been used in different conditions with varied results, yet there is limited evidence to date supporting its effectiveness, particularly for individuals with diabetes. In this review, we will focus on community-based peer-led diabetes self-management programmes (COMP-DSMP) and examine the implementation strategies and diabetes-related health outcomes associated with them in LMIC primary healthcare settings. Methods and analysis In accordance with reporting equity-focused systematic reviews PRISMA-P (preferred reporting items for systematic review and meta-analysis protocols 2015 checklist) guidelines, a systematic review with meta-analysis of randomised controlled trials (RCTs), non-randomised controlled trials, quasi-randomised controlled trials (CCTs) that involve contact with an individual or group of peers (paid or voluntary). Electronic searches will be performed in The Cochrane Library, MEDLINE, PubMed, SCOUPS, CINAHL and PsycINFO Database for the period January up to July 2000 along with manual searches in the reference lists of relevant papers. The analyses will be performed based on baseline data from RCTs, CCTs and preintervention and postintervention means or proportions will be reported for both intervention and control groups, and the absolute change from baseline will be calculated, together with 95% CIs. For dichotomous outcomes, the relative risk of the outcome will be presented compared to the control group. The risk difference will be calculated, which is the absolute difference in the proportions in each treatment group. Ethics and dissemination Ethics is not required for this study, given that this is a protocol for a systematic review, which utilises published data. The findings of this study will be widely disseminated through peer-reviewed publications and conference presentations. Trial registration number PROSPERO (2014:CRD42014007531). PMID:26179646

Eyes wide open: reader and author responsibility in understanding the limits of peer review.

PubMed

Benson, P J

2015-10-01

'Medical science can only flourish in a free society and dies under totalitarian repression.' (1) Peer review post-publication is relatively easy to define: when the world decides the importance of publication. Peer review pre-publication is what the scientific community frequently means when using the term 'peer review'. But what it is it? Few will agree on an exact definition; generally speaking, it refers to an independent, third party scrutiny of a manuscript by scientific experts (called peers) who advise on its suitability for publication. Peer review is expensive; although reviewers are unpaid, the cost in time is enormous and it is slow. There is often little agreement among reviewers about whether an article should be published and peer review can be a lottery. Often referred to as a quality assurance process, there are many examples of when peer review failed. Many will be aware of Woo-Suk Hwang's shocking stem cell research misconduct at Seoul National University. (2) Science famously published two breakthrough articles that were found subsequently to be completely fabricated and this happened in spite of peer review. Science is not unique in making this error. However, love it or hate it, peer review, for the present time at least, is here to stay. In this article, Philippa Benson, Managing Editor of Science Advances (the first open access journal of the American Association for the Advancement of Science), discusses the merits of peer review. Dr Benson has extensive experience in the publishing world and was Executive Director of PJB Consulting, a not-for-profit organisation supporting clients on issues related to converting to full electronic publishing workflows as well as challenges working with international authors and publishers. Her clients included the Public Library of Science journals, the American Society for Nutrition and the de Beaumont Foundation. She recently co-authored a book, What Editors Want: An Author's Guide to Scientific Journal Publishing (University of Chicago Press), which helps readers understand and navigate the publishing process in high impact science and technical journals. Her master's and doctorate degrees are from Carnegie Mellon University. JYOTI SHAH Commissioning Editor References 1. Eaton KK . Editorial: when is a peer review journal not a peer review journal? J Nutr Environ Med 1997 ; 7 : 139 - 144 . 2. van der Heyden MA , van de Ven T , Opthof T . Fraud and misconduct in science: the stem cell seduction . Neth Heart J 2009 ; 17 : 25 - 29 .

Radiological performance assessment for the E-Area Vaults Disposal Facility. Appendices A through M

DOE Office of Scientific and Technical Information (OSTI.GOV)

Cook, J.R.

1994-04-15

These document contains appendices A-M for the performance assessment. They are A: details of models and assumptions, B: computer codes, C: data tabulation, D: geochemical interactions, E: hydrogeology of the Savannah River Site, F: software QA plans, G: completeness review guide, H: performance assessment peer review panel recommendations, I: suspect soil performance analysis, J: sensitivity/uncertainty analysis, K: vault degradation study, L: description of naval reactor waste disposal, M: porflow input file. (GHH)

Social development of children born very preterm: a systematic review.

PubMed

Ritchie, Kirsten; Bora, Samudragupta; Woodward, Lianne J

2015-10-01

To review systematically studies examining the development of social competence in children born very preterm (VPT) (gestation <33 wks) and identify neonatal and family predictors. Peer-reviewed original articles were extracted from PubMed and PsycINFO following Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) guidelines. Selection criteria included children born VPT and comparison children born at term, sample born after 1990, and children assessed between 0 and 17 years on at least one measure of social competence spanning social adjustment, performance, and/or social skills. Twenty-three studies were included. Seven focused on social competence and another 16 examined social competence within a range of outcomes. Study quality was low. Limitations included reliance on single informant data, cross-sectional measurement, use of brief screening tools, absence of child or peer report, and no conceptual model. In terms of social adjustment, 16 out of 21 studies found children born VPT had more peer problems and social withdrawal. Findings of social performance were mixed, with some studies suggesting differences in prosocial behavior (4/14) and others not. Social skills were assessed in four studies and showed children born VPT had poorer skills than children born at term. Predictors of social competence included gestational age, neonatal brain abnormalities, and family socio-economic status. Children born VPT have poorer social competence. These difficulties emerge early and persist throughout childhood. © 2015 Mac Keith Press.

Pre-university Chemistry Students in a Mimicked Scholarly Peer Review

NASA Astrophysics Data System (ADS)

van Rens, Lisette; Hermarij, Philip; Pilot, Albert; Beishuizen, Jos; Hofman, Herman; Wal, Marjolein

2014-10-01

Peer review is a significant component in scientific research. Introducing peer review into inquiry processes may be regarded as an aim to develop student understanding regarding quality in inquiries. This study examines student understanding in inquiry peer reviews among pre-university chemistry students, aged 16-17, when they enact a design of a mimicked scholarly peer review. This design is based on a model of a human activity system. Twenty-five different schools in Brazil, Germany, Poland and The Netherlands participated. The students (n = 880) conducted in small groups (n = 428) open inquiries on fermentation. All groups prepared an inquiry report for peer review. These reports were published on a website. Groups were randomly paired in an internet symposium, where they posted review comments to their peers. These responses were qualitatively analyzed on small groups' level of understanding regarding seven categories: inquiry question, hypothesis, management of control variables, accurate measurement, presenting results, reliability of results, discussion and conclusion. The mimicked scholarly review prompted a collective practice. Student understanding was significantly well on presenting results, discussion and conclusion, and significantly less on inquiry question and reliability of results. An enacted design, based on a model of a human activity system, created student understanding of quality in inquiries as well as an insight in a peer-reviewing practice. To what extent this model can be applied in a broader context of design research in science education needs further study.

Peer review of health research funding proposals: A systematic map and systematic review of innovations for effectiveness and efficiency.

PubMed

Shepherd, Jonathan; Frampton, Geoff K; Pickett, Karen; Wyatt, Jeremy C

2018-01-01

To investigate methods and processes for timely, efficient and good quality peer review of research funding proposals in health. A two-stage evidence synthesis: (1) a systematic map to describe the key characteristics of the evidence base, followed by (2) a systematic review of the studies stakeholders prioritised as relevant from the map on the effectiveness and efficiency of peer review 'innovations'. Standard processes included literature searching, duplicate inclusion criteria screening, study keyword coding, data extraction, critical appraisal and study synthesis. A total of 83 studies from 15 countries were included in the systematic map. The evidence base is diverse, investigating many aspects of the systems for, and processes of, peer review. The systematic review included eight studies from Australia, Canada, and the USA, evaluating a broad range of peer review innovations. These studies showed that simplifying the process by shortening proposal forms, using smaller reviewer panels, or expediting processes can speed up the review process and reduce costs, but this might come at the expense of peer review quality, a key aspect that has not been assessed. Virtual peer review using videoconferencing or teleconferencing appears promising for reducing costs by avoiding the need for reviewers to travel, but again any consequences for quality have not been adequately assessed. There is increasing international research activity into the peer review of health research funding. The studies reviewed had methodological limitations and variable generalisability to research funders. Given these limitations it is not currently possible to recommend immediate implementation of these innovations. However, many appear promising based on existing evidence, and could be adapted as necessary by funders and evaluated. Where feasible, experimental evaluation, including randomised controlled trials, should be conducted, evaluating impact on effectiveness, efficiency and quality.

Multi-Stage Open Peer Review: Scientific Evaluation Integrating the Strengths of Traditional Peer Review with the Virtues of Transparency and Self-Regulation

PubMed Central

Pöschl, Ulrich

2012-01-01

The traditional forms of scientific publishing and peer review do not live up to all demands of efficient communication and quality assurance in today’s highly diverse and rapidly evolving world of science. They need to be advanced and complemented by interactive and transparent forms of review, publication, and discussion that are open to the scientific community and to the public. The advantages of open access, public peer review, and interactive discussion can be efficiently and flexibly combined with the strengths of traditional scientific peer review. Since 2001 the benefits and viability of this approach are clearly demonstrated by the highly successful interactive open access journal Atmospheric Chemistry and Physics (ACP, www.atmos-chem-phys.net) and a growing number of sister journals launched and operated by the European Geosciences Union (EGU, www.egu.eu) and the open access publisher Copernicus (www.copernicus.org). The interactive open access journals are practicing an integrative multi-stage process of publication and peer review combined with interactive public discussion, which effectively resolves the dilemma between rapid scientific exchange and thorough quality assurance. Key features and achievements of this approach are: top quality and impact, efficient self-regulation and low rejection rates, high attractivity and rapid growth, low costs, and financial sustainability. In fact, ACP and the EGU interactive open access sister journals are by most if not all standards more successful than comparable scientific journals with traditional or alternative forms of peer review (editorial statistics, publication statistics, citation statistics, economic costs, and sustainability). The high efficiency and predictive validity of multi-stage open peer review have been confirmed in a series of dedicated studies by evaluation experts from the social sciences, and the same or similar concepts have recently also been adopted in other disciplines, including the life sciences and economics. Multi-stage open peer review can be flexibly adjusted to the needs and peculiarities of different scientific communities. Due to the flexibility and compatibility with traditional structures of scientific publishing and peer review, the multi-stage open peer review concept enables efficient evolution in scientific communication and quality assurance. It has the potential for swift replacement of hidden peer review as the standard of scientific quality assurance, and it provides a basis for open evaluation in science. PMID:22783183

Content and communication: How can peer review provide helpful feedback about the writing?

PubMed Central

Shashok, Karen

2008-01-01

Background Peer review is assumed to improve the quality of research reports as tools for scientific communication, yet strong evidence that this outcome is obtained consistently has been elusive. Failure to distinguish between aspects of discipline-specific content and aspects of the writing or use of language may account for some deficiencies in current peer review processes. Discussion The process and outcomes of peer review may be analyzed along two dimensions: 1) identifying scientific or technical content that is useful to other researchers (i.e., its "screening" function), and 2) improving research articles as tools for communication (i.e., its "improving" function). However, editors and reviewers do not always distinguish clearly between content criteria and writing criteria. When peer reviewers confuse content and writing, their feedback can be misunderstood by authors, who may modify texts in ways that do not make the readers' job easier. When researchers in peer review confuse the two dimensions, this can lead to content validity problems that foil attempts to define informative variables and outcome measures, and thus prevent clear trends from emerging. Research on writing, revising and editing suggests some reasons why peer review is not always as effective as it might be in improving what is written. Summary Peer review could be improved if stakeholders were more aware of variations in gatekeepers' (reviewers' and editors') ability to provide feedback about the content or the writing. Gatekeepers, academic literacy researchers, and wordface professionals (author's editors, medical writers and translators) could work together to discover the types of feedback authors find most useful. I offer suggestions to help editologists design better studies of peer review which could make the process an even stronger tool for manuscript improvement than it is now. PMID:18237378

Content and communication: how can peer review provide helpful feedback about the writing?

PubMed

Shashok, Karen

2008-01-31

Peer review is assumed to improve the quality of research reports as tools for scientific communication, yet strong evidence that this outcome is obtained consistently has been elusive. Failure to distinguish between aspects of discipline-specific content and aspects of the writing or use of language may account for some deficiencies in current peer review processes. The process and outcomes of peer review may be analyzed along two dimensions: 1) identifying scientific or technical content that is useful to other researchers (i.e., its "screening" function), and 2) improving research articles as tools for communication (i.e., its "improving" function). However, editors and reviewers do not always distinguish clearly between content criteria and writing criteria. When peer reviewers confuse content and writing, their feedback can be misunderstood by authors, who may modify texts in ways that do not make the readers' job easier. When researchers in peer review confuse the two dimensions, this can lead to content validity problems that foil attempts to define informative variables and outcome measures, and thus prevent clear trends from emerging. Research on writing, revising and editing suggests some reasons why peer review is not always as effective as it might be in improving what is written. Peer review could be improved if stakeholders were more aware of variations in gatekeepers' (reviewers' and editors') ability to provide feedback about the content or the writing. Gatekeepers, academic literacy researchers, and wordface professionals (author's editors, medical writers and translators) could work together to discover the types of feedback authors find most useful. I offer suggestions to help editologists design better studies of peer review which could make the process an even stronger tool for manuscript improvement than it is now.

Applications of the Schur Basis to Quantum Algorithms

DTIC Science & Technology

2011-01-10

superpolynomial speedups based on quantum circuits. (a) Papers published in peer -reviewed journals (N/A for none) 1. D.A.Bacon, I.L. Chuang, A.W...reporting period. List the papers, including journal references, in the following categories: (b) Papers published in non- peer -reviewed journals or in...MIT, Department of EECS, 2008 7.00Number of Papers published in peer -reviewed journals: Number of Papers published in non peer -reviewed journals: (c

Redefining the Practice of Peer Review Through Intelligent Automation Part 1: Creation of a Standardized Methodology and Referenceable Database.

PubMed

Reiner, Bruce I

2017-10-01

Conventional peer review practice is compromised by a number of well-documented biases, which in turn limit standard of care analysis, which is fundamental to determination of medical malpractice. In addition to these intrinsic biases, other existing deficiencies exist in current peer review including the lack of standardization, objectivity, retrospective practice, and automation. An alternative model to address these deficiencies would be one which is completely blinded to the peer reviewer, requires independent reporting from both parties, utilizes automated data mining techniques for neutral and objective report analysis, and provides data reconciliation for resolution of finding-specific report differences. If properly implemented, this peer review model could result in creation of a standardized referenceable peer review database which could further assist in customizable education, technology refinement, and implementation of real-time context and user-specific decision support.

The mechanisms underpinning peer support: a literature review.

PubMed

Watson, Emma

2017-12-20

The employment of Peer Support Workers, who themselves have experience of significant emotional distress, can promote recovery at an individual and organisational level. While research examining the benefits of peer support within mental health services continues to grow, an understanding of how, and through what processes, these benefits are reached remains under-developed. To review the published research literature relating to the process of peer support and its underpinning mechanisms to better understand how and why it works. A scoping review of published literature identified studies relating to peer support mechanisms, processes and relationships. Studies were summarised and findings analysed. Five mechanisms were found to underpin peer support relationships (lived experience, love labour, the liminal position of the peer worker, strengths-focussed social and practical support, and the helper role). The identified mechanisms can underpin both the success and difficulties associated with peer support relationships. Further research should review a broader range of literature and clarify how these mechanisms contribute to peer support in different contexts.

Effectiveness of Guided Peer Review of Student Essays in a Large Undergraduate Biology Course

ERIC Educational Resources Information Center

Kelly, Lauren

2015-01-01

Instructors and researchers often consider peer review an integral part of the writing process, providing myriad benefits for both writers and reviewers. Few empirical studies, however, directly address the relationship between specific methodological changes and peer review effectiveness, especially outside the composition classroom. To…

42 CFR 52h.6 - Availability of information.

Code of Federal Regulations, 2010 CFR

2010-10-01

... a peer review group will be available for public inspection and copying to the extent provided by... regulations (45 CFR parts 5, 5b). (b) Meetings of peer review groups reviewing grant applications or contract... by peer review groups that contain trade secrets or commercial or financial information obtained from...

Methodologies of Peer and Editorial Review: Changing Practices

ERIC Educational Resources Information Center

Selfe, Cynthia; Hawisher, Gail

2012-01-01

The authors--drawing on their varied experiences as authors and publishers of a journal and several book series--provide a historical review and consideration of peer review in publishing. They find that scholarly peer review, from the question of signed reviews to the practices of digital publications, is in the midst of change, but that at the…

42 CFR 52h.7 - What matters must be reviewed for grants?

Code of Federal Regulations, 2010 CFR

2010-10-01

... SCIENTIFIC PEER REVIEW OF RESEARCH GRANT APPLICATIONS AND RESEARCH AND DEVELOPMENT CONTRACT PROJECTS § 52h.7... reviewed by a peer review group in accordance with the provisions of this part and the group has made... appropriate peer review group, in accordance with the provisions of this part, and the group has made...

Comparing Peer Review and Self-Review as Ways to Improve College Students' Writing

ERIC Educational Resources Information Center

Covill, Amy E.

2010-01-01

The effect of three approaches to revision instruction on 61 college students' revision behavior and writing quality was investigated for this article. Students wrote three 5-page papers and received one of three instructional approaches: Formal Peer Review (n = 19), Formal Self-Review (n = 20), or No Formal Review (n = 22). Formal Peer Review…

Biomass Program 2007 Program Peer Review - Full Report

DOE Office of Scientific and Technical Information (OSTI.GOV)

none,

This document summarizes the comments provided by the peer reviewers at the U.S. Department of Energy (DOE) Biomass Program’s Peer Review meeting, held on November 14-15, 2007 in Baltimore, MD and Platform Reviews conducted over the summer of 2007. The Platform Reviews provide evaluations of the Program’s projects in applied research, development, and demonstration.

Views on the peer review system of biomedical journals: an online survey of academics from high-ranking universities

PubMed Central

2013-01-01

Background Peer review is the major method used by biomedical journals for making the decision of publishing an article. This cross-sectional survey assesses views concerning the review system of biomedical journals among academics globally. Methods A total of 28,009 biomedical academics from high-ranking universities listed by the 2009 Times Higher Education Quacquarelli Symonds (THE-QS) World University Rankings were contacted by email between March 2010 and August 2010. 1,340 completed an online survey which focused on their academic background, negative experiences and views on biomedical journal peer review and the results were compared among basic scientists, clinicians and clinician scientists. Results Fewer than half of the respondents agreed that the peer review systems of biomedical journals were fair (48.4%), scientific (47.5%), or transparent (25.1%). Nevertheless, 58.2% of the respondents agreed that authors should remain anonymous and 64.4% agreed that reviewers should not be disclosed. Most, (67.7%) agreed to the establishment of an appeal system. The proportion of native English-speaking respondents who agreed that the “peer review system is fair” was significantly higher than for non-native respondents (p = 0.02). Similarly, the proportion of clinicians stating that the “peer review system is fair” was significantly higher than that for basic scientists and clinician-scientists (p = 0.004). For females, (β = −0.1, p = 0.03), the frequency of encountering personal attacks in reviewers’ comments (β = −0.1, p = 0.002) and the frequency of imposition of unnecessary references by reviewers (β = −0.06, p = 0.04) were independently and inversely associated with agreement that “the peer review system is fair”. Conclusion Academics are divided on the issue of whether the biomedical journal peer review system is fair, scientific and transparent. A majority of academics agreed with the double-blind peer review and to the establishment of an appeal system. Female academics, experience of personal attacks and imposition of unnecessary references by reviewers were related to disagreement about fairness of the peer review system of biomedical journals. PMID:23758823

Four peer reviews in support of the Tier 3 rulemaking ...

EPA Pesticide Factsheets

Peer review of ERG's KenCaryl (CO) estimated summer hot-soak distributions report in support of the Tier 3 rulemaking To peer review ERG's KenCaryl (CO) estimated summer hot-soak distributions report (for Tier 3 rulemaking)

Clinical perspective: creating an effective practice peer review process-a primer.

PubMed

Gandhi, Manisha; Louis, Frances S; Wilson, Shae H; Clark, Steven L

2017-03-01

Peer review serves as an important adjunct to other hospital quality and safety programs. Despite its importance, the available literature contains virtually no guidance regarding the structure and function of effective peer review committees. This Clinical Perspective provides a summary of the purposes, structure, and functioning of effective peer review committees. We also discuss important legal considerations that are a necessary component of such processes. This discussion includes useful templates for case selection and review. Proper committee structure, membership, work flow, and leadership as well as close cooperation with the hospital medical executive committee and legal representatives are essential to any effective peer review process. A thoughtful, fair, systematic, and organized approach to creating a peer review process will lead to confidence in the committee by providers, hospital leadership, and patients. If properly constructed, such committees may also assist in monitoring and enforcing compliance with departmental protocols, thus reducing harm and promoting high-quality practice. Copyright © 2016 Elsevier Inc. All rights reserved.

Does peer-assisted learning improve academic performance? A scoping review.

PubMed

Williams, Brett; Reddy, Priya

2016-07-01

Due to the diverse and ever-changing nature of the healthcare industry, teaching pedagogies such as peer-assisted learning (PAL) are being implemented to align with external competency standards. A scoping review was conducted in order to map the breadth of literature available on PAL and its impact on student performance. This review used Arksey and O'Malley's six stage scoping methodology. The databases searched included: Cinahl, Ovid Medline, Proquest and Embase as well as grey literature sites and dissertations. 22 articles were included in this review, 10 of which were mixed methods randomised controlled trials, one retrospective study, four controlled trials, two randomised cross over controlled trial, three prospective randomised controlled trials, one thesis and one comparative research design. Analysis of the included articles identified three major themes outlining student performance. Student teachers themselves showed the most significant improvement in objective outcomes. The predominant healthcare field addressed were medical students with very few studies being completed on other professions. The search indicated an overall positive response to PAL with the measurable outcome of student tutors being of most significance. Further research is required to determine the relevance for the wider healthcare community. Copyright © 2016 Elsevier Ltd. All rights reserved.

Why Are Chemists and Other Scientists Afraid of the Peer Review of Teaching?

NASA Astrophysics Data System (ADS)

Atwood, Charles H.; Taylor, James W.; Hutchings, Pat A.

2000-02-01

This paper presents a series of arguments that teaching should be subjected to the similar review standards that chemical research employs. Through peer review, the hope is to elevate the status of teaching in academe. The paper also describes a national effort through the American Association for Higher Education and the Carnegie Foundation for the Advancement of Teaching to establish a peer-review process appropriate for teaching. Finally, an examination of some of the perceived barriers to peer review, including fear, is detailed.

Performance-Based Assessment Resource Guide.

ERIC Educational Resources Information Center

Gilbert, Judith C.; Burger, Patricia

This resource guide reviews a variety of performance-based student assessment strategies, and provides examples of, and references for, the strategies. Strategies include anecdotal records, interviews, peer report and group evaluations, and portfolios. Materials in the guide include: (1) a resource guide update form for teachers; (2) department…

Helping agencies improve their planning analysis techniques.

DOT National Transportation Integrated Search

2011-11-18

This report summarizes the results of a peer review of the AZTDM. The peer review was : supported by the Travel Model Improvement Program (TMIP), which is sponsored by FHWA. : The peer review of a travel model can serve multiple purposes, including i...

Evaluating the effectiveness of peer-based intervention in managing type I diabetes mellitus among children and adolescents: A systematic review

PubMed Central

Kazemi, Sepideh; Parvizy, Soroor; Atlasi, Rasha; Baradaran, Hamid R

2016-01-01

Background: Type 1 diabetes is one of the chronic metabolic disorders among children and adolescents. Peers are also important units in diabetes management through adolescence. This study aimed to evaluate the effectiveness of peer-based intervention in managing type 1 diabetes mellitus among children and adolescents. Methods: Searching articles published prior to December 2013 in PubMed, Web of Science, Cochrane library, Science Direct, Google scholar, CINAHL and Scopus, we found 8,548 publications. The first reviewer critically appraised the retrieved articles, using the CONSORT and the TREND checklists and then the second-assessor checked them. All abstracts were screened, and only eight full text articles remained for evaluation based on inclusion criteria Results: Eight studies, including five randomized controlled trials, one controlled trial, and two pre-post trials were critically appraised based on CONSORT and the TREND checklists. The outcomes of these studies were as follows: knowledge (three studies), attitude (two studies), performance (one study), clinical parameters— exclusively HbA1c—(four studies), and psychosocial parameters—such as quality of life, coping, self-care, selfconfidence, satisfaction with the perceived social support, social skills, and diabetes-related conflicts Conclusion: The findings of this systematic review revealed that peer-based interventions could help to manage diabetes. While there is a lack of professional or family-based interventions and education, peers can be involved in the process of patient education. As there are few studies in the area of peer-based diabetes management, conducting further interventional studies with robust methodology is highly recommended. PMID:28210607

Evaluating the effectiveness of peer-based intervention in managing type I diabetes mellitus among children and adolescents: A systematic review.

PubMed

Kazemi, Sepideh; Parvizy, Soroor; Atlasi, Rasha; Baradaran, Hamid R

2016-01-01

Background: Type 1 diabetes is one of the chronic metabolic disorders among children and adolescents. Peers are also important units in diabetes management through adolescence. This study aimed to evaluate the effectiveness of peer-based intervention in managing type 1 diabetes mellitus among children and adolescents. Methods: Searching articles published prior to December 2013 in PubMed, Web of Science, Cochrane library, Science Direct, Google scholar, CINAHL and Scopus, we found 8,548 publications. The first reviewer critically appraised the retrieved articles, using the CONSORT and the TREND checklists and then the second-assessor checked them. All abstracts were screened, and only eight full text articles remained for evaluation based on inclusion criteria Results: Eight studies, including five randomized controlled trials, one controlled trial, and two pre-post trials were critically appraised based on CONSORT and the TREND checklists. The outcomes of these studies were as follows: knowledge (three studies), attitude (two studies), performance (one study), clinical parameters- exclusively HbA1c-(four studies), and psychosocial parameters-such as quality of life, coping, self-care, selfconfidence, satisfaction with the perceived social support, social skills, and diabetes-related conflicts Conclusion: The findings of this systematic review revealed that peer-based interventions could help to manage diabetes. While there is a lack of professional or family-based interventions and education, peers can be involved in the process of patient education. As there are few studies in the area of peer-based diabetes management, conducting further interventional studies with robust methodology is highly recommended.

EPA Peer Consultation Workshop Report on the Review of the Draft IRIS Toxicological Review of Dibutyl Phthalate (DBP)

EPA Science Inventory

The U.S. EPA finalized comments gathered from a public peer review of the scientific basis supporting the human health hazard and dose-response assessment of dibutyl phthalate (DBP) that will appear on the Integrated Risk Information System (IRIS) database. The peer review has en...

Giving Feedback: Preparing Students for Peer Review and Self-Evaluation

ERIC Educational Resources Information Center

Philippakos, Zoi A.

2017-01-01

Revision is an important aspect of the writing process but is often challenging for students. Peer review can be helpful, but training is needed for it to work effectively. This article suggests an approach to preparing students for peer review by teaching specific evaluation criteria and leading collaborative practice in reviewing papers written…

Writing Quality Peer Reviews of Research Manuscripts

ERIC Educational Resources Information Center

Ward, Phillip; Graber, Kim C.; van der Mars, Hans

2015-01-01

Peer review is an important mechanism for advancing knowledge in a manner deemed as acceptable by the research community. It can also serve the function of providing guidance to an author(s) to improve the likelihood that manuscripts will be accepted in peer reviewed journals. There is, however, little assistance for new or existing reviewers of…

IRIS Toxicological Review and Summary Documents for 1,4-Dichlorobenzene (External Peer Review)

EPA Science Inventory

The U.S. EPA has conducted a peer review of the scientific basis supporting the human health hazard and dose-response assessment of 1,4-dichlorobenzene that will appear on the Integrated Risk Information System (IRIS) database. Peer review is meant to ensure that science is used ...

Biomass Program 2007 Program Peer Review - Feedstock Platform Summary

DOE Office of Scientific and Technical Information (OSTI.GOV)

none,

This document discloses the comments provided by a review panel at the U.S. Department of Energy Office of the Biomass Program Peer Review held on November 15-16, 2007 in Baltimore, MD and the Feedstock Platform Portfolio Peer Review held on August 21st through 23rd in Washington D.C.

Conflict of Interest and Disclosure Policies in Psychiatry and Medicine: A Comparative Study of Peer-Reviewed Journals

ERIC Educational Resources Information Center

Khurana, Gauri; Henderson, Schuyler; Walter, Garry; Martin, Andres

2012-01-01

Objective: The authors reviewed and characterized conflict of interest (COI) and disclosure policies published in peer-reviewed psychiatric and nonpsychiatric journals. Methods: The authors examined peer-reviewed publications in the psychiatric (N=20) and nonpsychiatric (N=20) literature. Using qualitative and quantitative approaches, they…

The Problem of Humiliation in Peer Review

ERIC Educational Resources Information Center

Comer, Debra R.; Schwartz, Michael

2014-01-01

This paper examines the problem of vituperative feedback from peer reviewers. We argue that such feedback is morally unacceptable, insofar as it humiliates authors and damages their dignity. We draw from social-psychological research to explore those aspects of the peer-review process in general and the anonymity of blind reviewing in particular…

Online Peer Review: Encouraging Student Response and Development

ERIC Educational Resources Information Center

Lansiquot, Reneta; Rosalia, Christine

2015-01-01

This study explored the use of a tailored online peer review program for first-year undergraduate students at an urban college of technology. The program facilitated group peer review in meaningful and technologically elegant ways. Students in a composition class were divided into two groups. One group acted as first reviewers, and the other group…

Thank you to our 2016 peer reviewers

NASA Astrophysics Data System (ADS)

Hauck, Steven A.; Baratoux, David; Stanley, Sabine

2017-02-01

Peer review is one of most fundamental aspects of the modern practice of science. As scientists we hold our own work up to scrutiny by experts among our peers in order to encourage the best practices in scientific conduct and communication. Thorough consideration and review by professional colleagues of scientific papers are critical aspects of ensuring that the manuscripts published by JGR-Planets are accurate, valuable, and clearly communicated. Peer review is an essential element of the process of refining understanding and sharing science, and the effort and expertise shared by each reviewer are crucial to the advancement of planetary science. In 2016, JGR Planets benefited from more than 451 reviews provided by 337 of our peers for papers submitted to the journal. Thank you all for your dedication to advancing planetary science.

With Whom Does LANL Publish? – A look at LANL collaborations from 1990 -2015 using the Web of Science

DOE Office of Scientific and Technical Information (OSTI.GOV)

Springer, Everett P.

Collaborations are critical to the science, technology, and engineering achievements at Los Alamos National Laboratory (LANL). This report analyzed the collaborations as measured through peer-reviewed publications from the Web of Science (WoS) database for LANL for the 1990 – 2015 period. Both a cumulative analysis over the entire time period and annual analyses were performed. The results found that the Department of Energy national laboratories, University of California campuses, and other academic institutions collaborate with LANL on regular basis. Results provide insights into trends in peer-reviewed papers collaborations for LANL.

Behind the Spam: A ``Spectral Analysis'' of Predatory Publishers

NASA Astrophysics Data System (ADS)

Beall, Jeffrey

2016-10-01

Most researchers today are bombarded with spam email solicitations from questionable scholarly publishers. These emails solicit article manuscripts, editorial board service, and even ad hoc peer reviews. These ``predatory'' publishers exploit the scholarly publishing process, patterning themselves after legitimate scholarly publishers yet performing little or no peer review and quickly accepting submitted manuscripts and collecting fees from submitting authors. These counterfeit publishers and journals have published much junk science? especially in the field of cosmology? threatening the integrity of the academic record. This paper examines the current state of predatory publishing and advises researchers how to navigate scholarly publishing to best avoid predatory publishers and other scholarly publishing-related perils.

Bridging the Otolaryngology Peer Review Knowledge Gap: A Call for a Residency Development Program.

PubMed

Schmalbach, Cecelia E

2016-07-01

Current otolaryngology literature and future scientific direction rely heavily on a rigorous peer review process. Just as manuscripts warrant thoughtful review with constructive feedback to the authors, the same can be said for critiques written by novice peer reviewers. Formal scientific peer review training programs are lacking. Recognizing this knowledge gap, Otolaryngology-Head and Neck Surgery is excited to offer its new Resident Reviewer Development Program. All otolaryngology residents who are postgraduate year 2 and above and in excellent academic standing are eligible to participate in this mentored program, during which they will conduct 6 manuscript reviews under the direction of a seasoned reviewer in his or her subspecialty area of interest. By completing reviews alongside a mentor, participants gain the required skills to master the peer review process-a first step that often leads to journal editorial board and associate editor invitations. © American Academy of Otolaryngology—Head and Neck Surgery Foundation 2016.

U.S. EPA. 2000. Science Policy Council Handbook: Peer Review

EPA Pesticide Factsheets

The goal of the Peer Review Policy and this Handbook is to enhance the quality and credibility of Agency decisions by ensuring that the scientific and technical work products underlying these decisions receive appropriate levels of peer review by independe

A systematic review of the effectiveness and cost-effectiveness of peer education and peer support in prisons.

PubMed

Bagnall, Anne-Marie; South, Jane; Hulme, Claire; Woodall, James; Vinall-Collier, Karen; Raine, Gary; Kinsella, Karina; Dixey, Rachael; Harris, Linda; Wright, Nat M J

2015-03-25

Prisoners experience significantly worse health than the general population. This review examines the effectiveness and cost-effectiveness of peer interventions in prison settings. A mixed methods systematic review of effectiveness and cost-effectiveness studies, including qualitative and quantitative synthesis was conducted. In addition to grey literature identified and searches of websites, nineteen electronic databases were searched from 1985 to 2012. Study selection criteria were: Prisoners resident in adult prisons and children resident in Young Offender Institutions (YOIs). Peer-based interventions. Review questions 3 and 4 compared peer and professionally led approaches. Prisoner health or determinants of health; organisational/process outcomes; views of prison populations. Quantitative, qualitative and mixed method evaluations. Fifty-seven studies were included in the effectiveness review and one study in the cost-effectiveness review; most were of poor methodological quality. Evidence suggested that peer education interventions are effective at reducing risky behaviours, and that peer support services are acceptable within the prison environment and have a positive effect on recipients, practically or emotionally. Consistent evidence from many, predominantly qualitative, studies, suggested that being a peer deliverer was associated with positive effects. There was little evidence on cost-effectiveness of peer-based interventions. There is consistent evidence from a large number of studies that being a peer worker is associated with positive health; peer support services are also an acceptable source of help within the prison environment and can have a positive effect on recipients. Research into cost-effectiveness is sparse. PROSPERO ref: CRD42012002349.

Letting the daylight in: Reviewing the reviewers and other ways to maximize transparency in science

PubMed Central

Wicherts, Jelte M.; Kievit, Rogier A.; Bakker, Marjan; Borsboom, Denny

2012-01-01

With the emergence of online publishing, opportunities to maximize transparency of scientific research have grown considerably. However, these possibilities are still only marginally used. We argue for the implementation of (1) peer-reviewed peer review, (2) transparent editorial hierarchies, and (3) online data publication. First, peer-reviewed peer review entails a community-wide review system in which reviews are published online and rated by peers. This ensures accountability of reviewers, thereby increasing academic quality of reviews. Second, reviewers who write many highly regarded reviews may move to higher editorial positions. Third, online publication of data ensures the possibility of independent verification of inferential claims in published papers. This counters statistical errors and overly positive reporting of statistical results. We illustrate the benefits of these strategies by discussing an example in which the classical publication system has gone awry, namely controversial IQ research. We argue that this case would have likely been avoided using more transparent publication practices. We argue that the proposed system leads to better reviews, meritocratic editorial hierarchies, and a higher degree of replicability of statistical analyses. PMID:22536180

Expanding capacity and promoting inclusion in introductory computer science: a focus on near-peer mentor preparation and code review

NASA Astrophysics Data System (ADS)

Pon-Barry, Heather; Packard, Becky Wai-Ling; St. John, Audrey

2017-01-01

A dilemma within computer science departments is developing sustainable ways to expand capacity within introductory computer science courses while remaining committed to inclusive practices. Training near-peer mentors for peer code review is one solution. This paper describes the preparation of near-peer mentors for their role, with a focus on regular, consistent feedback via peer code review and inclusive pedagogy. Introductory computer science students provided consistently high ratings of the peer mentors' knowledge, approachability, and flexibility, and credited peer mentor meetings for their strengthened self-efficacy and understanding. Peer mentors noted the value of videotaped simulations with reflection, discussions of inclusion, and the cohort's weekly practicum for improving practice. Adaptations of peer mentoring for different types of institutions are discussed. Computer science educators, with hopes of improving the recruitment and retention of underrepresented groups, can benefit from expanding their peer support infrastructure and improving the quality of peer mentor preparation.

Implementation and Validation of PACS Integrated Peer Review for Discrepancy Recording of Radiology Reporting.

PubMed

Olthof, A W; van Ooijen, P M A

2016-09-01

The purpose of this work is to demonstrate the possibility of implementation of a PACS-integrated peer review system based on RADPEER™ classification providing a step-wise implementation plan utilizing features already present in the standard PACS implementation and without the requirement of additional software development. Furthermore, we show the usage and effects of the system during the first 30 months of usage. To allow fast and easy implementation into the daily workflow the key-word feature of the PACS was used. This feature allows to add a key-word to an imaging examination for easy searching in the PACS database (e.g. by entering keywords for different kinds of pathology). For peer review we implemented a keyword structure including a code for each of the existing RADPEER™ scoring language terms and a keyword with the phrase "second reading" followed by the name of the individual radiologist. The use of the short-keys to enter the codes in relation to the peer review was a simple to use solution. During the study 599 reports were peer reviewed. The active participation in this study of the radiologists varies and ranges from 3 to 327 reviews per radiologist. The number of peer review is highest in CT and CR. There are no significant technical obstacles to implement a PACS-integrated RADPEER™ -system based on key-words allowing easy integration of peer review into the daily routine without the requirement of additional software. Peer review implemented in a non-random setting based on relevant priors could already help in increasing the quality of radiological reporting and serve as continuing education among peers. Decisiveness, tact and trust are needed to promote use of the system and collaborative discussion of the results by radiologist.

What's with all this peer-review stuff anyway?

DOE Office of Scientific and Technical Information (OSTI.GOV)

Warner, J. S.

2010-01-01

The Journal of Physical Security was ostensibly started to deal with a perceived lack of peer-reviewed journals related to the field of physical security. In fact, concerns have been expressed that the field of physical security is scarcely a field at all. A typical, well-developed field might include the following: multiple peer-reviewed journals devoted to the subject, rigor and critical thinking, metrics, fundamental principles, models and theories, effective standards and guidelines, R and D conferences, professional societies, certifications, its own academic department (or at least numerous academic experts), widespread granting of degrees in the field from 4-year research universities, mechanismsmore » for easily spotting 'snake oil' products and services, and the practice of professionals organizing to police themselves, provide quality control, and determine best practices. Physical Security seems to come up short in a number of these areas. Many of these attributes are difficult to quantify. This paper seeks to focus on one area that is quantifiable: the number of peer-reviewed journals dedicated to the field of Physical Security. In addition, I want to examine the number of overall periodicals (peer-reviewed and non-peer-reviewed) dedicated to physical security, as well as the number of papers published each year about physical security. These are potentially useful analyses because one can often infer how healthy or active a given field is by its publishing activity. For example, there are 2,754 periodicals dedicated to the (very healthy and active) field of physics. This paper concentrates on trade journal versus peer-reviewed journals. Trade journals typically focus on practice-related topics. A paper appropriate for a trade journal is usually based more on practical experience than rigorous studies or research. Models, theories, or rigorous experimental research results will usually not be included. A trade journal typically targets a specific market in an industry or trade. Such journals are often considered to be news magazines and may contain industry specific advertisements and/or job ads. A peer-reviewed journal, a.k.a 'referred journal', in contrast, contains peer-reviewed papers. A peer-reviewed paper is one that has been vetted by the peer review process. In this process, the paper is typically sent to independent experts for review and consideration. A peer-reviewed paper might cover experimental results, and/or a rigorous study, analyses, research efforts, theory, models, or one of many other scholarly endeavors.« less

The Fate of Abstracts Presented at the 2013 and 2014 Annual Meetings of the Romanian Society of Gastroenterology and Hepatology.

PubMed

Trifan, Anca; Chihaia, Catalin-Alexandru; Tanase, Oana; Lungu, Cristina-Maria; Stanciu, Carol

2016-12-01

Oral and poster presentations at annual national meetings of the Romanian Society of Gastroenterology and Hepatology (RSGH) provide a forum for education, communication and discussion of new research. However, for the wide-spread dissemination of the new research work, each presentation should be subsequently published as a full-text article in peer-reviewed, indexed journals. to evaluate the publication rate of full-text articles in peer-reviewed journals after being first presented as abstracts at two consecutive RSGH annual meetings. A retrospective review of all abstracts presented at the annual meetings in 2013 and 2014 was performed. PubMed and Google Scholar were searched using abstract titles, first author's name and affiliation, and key words from the title to identify whether an abstract resulted in a peer-reviewed publication. Abstracts published in full-text were subsequently assessed for study type, study center, topics, publication year, journals and their impact factors (IFs). We chose the 2013 and 2014 meetings to ensure a minimum two-year follow-up period since the last meeting for the publication as full-length articles. A total of 562 abstracts were presented (275 in 2013, 287 in 2014). There were 150 oral presentations (93 in 2013, 57 in 2014) and 412 poster presentations (182 in 2013, 230 in 2014). Fifty seven of them (10.1%) were published as full-text articles, among them 26 (17.3%) after oral presentations and 31 (7.5%) after poster presentations (P=0.001). University affiliation and original research work were most likely to be published. The average IFs of the journals which published the articles were 2.42 in 2013 and 1.87 in 2014. The publication rate for the annual RSGH meetings abstracts as full-text articles in peer-reviewed journals is very low compared to the analyses performed in gastroenterology or other medical specialities from other countries. It is not clear yet what are the factors responsible for the failure of publication.

Healthcare system intervention for prevention of birth injuries - process evaluation of self-assessment, peer review, feedback and agreement for change.

PubMed

Nyström, Monica E; Westerlund, Anna; Höög, Elisabet; Millde-Luthander, Charlotte; Högberg, Ulf; Grunewald, Charlotta

2012-08-24

Patient safety is fundamental in high quality healthcare systems but despite an excellent record of perinatal care in Sweden some children still suffer from substandard care and unnecessary birth injuries. Sustainable patient safety improvements assume changes in key actors' mental models, norms and culture as well as in the tools, design and organisation of work. Interventions positively affecting team mental models on safety issues are a first step to enhancing change. Our purpose was to study a national intervention programme for the prevention of birth injuries with the aim to elucidate how the main interventions of self-assessment, peer review, feedback and written agreement for change affected the teams and their mental model of patient safety, and thereby their readiness for change. Knowledge of relevant considerations before implementing this type of patient safety intervention series could thereby be increased. Eighty participants in twenty-seven maternity units were interviewed after the first intervention sequence of the programme. A content analysis using a priori coding was performed in order to relate results to the anticipated outcomes of three basic interventions: self-assessment, peer review and written feedback, and agreement for change. The self-assessment procedure was valuable and served as a useful tool for elucidating strengths and weaknesses and identifying areas for improvement for a safer delivery in maternity units. The peer-review intervention was appreciated, despite it being of less value when considering the contribution to explicit outcome effects (i.e. new input to team mental models and new suggestions for actions). The feedback report and the mutual agreement on measures for improvements reached when signing the contract seemed exert positive pressures for change. Our findings are in line with several studies stressing the importance of self-evaluation by encouraging a thorough review of objectives, practices and outcomes for the continuous improvement of an organisation. Even though effects of the peer review were limited, feedback from peers, or other change agents involved, and the support that a clear and well-structured action plan can provide are considered to be two important complements to future self-assessment procedures related to patient safety improvement.

13 CFR 306.7 - Performance evaluations of University Centers.

Code of Federal Regulations, 2010 CFR

2010-01-01

... 13 Business Credit and Assistance 1 2010-01-01 2010-01-01 false Performance evaluations of University Centers. 306.7 Section 306.7 Business Credit and Assistance ECONOMIC DEVELOPMENT ADMINISTRATION... following Investment Assistance cycle. (c) For peer review, EDA shall ensure the participation of at least...

Online Peer-to-Peer Support for Young People With Mental Health Problems: A Systematic Review.

PubMed

Ali, Kathina; Farrer, Louise; Gulliver, Amelia; Griffiths, Kathleen M

2015-01-01

Adolescence and early adulthood are critical periods for the development of mental disorders. Online peer-to-peer communication is popular among young people and may improve mental health by providing social support. Previous systematic reviews have targeted Internet support groups for adults with mental health problems, including depression. However, there have been no systematic reviews examining the effectiveness of online peer-to-peer support in improving the mental health of adolescents and young adults. The aim of this review was to systematically identify available evidence for the effectiveness of online peer-to peer support for young people with mental health problems. The PubMed, PsycInfo, and Cochrane databases were searched using keywords and Medical Subject Headings (MeSH) terms. Retrieved abstracts (n=3934) were double screened and coded. Studies were included if they (1) investigated an online peer-to-peer interaction, (2) the interaction discussed topics related to mental health, (3) the age range of the sample was between 12 to 25 years, and (4) the study evaluated the effectiveness of the peer-to-peer interaction. Six studies satisfied the inclusion criteria for the current review. The studies targeted a range of mental health problems including depression and anxiety (n=2), general psychological problems (n=1), eating disorders (n=1), and substance use (tobacco) (n=2). The majority of studies investigated Internet support groups (n=4), and the remaining studies focused on virtual reality chat sessions (n=2). In almost all studies (n=5), the peer support intervention was moderated by health professionals, researchers or consumers. Studies employed a range of study designs including randomized controlled trials (n=3), pre-post studies (n=2) and one randomized trial. Overall, two of the randomized controlled trials were associated with a significant positive outcome in comparison to the control group at post-intervention. In the remaining four studies, peer-to-peer support was not found to be effective. This systematic review identified an overall lack of high-quality studies examining online peer-to-peer support for young people. Given that peer support is frequently used as an adjunct to Internet interventions for a variety of mental health conditions, there is an urgent need to determine the effectiveness of peer support alone as an active intervention.

28 CFR 34.101 - Exceptions to applicability.

Code of Federal Regulations, 2010 CFR

2010-07-01

... Section 34.101 Judicial Administration DEPARTMENT OF JUSTICE OJJDP COMPETITION AND PEER REVIEW PROCEDURES Peer Review § 34.101 Exceptions to applicability. The assistance and procurement contract situations... outside the scope of the section 262(d) peer review requirement as set forth in this subpart. ...

Timely deposition of macromolecular structures is necessary for peer review

DOE Office of Scientific and Technical Information (OSTI.GOV)

Joosten, Robbie P.; Soueidan, Hayssam; Wessels, Lodewyk F. A.

2013-12-01

Deposition of crystallographic structures should be concurrent with or prior to manuscript submission for peer review, enabling validation and increasing reliability of the PDB. Most of the macromolecular structures in the Protein Data Bank (PDB), which are used daily by thousands of educators and scientists alike, are determined by X-ray crystallography. It was examined whether the crystallographic models and data were deposited to the PDB at the same time as the publications that describe them were submitted for peer review. This condition is necessary to ensure pre-publication validation and the quality of the PDB public archive. It was found thatmore » a significant proportion of PDB entries were submitted to the PDB after peer review of the corresponding publication started, and many were only submitted after peer review had ended. It is argued that clear description of journal policies and effective policing is important for pre-publication validation, which is key in ensuring the quality of the PDB and of peer-reviewed literature.« less

Peer Review and Surgical Innovation: Robotic Surgery and Its Hurdles.

PubMed

Vyas, Dinesh; Cronin, Sean

2015-12-01

The peer review processes as outlined in the Health Care Quality Improvement Act (HCQIA) is meant ensure quality standard of care through a self-policing mechanism by the medical community. This process grants immunity for people filing a peer review, which is meant to protect whistleblowers. However, it also creates a loophole that can be used maliciously to hinder competition. This is accentuated when surgeons are integrating new technologies, such as robotic surgery, into their practice. With more than 2000 da Vinci robots in use and more than 300 new units being shipped each year, robotic surgery has become a mainstay in the surgical field. The applications for robots continue to expand as surgeons discover their expanding capability. We need a better peer review process. That ensures the peer review is void of competitive bias. Peer reviewers need to be familiar with the procedure and the technology. The current process could stymie innovation in the name of competition.

Tardive Dyskinesia

MedlinePlus

... Supplements Peer Review Process Review Committees Application Support Library Clinical Research Next Steps Pre-Funding: After Review Terms of ... Supplements Peer Review Process Review Committees Application Support Library Clinical Research Next Steps Pre-Funding: After Review Terms of ...

Hemicrania Continua

MedlinePlus

... Supplements Peer Review Process Review Committees Application Support Library Clinical Research Next Steps Pre-Funding: After Review Terms of ... Supplements Peer Review Process Review Committees Application Support Library Clinical Research Next Steps Pre-Funding: After Review Terms of ...

Benign Essential Blepharospasm

MedlinePlus

... Supplements Peer Review Process Review Committees Application Support Library Clinical Research Next Steps Pre-Funding: After Review Terms of ... Supplements Peer Review Process Review Committees Application Support Library Clinical Research Next Steps Pre-Funding: After Review Terms of ...

Maintaining live discussion in two-stage open peer review.

PubMed

Sandewall, Erik

2012-01-01

Open peer review has been proposed for a number of reasons, in particular, for increasing the transparency of the article selection process for a journal, and for obtaining a broader basis for feedback to the authors and for the acceptance decision. The review discussion may also in itself have a value for the research community. These goals rely on the existence of a lively review discussion, but several experiments with open-process peer review in recent years have encountered the problem of faltering review discussions. The present article addresses the question of how lively review discussion may be fostered by relating the experience of the journal Electronic Transactions on Artificial Intelligence (ETAI) which was an early experiment with open peer review. Factors influencing the discussion activity are identified. It is observed that it is more difficult to obtain lively discussion when the number of contributed articles increases, which implies difficulties for scaling up the open peer review model. Suggestions are made for how this difficulty may be overcome.

Maintaining Live Discussion in Two-Stage Open Peer Review

PubMed Central

Sandewall, Erik

2011-01-01

Open peer review has been proposed for a number of reasons, in particular, for increasing the transparency of the article selection process for a journal, and for obtaining a broader basis for feedback to the authors and for the acceptance decision. The review discussion may also in itself have a value for the research community. These goals rely on the existence of a lively review discussion, but several experiments with open-process peer review in recent years have encountered the problem of faltering review discussions. The present article addresses the question of how lively review discussion may be fostered by relating the experience of the journal Electronic Transactions on Artificial Intelligence (ETAI) which was an early experiment with open peer review. Factors influencing the discussion activity are identified. It is observed that it is more difficult to obtain lively discussion when the number of contributed articles increases, which implies difficulties for scaling up the open peer review model. Suggestions are made for how this difficulty may be overcome. PMID:22363282

Learning Gains from a Recurring "Teach and Question" Homework Assignment in a General Biology Course: Using Reciprocal Peer Tutoring Outside Class.

PubMed

Bailey, E G; Baek, D; Meiling, J; Morris, C; Nelson, N; Rice, N S; Rose, S; Stockdale, P

2018-06-01

Providing students with one-on-one interaction with instructors is a big challenge in large courses. One solution is to have students interact with their peers during class. Reciprocal peer tutoring (RPT) is a more involved interaction that requires peers to alternate the roles of "teacher" and "student." Theoretically, advantages for peer tutoring include the verbalization and questioning of information and the scaffolded exploration of material through social and cognitive interaction. Studies on RPT vary in their execution, but most require elaborate planning and take up valuable class time. We tested the effectiveness of a "teach and question" (TQ) assignment that required student pairs to engage in RPT regularly outside class. A quasi-experimental design was implemented: one section of a general biology course completed TQ assignments, while another section completed a substitute assignment requiring individuals to review course material. The TQ section outperformed the other section by ∼6% on exams. Session recordings were coded to investigate correlation between TQ quality and student performance. Asking more questions was the characteristic that best predicted exam performance, and this was more predictive than most aspects of the course. We propose the TQ as an easy assignment to implement with large performance gains.

Doing a Good Deed or Confounding the Problem? Peer Review and Sociology Textbooks.

ERIC Educational Resources Information Center

Kendall, Diana

1999-01-01

Examines how the peer review process influences the writing and publication of sociology textbooks and the teaching of sociology. States that the peer review process may influence the final textbook in five ways: (1) degree of innovation; (2) length; (3) reading level; (4) cloning ancillaries and accessories; and (5) using reviewers as marketing…

Applying Peer Reviews in Software Engineering Education: An Experiment and Lessons Learned

ERIC Educational Resources Information Center

Garousi, V.

2010-01-01

Based on the demonstrated value of peer reviews in the engineering industry, numerous industry experts have listed it at the top of the list of desirable development practices. Experience has shown that problems (defects) are eliminated earlier if a development process incorporates peer reviews and that these reviews are as effective as or even…

Who benefits from peer review? An analysis of the outcome of 100 requests for review by Plastic and Reconstructive Surgery.

PubMed

Loonen, Martijn P J; Hage, J Joris; Kon, Moshe

2005-10-01

Little is known of what is done with the comments on submitted manuscripts provided by peer reviewers or to what extent these comments benefit the editor in deciding to accept or reject the manuscript, the author(s) in revising their manuscript, or the readership at large. Furthermore, nothing is known of any possible benefits of the process to the peer reviewer. Finally, the peer-review process may even be maleficent because of its implicit delay of publication and a possible bias against manuscripts originating from non-Anglo-American countries. The authors evaluated the benefits of the peer-review process to authors, editor, readers, and reviewers by a bibliometric analysis of the outcome of 100 requests for review made by the editor of Plastic and Reconstructive Surgery from 1992 through 2003. The publication delay and potential geographical bias were evaluated as potential disadvantages. The authors' reviewer advised acceptance of 56 percent of the manuscripts, and the editor mostly agreed with his advice. This suggests that the editor benefited from the review. The authors addressed 48 to 81 percent of the reviewer's constructive suggestions, and this suggests that they and the readers benefited also. Readers of Plastic and Reconstructive Surgery may further benefit because manuscripts rejected by Plastic and Reconstructive Surgery end up in less prestigious journals. The implicit delay of publication is limited, and the authors found no bias against non-Anglo-American submissions. The cost-effectiveness of the process for the peer reviewer remains unclear. The peer-review system of Plastic and Reconstructive Surgery, in general, is beneficial.

Peer review of health research funding proposals: A systematic map and systematic review of innovations for effectiveness and efficiency

PubMed Central

Frampton, Geoff K.; Pickett, Karen; Wyatt, Jeremy C.

2018-01-01

Objective To investigate methods and processes for timely, efficient and good quality peer review of research funding proposals in health. Methods A two-stage evidence synthesis: (1) a systematic map to describe the key characteristics of the evidence base, followed by (2) a systematic review of the studies stakeholders prioritised as relevant from the map on the effectiveness and efficiency of peer review ‘innovations’. Standard processes included literature searching, duplicate inclusion criteria screening, study keyword coding, data extraction, critical appraisal and study synthesis. Results A total of 83 studies from 15 countries were included in the systematic map. The evidence base is diverse, investigating many aspects of the systems for, and processes of, peer review. The systematic review included eight studies from Australia, Canada, and the USA, evaluating a broad range of peer review innovations. These studies showed that simplifying the process by shortening proposal forms, using smaller reviewer panels, or expediting processes can speed up the review process and reduce costs, but this might come at the expense of peer review quality, a key aspect that has not been assessed. Virtual peer review using videoconferencing or teleconferencing appears promising for reducing costs by avoiding the need for reviewers to travel, but again any consequences for quality have not been adequately assessed. Conclusions There is increasing international research activity into the peer review of health research funding. The studies reviewed had methodological limitations and variable generalisability to research funders. Given these limitations it is not currently possible to recommend immediate implementation of these innovations. However, many appear promising based on existing evidence, and could be adapted as necessary by funders and evaluated. Where feasible, experimental evaluation, including randomised controlled trials, should be conducted, evaluating impact on effectiveness, efficiency and quality. PMID:29750807

Organised Governmental Learning: Vocational Education and Training Practices between Peer Review and Peer Learning

ERIC Educational Resources Information Center

Speer, Sandra

2011-01-01

Peer learning has already existed for a long time, as an informal as well as a formal practice between people from the same professional area. However, peer learning systems on the macro level are relatively newer concepts. Policy learning can be fostered by various types of organised activities, ranging from peer review frameworks, which often…

Peering into peer-review at GigaScience.

PubMed

Edmunds, Scott C

2013-01-24

Fostering and promoting more open and transparent science is one of the goals of GigaScience. One of the ways we have been doing this is by throwing light on the peer-review process and carrying out open peer-review as standard. In this editorial, we provide our rationale for undertaking this policy, give examples of our positive experiences to date, and encourage others to open up the normally opaque publication process.

Two decades of external peer review of cancer care in general hospitals; the Dutch experience.

PubMed

Kilsdonk, Melvin J; Siesling, Sabine; Otter, Rene; van Harten, Wim H

2016-03-01

External peer review was introduced in general hospitals in the Netherlands in 1994 to assess and improve the multidisciplinary team approach in cancer care. This paper aims to explore the value, perceived impact, and (future) role of external peer review in cancer care. Semistructured interviews were held with clinicians, oncology nurses, and managers from fifteen general hospitals that participated in three rounds of peer review over a period of 16 years. Interviewees reflected on the goals and expectations, experiences, perceived impact, and future role of external peer review. Transcriptions of the interviews were coded to discover recurrent themes. Improving clinical care and organization were the main motives for participation. Positive impact was perceived on multiple aspects of care such as shared responsibilities, internal prioritization of cancer care, improved communication, and a clear structure and position of cancer care within general hospitals. Establishing a direct relationship between the external peer review and organizational or clinical impact proved to be difficult. Criticism was raised on the content of the program being too theoretical and organization-focussed after three rounds. According to most stakeholders, external peer review can improve multidisciplinary team work in cancer care; however, the acceptance is threatened by a perceived disbalance between effort and visible clinical impact. Leaner and more clinically focused programs are needed to keep repeated peer reviews challenging and worthwhile. © 2015 The Authors. Cancer Medicine published by John Wiley & Sons Ltd.

Information Quality in Regulatory Decision Making: Peer Review versus Good Laboratory Practice.

PubMed

McCarty, Lynn S; Borgert, Christopher J; Mihaich, Ellen M

2012-07-01

There is an ongoing discussion on the provenance of toxicity testing data regarding how best to ensure its validity and credibility. A central argument is whether journal peer-review procedures are superior to Good Laboratory Practice (GLP) standards employed for compliance with regulatory mandates. We sought to evaluate the rationale for regulatory decision making based on peer-review procedures versus GLP standards. We examined pertinent published literature regarding how scientific data quality and validity are evaluated for peer review, GLP compliance, and development of regulations. Some contend that peer review is a coherent, consistent evaluative procedure providing quality control for experimental data generation, analysis, and reporting sufficient to reliably establish relative merit, whereas GLP is seen as merely a tracking process designed to thwart investigator corruption. This view is not supported by published analyses pointing to subjectivity and variability in peer-review processes. Although GLP is not designed to establish relative merit, it is an internationally accepted quality assurance, quality control method for documenting experimental conduct and data. Neither process is completely sufficient for establishing relative scientific soundness. However, changes occurring both in peer-review processes and in regulatory guidance resulting in clearer, more transparent communication of scientific information point to an emerging convergence in ensuring information quality. The solution to determining relative merit lies in developing a well-documented, generally accepted weight-of-evidence scheme to evaluate both peer-reviewed and GLP information used in regulatory decision making where both merit and specific relevance inform the process.

Appendix G: Peer review nondisclosure agreement

DOE Office of Scientific and Technical Information (OSTI.GOV)

None, None

This peer review nondisclosure agreement should be signed by each reviewer prior to the program sending review materials if sensitive or proprietary information will be provided reviewers or discussed during the review, and to everyone attending a review.

A Review of Peer Social Development in Early Childhood.

ERIC Educational Resources Information Center

Goin, Robin P.

1998-01-01

Reviews the literature on young children's peer social development. Addresses implications of social learning theory and empirical research. Discusses recurring themes, including child/peer versus child/adult interactions, incorporation of toys and games, influence of mothers, and gender peer preferences. Considers areas lacking empirical support…

Commercial Lighting Solutions, Webtool Peer Review Report

DOE Office of Scientific and Technical Information (OSTI.GOV)

Jones, Carol C.; Meyer, Tracy A.

2009-06-17

The Commercial Lighting Solutions (CLS) project directly supports the U.S. Department of Energy’s Commercial Building Energy Alliance efforts to design high performance buildings. CLS creates energy efficient best practice lighting designs for widespread use, and they are made available to users via an interactive webtool that both educates and guides the end user through the application of the Lighting Solutions. This report summarizes the peer review of the beta version of the CLS webtool, which contains retail box lighting solutions. The methodology for the peer review process included data collection (stakeholder input), analysis of the comments, and organization of themore » input into categories for prioritization of the comments against a set of criteria. Based on this process, recommendations were developed about which feedback should be addressed for the release of version 1.0 of the webtool at the Lightfair conference in New York City in May 2009. Due to the volume of data (~500 comments) the methodology for addressing the peer review comments was central to the success of the ultimate goal of improving the tool. The comments were first imported into a master spreadsheet, and then grouped and organized in several layers. Solutions to each comment were then rated by importance and feasibility to determine the practicality of resolving the concerns of the commenter in the short-term or long-term. The rating system was used as an analytical tool, but the results were viewed thoughtfully to ensure that they were not the sole the factor in determining which comments were recommended for near-term resolution. The report provides a list of the top ten most significant and relevant improvements that will be made within the webtool for version 1.0 as well as appendices containing the short-term priorities in additional detail. Peer review comments that are considered high priority by the reviewers and the CLS team but cannot be completed for Version 1.0 are listed as long-term recommendations.« less

Do peers matter? A review of peer and/or friends' influence on physical activity among American adolescents.

PubMed

Fitzgerald, Amanda; Fitzgerald, Noelle; Aherne, Cian

2012-08-01

This systematic review investigated the relationship between peer and/or friend variables and physical activity among adolescents by synthesising cross-sectional, longitudinal, and experimental research conducted in the US. Seven electronic databases were searched to identify related articles published within the last 10 years and the articles reviewed included adolescents between 10 and 18 years. Studies reporting a measure of physical activity for adolescents and at least one potential peer and/or friend variable were included. Research demonstrated that peers and friends have an important role to play in the physical activity behavior of adolescents. Six processes were identified through which peers and/or friends may have an influence on physical activity including: peer and/or friend support, presence of peers and friends, peer norms, friendship quality and acceptance, peer crowds, and peer victimization. The theoretical significance of these results is assessed and the development of peer-related physical activity programs for adolescents is discussed. Copyright © 2012 The Foundation for Professionals in Services for Adolescents. Published by Elsevier Ltd. All rights reserved.

[Improving patient safety through voluntary peer review].

PubMed

Kluge, S; Bause, H

2015-01-01

The intensive care unit (ICU) is one area of the hospital in which processes and communication are of primary importance. Errors in intensive care units can lead to serious adverse events with significant consequences for patients. Therefore quality and risk-management are important measures when treating critically ill patients. A pragmatic approach to support quality and safety in intensive care is peer review. This approach has gained significant acceptance over the past years. It consists of mutual visits by colleagues who conduct standardised peer reviews. These reviews focus on the systematic evaluation of the quality of an ICU's structure, its processes and outcome. Together with different associations, the State Chambers of Physicians and the German Medical Association have developed peer review as a standardized tool for quality improvement. The common goal of all stakeholders is the continuous and sustainable improvement in intensive care with peer reviews significantly increasing and improving communication between professions and disciplines. Peer reviews secure the sustainability of planned change processes and consequently lead the way to an improved culture of quality and safety.

7 CFR 3411.10 - Establishment and operation of peer review groups.

Code of Federal Regulations, 2010 CFR

2010-01-01

...) COOPERATIVE STATE RESEARCH, EDUCATION, AND EXTENSION SERVICE, DEPARTMENT OF AGRICULTURE NATIONAL RESEARCH INITIATIVE COMPETITIVE GRANTS PROGRAM Scientific Peer Review of Research Grant Applications § 3411.10 Establishment and operation of peer review groups. Subject to § 3411.5, the Administrator shall adopt procedures...

7 CFR 3400.10 - Establishment and operation of peer review groups.

Code of Federal Regulations, 2010 CFR

2010-01-01

...) COOPERATIVE STATE RESEARCH, EDUCATION, AND EXTENSION SERVICE, DEPARTMENT OF AGRICULTURE SPECIAL RESEARCH GRANTS PROGRAM Scientific Peer Review of Research Grant Applications § 3400.10 Establishment and operation of peer review groups. Subject to § 3400.5, the Administrator will adopt procedures for the...

42 CFR 52h.5 - Conflict of interest.

Code of Federal Regulations, 2014 CFR

2014-10-01

... Health PUBLIC HEALTH SERVICE, DEPARTMENT OF HEALTH AND HUMAN SERVICES GRANTS SCIENTIFIC PEER REVIEW OF...) This section applies only to conflicts of interest involving members of peer review groups. This... Executive Order 11222, as amended. For those federal employees serving on peer review groups, in accordance...

42 CFR 52h.5 - Conflict of interest.

Code of Federal Regulations, 2013 CFR

2013-10-01

... Health PUBLIC HEALTH SERVICE, DEPARTMENT OF HEALTH AND HUMAN SERVICES GRANTS SCIENTIFIC PEER REVIEW OF...) This section applies only to conflicts of interest involving members of peer review groups. This... Executive Order 11222, as amended. For those federal employees serving on peer review groups, in accordance...

42 CFR 52h.5 - Conflict of interest.

Code of Federal Regulations, 2012 CFR

2012-10-01

... Health PUBLIC HEALTH SERVICE, DEPARTMENT OF HEALTH AND HUMAN SERVICES GRANTS SCIENTIFIC PEER REVIEW OF...) This section applies only to conflicts of interest involving members of peer review groups. This... Executive Order 11222, as amended. For those federal employees serving on peer review groups, in accordance...

Can editors save peer review from peer reviewers?

PubMed

D'Andrea, Rafael; O'Dwyer, James P

2017-01-01

Peer review is the gold standard for scientific communication, but its ability to guarantee the quality of published research remains difficult to verify. Recent modeling studies suggest that peer review is sensitive to reviewer misbehavior, and it has been claimed that referees who sabotage work they perceive as competition may severely undermine the quality of publications. Here we examine which aspects of suboptimal reviewing practices most strongly impact quality, and test different mitigating strategies that editors may employ to counter them. We find that the biggest hazard to the quality of published literature is not selfish rejection of high-quality manuscripts but indifferent acceptance of low-quality ones. Bypassing or blacklisting bad reviewers and consulting additional reviewers to settle disagreements can reduce but not eliminate the impact. The other editorial strategies we tested do not significantly improve quality, but pairing manuscripts to reviewers unlikely to selfishly reject them and allowing revision of rejected manuscripts minimize rejection of above-average manuscripts. In its current form, peer review offers few incentives for impartial reviewing efforts. Editors can help, but structural changes are more likely to have a stronger impact.

National Ignition Facility, High-Energy-Density and Inertial Confinement Fusion, Peer-Review Panel (PRP) Final Report

DOE Office of Scientific and Technical Information (OSTI.GOV)

Keane, C. J.

2014-01-28

The National Ignition Facility (NIF) at Lawrence Livermore National Laboratory (LLNL) is operated as a National Nuclear Security Administration (NNSA) user facility in accordance with Department of Energy (DOE) best practices, including peer-reviewed experiments, regular external reviews of performance, and the use of a management structure that facilitates user and stakeholder feedback. NIF facility time is managed using processes similar to those in other DOE science facilities and is tailored to meet the mix of missions and customers that NIF supports. The NIF Governance Plan describes the process for allocating facility time on NIF and for creating the shot schedule.more » It also includes the flow of responsibility from entity to entity. The plan works to ensure that NIF meets its mission goals using the principles of scientific peer review, including transparency and cooperation among the sponsor, the NIF staff, and the various user communities. The NIF Governance Plan, dated September 28, 2012, was accepted and signed by LLNL Director Parney Albright, NIF Director Ed Moses, and Don Cook and Thomas D’Agostino of NNSA. Figure 1 shows the organizational structure for NIF Governance.« less

o'Peer: open peer review

NASA Astrophysics Data System (ADS)

Brewer, J. H.

2014-12-01

I have built a "demonstration" website at http://oPeer.org to illustrate how peer review and publication might be improved relative to the current model, which was designed and implemented in an era when scientific communication was either face-to-face or relied upon human delivery of ink marks on dead trees.

Voluntary peer review as innovative tool for quality improvement in the intensive care unit – a retrospective descriptive cohort study in German intensive care units

PubMed Central

Kumpf, Oliver; Bloos, Frank; Bause, Hanswerner; Brinkmann, Alexander; Deja, Maria; Marx, Gernot; Kaltwasser, Arnold; Dubb, Rolf; Muhl, Elke; Greim, Clemens-A.; Weiler, Norbert; Chop, Ines; Jonitz, Günther; Schaefer, Henning; Felsenstein, Matthias; Liebeskind, Ursula; Leffmann, Carsten; Jungbluth, Annemarie; Waydhas, Christian; Pronovost, Peter; Spies, Claudia; Braun, Jan-Peter

2014-01-01

Introduction: Quality improvement and safety in intensive care are rapidly evolving topics. However, there is no gold standard for assessing quality improvement in intensive care medicine yet. In 2007 a pilot project in German intensive care units (ICUs) started using voluntary peer reviews as an innovative tool for quality assessment and improvement. We describe the method of voluntary peer review and assessed its feasibility by evaluating anonymized peer review reports and analysed the thematic clusters highlighted in these reports. Methods: Retrospective data analysis from 22 anonymous reports of peer reviews. All ICUs – representing over 300 patient beds – had undergone voluntary peer review. Data were retrieved from reports of peers of the review teams and representatives of visited ICUs. Data were analysed with regard to number of topics addressed and results of assessment questionnaires. Reports of strengths, weaknesses, opportunities and threats (SWOT reports) of these ICUs are presented. Results: External assessment of structure, process and outcome indicators revealed high percentages of adherence to predefined quality goals. In the SWOT reports 11 main thematic clusters were identified representative for common ICUs. 58.1% of mentioned topics covered personnel issues, team and communication issues as well as organisation and treatment standards. The most mentioned weaknesses were observed in the issues documentation/reporting, hygiene and ethics. We identified several unique patterns regarding quality in the ICU of which long-term personnel problems und lack of good reporting methods were most interesting Conclusion: Voluntary peer review could be established as a feasible and valuable tool for quality improvement. Peer reports addressed common areas of interest in intensive care medicine in more detail compared to other methods like measurement of quality indicators. PMID:25587245

Voluntary peer review as innovative tool for quality improvement in the intensive care unit--a retrospective descriptive cohort study in German intensive care units.

PubMed

Kumpf, Oliver; Bloos, Frank; Bause, Hanswerner; Brinkmann, Alexander; Deja, Maria; Marx, Gernot; Kaltwasser, Arnold; Dubb, Rolf; Muhl, Elke; Greim, Clemens-A; Weiler, Norbert; Chop, Ines; Jonitz, Günther; Schaefer, Henning; Felsenstein, Matthias; Liebeskind, Ursula; Leffmann, Carsten; Jungbluth, Annemarie; Waydhas, Christian; Pronovost, Peter; Spies, Claudia; Braun, Jan-Peter

2014-01-01

Quality improvement and safety in intensive care are rapidly evolving topics. However, there is no gold standard for assessing quality improvement in intensive care medicine yet. In 2007 a pilot project in German intensive care units (ICUs) started using voluntary peer reviews as an innovative tool for quality assessment and improvement. We describe the method of voluntary peer review and assessed its feasibility by evaluating anonymized peer review reports and analysed the thematic clusters highlighted in these reports. Retrospective data analysis from 22 anonymous reports of peer reviews. All ICUs - representing over 300 patient beds - had undergone voluntary peer review. Data were retrieved from reports of peers of the review teams and representatives of visited ICUs. Data were analysed with regard to number of topics addressed and results of assessment questionnaires. Reports of strengths, weaknesses, opportunities and threats (SWOT reports) of these ICUs are presented. External assessment of structure, process and outcome indicators revealed high percentages of adherence to predefined quality goals. In the SWOT reports 11 main thematic clusters were identified representative for common ICUs. 58.1% of mentioned topics covered personnel issues, team and communication issues as well as organisation and treatment standards. The most mentioned weaknesses were observed in the issues documentation/reporting, hygiene and ethics. We identified several unique patterns regarding quality in the ICU of which long-term personnel problems und lack of good reporting methods were most interesting Conclusion: Voluntary peer review could be established as a feasible and valuable tool for quality improvement. Peer reports addressed common areas of interest in intensive care medicine in more detail compared to other methods like measurement of quality indicators.

Three decades of disasters: a review of disaster-specific literature from 1977-2009.

PubMed

Smith, Erin; Wasiak, Jason; Sen, Ayan; Archer, Frank; Burkle, Frederick M

2009-01-01

The potential for disasters exists in all communities. To mitigate the potential catastrophes that confront humanity in the new millennium, an evidence-based approach to disaster management is required urgently. This study moves toward such an evidence-based approach by identifying peer-reviewed publications following a range of disasters and events over the past three decades. Peer-reviewed, event-specific literature was identified using a comprehensive search of the electronically indexed database, MEDLINE (1956-January 2009). An extended comprehensive search was conducted for one event to compare the event-specific literature indexed in MEDLINE to other electronic databases (EMBASE, CINAHL, AMED, CENTRAL, Psych Info, Maternity and Infant Care, EBM Reviews). Following 25 individual disasters or overwhelming crises, a total of 2,098 peer-reviewed, event-specific publications were published in 789 journals (652 publications following disasters/events caused by natural hazards, 966 following human-made/technological disasters/events, and 480 following conflict/complex humanitarian events).The event with the greatest number of peer-reviewed, event-specific publications was the 11 September 2001 terrorist attacks (686 publications). Prehospital and Disaster Medicine published the greatest number of peer-reviewed, event-specific publications (54), followed by Journal of Traumatic Stress (42), Military Medicine (40), and Psychiatric Services (40). The primary topics of event-specific publications were mental health, medical health, and response. When an extended, comprehensive search was conducted for one event, 75% of all peer-reviewed, event-specific publications were indexed in MEDLINE. A broad range of multi-disciplinary journals publish peer reviewed, event-specific publications. While the majority of peer-reviewed, event-specific literature is indexed in MEDLINE, comprehensive search strategies should include EMBASE to increase yield.

A Synthesis of the Research on Alternative Assessment Methods in Teacher Education.

ERIC Educational Resources Information Center

Glowacki, Margaret L.; Steele, D. Joyce

This synthesis of research on alternative assessment methods in teacher education reviews literature on performance assessment, describing the various types of assessment discussed by M. Priestley (1982), including: (1) actual performance assessments (work-sample tests, identification tests, supervisor ratings, peer ratings, and self-assessments);…

Reflections of a CHAMPUS-APA peer reviewer.

PubMed

Parlour, R R

1986-02-01

Peer review is a major professional response to the problems of health insurance coverage for psychiatric services. Standard insurance programs reimburse only services that are conventional and cost-effective. The system assumes that services are skillfully documented by providers. Experience as a peer reviewer helps clinicians acquire skill in documentation.

Marketing Academics' Perceptions of the Peer Review Process

ERIC Educational Resources Information Center

Bailey, Charles D.; Hair, Joe F.; Hermanson, Dana R.; Crittenden, Victoria L.

2012-01-01

Publication in refereed journals is critical to career success for most marketing faculty members, and the peer review process is the gatekeeper for a refereed journal. The study reported here examines marketing academics' perceptions of this peer review process. Based on responses from 653 marketing academics, we find favorable overall…

The Neuroscience Peer Review Consortium

PubMed Central

Saper, Clifford B; Maunsell, John HR

2009-01-01

As the Neuroscience Peer Review Consortium (NPRC) ends its first year, it is worth looking back to see how the experiment has worked. In order to encourage dissemination of the details outlined in this Editorial, it will also be published in other journals in the Neuroscience Peer Review Consortium. PMID:19284614

42 CFR 24.5 - Peer review.

Code of Federal Regulations, 2014 CFR

2014-10-01

... 42 Public Health 1 2014-10-01 2014-10-01 false Peer review. 24.5 Section 24.5 Public Health PUBLIC HEALTH SERVICE, DEPARTMENT OF HEALTH AND HUMAN SERVICES PERSONNEL SENIOR BIOMEDICAL RESEARCH SERVICE § 24.5 Peer review. An individual may not be considered for appointment into the SBRS unless his/her...

42 CFR 24.5 - Peer review.

Code of Federal Regulations, 2012 CFR

2012-10-01

... 42 Public Health 1 2012-10-01 2012-10-01 false Peer review. 24.5 Section 24.5 Public Health PUBLIC HEALTH SERVICE, DEPARTMENT OF HEALTH AND HUMAN SERVICES PERSONNEL SENIOR BIOMEDICAL RESEARCH SERVICE § 24.5 Peer review. An individual may not be considered for appointment into the SBRS unless his/her...

42 CFR 24.5 - Peer review.

Code of Federal Regulations, 2013 CFR

2013-10-01

... 42 Public Health 1 2013-10-01 2013-10-01 false Peer review. 24.5 Section 24.5 Public Health PUBLIC HEALTH SERVICE, DEPARTMENT OF HEALTH AND HUMAN SERVICES PERSONNEL SENIOR BIOMEDICAL RESEARCH SERVICE § 24.5 Peer review. An individual may not be considered for appointment into the SBRS unless his/her...

42 CFR 24.5 - Peer review.

Code of Federal Regulations, 2011 CFR

2011-10-01

... 42 Public Health 1 2011-10-01 2011-10-01 false Peer review. 24.5 Section 24.5 Public Health PUBLIC HEALTH SERVICE, DEPARTMENT OF HEALTH AND HUMAN SERVICES PERSONNEL SENIOR BIOMEDICAL RESEARCH SERVICE § 24.5 Peer review. An individual may not be considered for appointment into the SBRS unless his/her...

78 FR 63795 - Endangered and Threatened Wildlife and Plants; Determination of Endangered Status for Chromolaena...

Federal Register 2010, 2011, 2012, 2013, 2014

2013-10-24

... responses. The peer reviewers generally concurred with our methods and conclusions, and they provided... corallicola, and Harrisia aboriginum. The peer reviewers generally concurred with our methods and conclusions... discussion, below. (6) Comment: One peer reviewer provided research findings on the seed longevity and...

Peer Review Undergoing Revitalization

ERIC Educational Resources Information Center

Sawchuk, Stephen

2009-01-01

Established in the 142,000-student Montgomery County, Maryland, district in 1999, peer assistance and review (PAR)--or "peer review," as it is occasionally called--is actually an old idea. In 1981, the then-president of the Toledo Federation of Teachers, Dal Lawrence, helped create the first PAR program. Almost 30 years later, only a…

Peer-review: An IOP Publishing Perspective

NASA Astrophysics Data System (ADS)

Smith, Timothy

2015-03-01

Online publishing is challenging, and potentially changing, the role of publishers in both managing the peer-review process and disseminating the work that they publish in meeting contrasting needs from diverse groups of research communities. Recognizing the value of peer-review as a fundamental service to authors and the research community, the underlying principles of managing the process for journals published by IOP Publishing remain unchanged and yet the potential and demand for alternative models exists. This talk will discuss the traditional approach to peer-review placed in the context of this changing demand.

The objective impact of clinical peer review on hospital quality and safety.

PubMed

Edwards, Marc T

2011-01-01

Despite its importance, the objective impact of clinical peer review on the quality and safety of care has not been studied. Data from 296 acute care hospitals show that peer review program and related organizational factors can explain up to 18% of the variation in standardized measures of quality and patient safety. The majority of programs rely on an outmoded and dysfunctional process model. Adoption of best practices informed by the continuing study of peer review program effectiveness has the potential to significantly improve patient outcomes.

Identifying and Remediating Student Misconceptions in Introductory Biology via Writing-to-Learn Assignments and Peer Review.

PubMed

Halim, Audrey S; Finkenstaedt-Quinn, Solaire A; Olsen, Laura J; Gere, Anne Ruggles; Shultz, Ginger V

2018-06-01

Student misconceptions are an obstacle in science, technology, engineering, and mathematics courses and unless remediated may continue causing difficulties in learning as students advance in their studies. Writing-to-learn assignments (WTL) are characterized by their ability to promote in-depth conceptual learning by allowing students to explore their understanding of a topic. This study sought to determine whether and what types of misconceptions are elicited by WTL assignments and how the process of peer review and revision leads to remediation or propagation of misconceptions. We examined four WTL assignments in an introductory biology course in which students first wrote about content by applying it to a realistic scenario, then participated in a peer-review process before revising their work. Misconceptions were identified in all four assignments, with the greatest number pertaining to protein structure and function. Additionally, in certain contexts, students used scientific terminology incorrectly. Analysis of the drafts and peer-review comments generated six profiles by which misconceptions were addressed through the peer-review process. The prevalent mode of remediation arose through directed peer-review comments followed by correction during revision. It was also observed that additional misconceptions were elicited as students revised their writing in response to general peer-review suggestions.

Peering into peer-review at GigaScience

PubMed Central

2013-01-01

Fostering and promoting more open and transparent science is one of the goals of GigaScience. One of the ways we have been doing this is by throwing light on the peer-review process and carrying out open peer-review as standard. In this editorial, we provide our rationale for undertaking this policy, give examples of our positive experiences to date, and encourage others to open up the normally opaque publication process. PMID:23587291

Peer-review for selection of oral presentations for conferences: Are we reliable?

PubMed

Deveugele, Myriam; Silverman, Jonathan

2017-11-01

Although peer-review for journal submission, grant-applications and conference submissions has been called 'a counter- stone of science', and even 'the gold standard for evaluating scientific merit', publications on this topic remain scares. Research that has investigated peer-review reveals several issues and criticisms concerning bias, poor quality review, unreliability and inefficiency. The most important weakness of the peer review process is the inconsistency between reviewers leading to inadequate inter-rater reliability. To report the reliability of ratings for a large international conference and to suggest possible solutions to overcome the problem. In 2016 during the International Conference on Communication in Healthcare, organized by EACH: International Association for Communication in Healthcare, a calibration exercise was proposed and feedback was reported back to the participants of the exercise. Most abstracts, as well as most peer-reviewers, receive and give scores around the median. Contrary to the general assumption that there are high and low scorers, in this group only 3 peer-reviewers could be identified with a high mean, while 7 has a low mean score. Only 2 reviewers gave only high ratings (4 and 5). Of the eight abstracts included in this exercise, only one abstract received a high mean score and one a low mean score. Nevertheless, both these abstracts received both low and high scores; all other abstracts received all possible scores. Peer-review of submissions for conferences are, in accordance with the literature, unreliable. New and creative methods will be needed to give the participants of a conference what they really deserve: a more reliable selection of the best abstracts. More raters per abstract improves the inter-rater reliability; training of reviewers could be helpful; providing feedback to reviewers can lead to less inter-rater disagreement; fostering negative peer-review (rejecting the inappropriate submissions) rather than a positive (accepting the best) could be fruitful for selecting abstracts for conferences. Copyright © 2017 Elsevier B.V. All rights reserved.

Data bank has operational impact. Proper peer review can protect hospitals from antitrust and defamation suits.

PubMed

Purtell, D L

1990-11-01

The Health Care Quality Improvement Act of 1986 can help protect medical professionals and healthcare facilities from antitrust and defamation claims and other forms of litigation arising from the peer review process. Some hospitals may need to make major changes in their peer review activity as a result of the act. The healthcare entity, not the physicians involved in peer review, has the burden of complying with the provisions of the act. Failure to comply with the act can lead to loss of immunity from damages, fines, and potential exclusion from the Medicare program. The potential for liability has sparked a need for hospitals to reexamine and possibly reorganize medical staff and update procedures and related governing documents. Healthcare entities may consider changes such as implementing a director of medical affairs function, choosing medical staff for multiple-year terms, and centralizing physician review files. In the 1980s many hospitals created quality assurance and risk management programs. Risk managers need to share data with quality assurance personnel, who must in turn share the information with medical staff involved with credentialing, peer review, and medical affairs management. Legal counsel will need to be familiar with the legalities of the act, as well as the hospital's peer review procedures and operations. General legal counsel should oversee coordination of hospital proceedings and assist in educating staff on the legalities of peer review.

The Validity of Online Patient Ratings of Physicians: Analysis of Physician Peer Reviews and Patient Ratings.

PubMed

McGrath, Robert J; Priestley, Jennifer Lewis; Zhou, Yiyun; Culligan, Patrick J

2018-04-09

Information from ratings sites are increasingly informing patient decisions related to health care and the selection of physicians. The current study sought to determine the validity of online patient ratings of physicians through comparison with physician peer review. We extracted 223,715 reviews of 41,104 physicians from 10 of the largest cities in the United States, including 1142 physicians listed as "America's Top Doctors" through physician peer review. Differences in mean online patient ratings were tested for physicians who were listed and those who were not. Overall, no differences were found between the online patient ratings based upon physician peer review status. However, statistical differences were found for four specialties (family medicine, allergists, internal medicine, and pediatrics), with online patient ratings significantly higher for those physicians listed as a peer-reviewed "Top Doctor" versus those who were not. The results of this large-scale study indicate that while online patient ratings are consistent with physician peer review for four nonsurgical, primarily in-office specializations, patient ratings were not consistent with physician peer review for specializations like anesthesiology. This result indicates that the validity of patient ratings varies by medical specialization. ©Robert J McGrath, Jennifer Lewis Priestley, Yiyun Zhou, Patrick J Culligan. Originally published in the Interactive Journal of Medical Research (http://www.i-jmr.org/), 09.04.2018.

Peer tutoring program for academic success of returning nursing students.

PubMed

Bryer, Jennifer

2012-01-01

High attrition rates among students in associate degree nursing programs are a concern for faculty, administrators, and students. Programs offering academic and emotional support for students at risk for failing a clinical course may decrease attrition rates and improve academic performance. A peer tutoring program was developed for returning nursing students who were unsuccessful in a previous clinical course. Peer tutors met with returning students weekly to review course work, complete case studies and practice NCLEX questions. Trusting, supportive relationships developed among students and a significant increase in grades was noted at the end of the course for 79% of students. Implementation of peer tutoring was beneficial for returning students, tutors, and the nursing program and may be valuable in other courses where academic achievement is a concern.

Peer review and psychiatric physician fitness for duty evaluations: analyzing the past and forecasting the future.

PubMed

Meyer, Donald J; Price, Marilyn

2012-01-01

In the United States, oversight of health care practitioners is delegated to a matrix of health care entities including but not limited to the state medical board which licenses physicians in the relevant jurisdiction. Typically, these organizations have their own codes of professional conduct. When a physician joins one of these health care organizations, legally the physician has entered into a contract with the organization and agreed to be bound by its regulations and procedures. The organization's peer review of a member physician for reasons of investigating questions of health care quality may require a psychiatric fitness for duty evaluation. That assessment is a forensic psychiatric examination to assist the peer review body much as an expert witness would assist the trier of fact in a criminal or civil law adjudication. Experts can better perform these functions if they are familiar with the legal differences that define these agencies' service under administrative as compared to civil or criminal law and procedures. Copyright © 2012 Elsevier Ltd. All rights reserved.

Variability of Reviewers' Comments in the Peer Review Process for Orthopaedic Research.

PubMed

Iantorno, Stephanie E; Andras, Lindsay M; Skaggs, David L

2016-07-01

Retrospective analysis of peer review comments. To assess the likelihood that comments provided by peer reviewers of one orthopaedic journal would be similar to comments of reviewers from the same journal and a second journal. The consistency of the peer review process in orthopedic research has not been objectively examined. Nine separate clinical papers related to spinal deformity were submitted for publication in major peer-reviewed journals and initially rejected. The exact same manuscripts were then submitted to different journals. All papers were returned with comments from two to three reviewers from each journal. Reviews were divided into distinct conceptual criticisms that were regarded as separate comments. Comments were compared between reviewers of the same journal and to comments from reviewers of the second journal. When comparing comments from reviewers of the same journal, an average of 11% of comments were repeated (range 0% [0/12] to 23% [3/13]). On average, 20% of comments from the first journal were repeated by a reviewer at the second journal (range 10% [1/10] to 33% [6/18]). If a comment was made by two or more reviewers from the first journal, it had a higher likelihood (43% [6/14]) of being repeated by a reviewer from the second journal. When an identical manuscript is submitted to a second journal after being rejected, 80% of peer review comments from the first journal are not repeated by reviewers from the second journal. One may question if addressing every peer review comment in a rejected manuscript prior to resubmission is an efficient use of resources. Comments that appear twice or more in the first journal review are more likely to reappear and may warrant special attention from the researcher. Level IV. Copyright © 2016 Scoliosis Research Society. Published by Elsevier Inc. All rights reserved.

Alternatives to Peer Review: Novel Approaches for Research Evaluation

PubMed Central

Birukou, Aliaksandr; Wakeling, Joseph Rushton; Bartolini, Claudio; Casati, Fabio; Marchese, Maurizio; Mirylenka, Katsiaryna; Osman, Nardine; Ragone, Azzurra; Sierra, Carles; Wassef, Aalam

2011-01-01

In this paper we review several novel approaches for research evaluation. We start with a brief overview of the peer review, its controversies, and metrics for assessing efficiency and overall quality of the peer review. We then discuss five approaches, including reputation-based ones, that come out of the research carried out by the LiquidPub project and research groups collaborated with LiquidPub. Those approaches are alternative or complementary to traditional peer review. We discuss pros and cons of the proposed approaches and conclude with a vision for the future of the research evaluation, arguing that no single system can suit all stakeholders in various communities. PMID:22174702

IRIS Toxicological Review of Libby Amphibole Asbestos ...

EPA Pesticide Factsheets

On August 25, 2011, the draft Toxicological Review of Libby Amphibole Asbestos and the charge to external peer reviewers were released for external peer review and public comment. The Toxicological Review and charge were reviewed internally by EPA and by other federal agencies and White House Offices before public release. In the new IRIS process (May 2009), introduced by the EPA Administrator, all written comments on IRIS assessments submitted by other federal agencies and White House Offices will be made publicly available. Accordingly, interagency comments and the interagency science consultation draft of the IRIS Toxicological Review of Libby Amphibole Asbestos and the charge to external peer reviewers are posted on this site. The project supports OSWER and Region 8 site clean-up and related risk management initiatives at this Superfund site. As with all IRIS assessments, the draft document will undergo agency review, OMB/interagency review and independent external peer review before being included on the IRIS data base.

Successful peer review of courses: a case study.

PubMed

Horowitz, S; Van Eyck, S; Albanese, M

1998-03-01

The authors describe their school's system of peer review for courses, established in 1988 to facilitate faculty evaluation and continual course and curriculum improvement. (The system has been temporarily suspended while the school's new curriculum becomes established.) They explain how the system was created and then report how faculty reviews of courses over the five-year operation of the system compared with students' reviews of the same courses. The faculty and students' ratings were in agreement 75% of the time. When not in agreement, the students' ratings tended to upgrade courses that were not very demanding, had easy grading, and emphasized clinical details, often at the expense of basic concepts and the big picture. The authors then document how the work of the peer review system favorably influenced the transformation of the school's curriculum. They also provide guidelines for the creation and operation of a course review process that uses faculty peers. The authors maintain that the peer review system worked because it was run by a committee of experienced and respected teachers who had been selected by their peers, the other faculty. Additional reasons for its success were that the school's faculty supported and respected the committee and its work, that course directors helped evaluate their courses, and that peer reviewers took their work seriously despite having no remuneration, and the clearly positive impact of the review system on faculty interaction, faculty-student interaction, and the reform of the curriculum.

Enhancing the role of case-oriented peer review to improve quality and safety in radiation oncology: Executive summary

PubMed Central

Marks, Lawrence B.; Adams, Robert D.; Pawlicki, Todd; Blumberg, Albert L.; Hoopes, David; Brundage, Michael D.; Fraass, Benedick A.

2013-01-01

This report is part of a series of white papers commissioned for the American Society for Radiation Oncology (ASTRO) Board of Directors as part of ASTRO's Target Safely Campaign, focusing on the role of peer review as an important component of a broad safety/quality assurance (QA) program. Peer review is one of the most effective means for assuring the quality of qualitative, and potentially controversial, patient-specific decisions in radiation oncology. This report summarizes many of the areas throughout radiation therapy that may benefit from the application of peer review. Each radiation oncology facility should evaluate the issues raised and develop improved ways to apply the concept of peer review to its individual process and workflow. This might consist of a daily multidisciplinary (eg, physicians, dosimetrists, physicists, therapists) meeting to review patients being considered for, or undergoing planning for, radiation therapy (eg, intention to treat and target delineation), as well as meetings to review patients already under treatment (eg, adequacy of image guidance). This report is intended to clarify and broaden the understanding of radiation oncology professionals regarding the meaning, roles, benefits, and targets for peer review as a routine quality assurance tool. It is hoped that this work will be a catalyst for further investigation, development, and study of the efficacy of peer review techniques and how these efforts can help improve the safety and quality of our treatments. PMID:24175002

Peer Victimization among Schoolchildren: Correlations, Causes, Consequences, and Considerations in Assessment and Intervention

ERIC Educational Resources Information Center

Card, Noel A.; Hodges, Ernest V. E.

2008-01-01

Peer victimization among schoolchildren is a common problem that predicts serious maladjustment. In this article, the authors define peer victimization, provide a brief overview of the history of research on the topic, and review prevalence rates, common measurement approaches, and the correlates of peer victimization. This review leads to…

Making Teaching Community Property: A Menu for Peer Collaboration and Peer Review. AAHE Teaching Initiative.

ERIC Educational Resources Information Center

Hutchings, Pat

A collection of program descriptions and case studies in college faculty peer collaboration and peer review includes: "Setting a Scholarly Tone: Teaching Circles in the History Department at Kent State University"; "Fostering Collective Responsibility for Student Learning: Teaching Seminars in the University of North Carolina at Charlotte…

Research management peer exchange hosted by the Oregon Department of Transportation Research Group, August 20-24, 2001. Summary report.

DOT National Transportation Integrated Search

2001-05-01

The team began this peer exchange with a review of the first Oregon Peer Exchange conducted in may, 1998. The review included a summary of recommendations made and the changes made as a result of the 1998 Peer Exchange Report. : The primary focus of ...

Peering into peer review: Galileo, ESP, Dr Scott Reuben, and advancing our professional evolution.

PubMed

Biddle, Chuck

2011-10-01

The fundamental purpose of peer review is quality control that facilitates the introduction of information into our discipline; information that is essential to the care of patients who require anesthesia services. While the AANA Journal relies heavily on this process to maintain the overall quality of our scholarly literature, it may fail that objective under certain conditions. This editorial serves to inform readers of the nature and goals of the peer review process.

2017 Building Technologies Office Peer Review Report

DOE Office of Scientific and Technical Information (OSTI.GOV)

None, None

The 2017 Building Technologies Office Peer Review Report summarizes the feedback submitted by reviewers for the 109 Building Technologies Office (BTO) projects presented at the 2017 BTO Peer Review. The report presents an overview of the goals and activities under each technology program area, a summary of project scores for each program, and a brief analysis of general evaluation trends within each program area or its constituent subprograms.

Peer Review of Submissions to the Annual American Evaluation Association Conference by the Graduate Student & New Evaluators Topical Interest Group

ERIC Educational Resources Information Center

Schroter, Daniela C.; Coryn, Chris L. S.; Montrosse, Bianca E.

2008-01-01

Peer review is an umbrella term that refers to a class of selection and oversight practices, including the familiar mechanisms of the review of proposals submitted for funding, of manuscripts for scholarly publications, and of personnel qualifications and portfolios for selection and promotion. Peer review has long been a cornerstone of modern…

Peer Review: Structured, Informal, Confidential, Helpful!

ERIC Educational Resources Information Center

Cassidy, Alice; Lee, Jack

2011-01-01

This paper describes an introductory workshop, Preparing to be a Peer Reviewer, presented at the University of British Columbia (UBC) to give hands-on practice to faculty members and others in order to provide formative peer review upon request. This workshop, which was designed at the request of a faculty member, is complemented by an Advanced…

Preparing English Learners for Effective Peer Review in the Writers' Workshop

ERIC Educational Resources Information Center

Kim, Soo Hyon

2015-01-01

English Language Learners (ELLs) often face challenges when participating in peer review activities in writers' workshops. This article identifies some of the potential difficulties that ELL writers may experience, and provides teachers with strategies to address these problems. The author describes a simple three-step peer review training model…

Using Peer Review to Improve Student Writing in Business Courses

ERIC Educational Resources Information Center

Rieber, Lloyd J.

2006-01-01

Student peer review has proven an effective technique for improving student writing in both English and business communication classes, yet the technique is not widely used in business courses other than business communication. In this article, the author discusses using student peer review in business classes to improve students' final written…

Peer Review of Teaching: Best Practices for a Non-Programmatic Approach

ERIC Educational Resources Information Center

Alabi, Jaena; Weare, William H., Jr.

2014-01-01

Many academic librarians who provide library instruction have never received formal training in educational theory and methods. To bridge this gap and improve the teaching skills of instruction librarians, some academic libraries have established peer review of teaching programs. Despite the recognized benefits of peer review, it may not be…

The Great Fossil Fiasco: Teaching about Peer Review.

ERIC Educational Resources Information Center

Gift, Nancy; Krasny, Marianne

2003-01-01

Describes a lesson that engages middle school students in learning about peer review. Uses the article "Archaeoraptor Fossil Trail," which was published in the November, 1999 issue of "National Geographic" as an example of a real life story of how peer review forces scientists to critically re-examine a fossil discovery. (SOE)

Influence of Peer Effects on Learning Outcomes: A Review of the Literature.

ERIC Educational Resources Information Center

Wilkinson, Ian A. G.; Hattie, John A.; Parr, Judy M.; Townsend, Michael A. R.; Fung, Irene; Ussher, Charlotte; Thrupp, Martin; Lauder, Hugh; Robinson, Tony

This report presents a literature review and conceptual model summarizing the influence of peer effects on learning outcomes. The report describes the approach to the review and provides a theoretical account of the environments, mechanisms, and processes that mediate learning among peers. It then summarizes the literature on compositional effects…

77 FR 58802 - Notice of Intent To Seek OMB Approval To Collect Information: Forms Pertaining to the Peer Review...

Federal Register 2010, 2011, 2012, 2013, 2014

2012-09-24

... Collect Information: Forms Pertaining to the Peer Review of ARS Research Projects AGENCY: Agricultural Research Service (ARS), USDA. ACTION: Notice and request for comments. SUMMARY: The proposed information... allow the ARS to efficiently manage data associated with the peer review of agricultural research. All...

Original Research and Peer Review Using Web-Based Collaborative Tools by College Students

ERIC Educational Resources Information Center

Cakir, Mustafa; Carlsen, William S.

2007-01-01

The Environmental Inquiry program supports inquiry based, student-centered science teaching on selected topics in the environmental sciences. Many teachers are unfamiliar with both the underlying science of toxicology, and the process and importance of peer review in scientific method. The protocol and peer review process was tested with college…

DOE Hydrogen Program: 2010 Annual Merit Review and Peer Evaluation Report

DOE Office of Scientific and Technical Information (OSTI.GOV)

Not Available

This document summarizes the comments provided by peer reviewers on hydrogen and fuel cell projects presented at the FY 2010 U.S. Department of Energy (DOE) Hydrogen Program and Vehicle Technologies Program Annual Merit Review and Peer Evaluation Meeting (AMR), held June 7-11, 2010 in Washington, D.C.

Peer Review of Report Modeling the Relationship Between Lead in Drinking Water and Blood Lead Levels in Children

EPA Science Inventory

EPA is peer reviewing the Agency’s report modeling the relationship between lead in drinking water and blood lead levels in children utilizing the Integrated Exposure Uptake Biokinetic (IEUBK) model. The report being peer reviewed may be used to inform the derivation of a concent...

Peer Review: The CHAMPUS Program.

ERIC Educational Resources Information Center

Stricker, George

This paper examines the use of the peer review system in evaluating out-patient clinical services for a third-party payer seeking justification for payment of services. Peer review is defined as a process by which one professional, in an official capacity, makes a judgment about a co-professional in a matter involving professional functioning. The…

Systematic review of peer education intervention programmes among individuals with type 2 diabetes.

PubMed

Gatlin, Tricia K; Serafica, Reimund; Johnson, Michael

2017-12-01

To systematically review published randomised controlled trials of peer education interventions among adults with type 2 diabetes. Systematic reviews have shown mixed results for peer support interventions to improve diabetes self-management. Given the effectiveness of diabetes education by healthcare professionals, peer education interventions may be a useful alternative approach. This review addressed that gap. Systematic review. A systematic search of published randomised controlled trials between 2006-2016 was conducted using the keywords diabetes, type 2 diabetes, randomised controlled trials, self-management, peer education and peer support. The methodological quality of each study was assessed using the Jadad scale. Seven studies were included in the final review, and the Jadad scores ranged from 8-10 of a possible 13 points. There was no consistent design, setting, or outcome measurement among the studies. There were two types of peer education interventions compared to traditional diabetes education: face-to-face or a combination of face-to-face and telephone/texting. The most common clinical outcome measure was HbA1c. Two of six studies showed statistically significant improvement in HbA1c between intervention and control groups. An increase in diabetes knowledge was also statistically significant in two of five studies. Peer education could be successful in improving clinical outcomes. No evidence was found indicating that healthcare provider education was superior in regard to clinical knowledge or behavioural or psychological outcome measures than peer education. HbA1c was statistically significantly lower in some peer education groups compared to control groups. There is evidence that peer education can be useful in achieving positive clinical outcomes such as decreasing HbA1c levels and increasing diabetes knowledge. A certified diabetes educator or a trained healthcare professional should not be overlooked though when using peer educators. © 2017 John Wiley & Sons Ltd.

Standardizing the evaluation of scientific and academic performance in neurosurgery--critical review of the "h" index and its variants.

PubMed

Aoun, Salah G; Bendok, Bernard R; Rahme, Rudy J; Dacey, Ralph G; Batjer, H Hunt

2013-11-01

Assessing the academic impact and output of scientists and physicians is essential to the academic promotion process and has largely depended on peer review. The inherent subjectivity of peer review, however, has led to an interest to incorporate objective measures into more established methods of academic assessment and promotion. Journal impact factor has been used to add objectivity to the process but this index alone does not capture all aspects of academic impact and achievement. The "h" index and its variants have been designed to compensate for these shortcomings, and have been successfully used in the fields of physics, mathematics, and biology, and more recently in medicine. Leaders in academic neurosurgery should be aware of the advantages offered by each of these indices, as well as of their individual shortcomings, to be able to efficiently use them to refine the peer-review process. This review critically analyzes indices that are currently available to evaluate the academic impact of scientists and physicians. These indices include the total citation count, the total number of papers, the impact factor, as well as the "h" index with eight of its most common variants. The analysis focuses on their use in the field of academic neurosurgery, and discusses means to implement them in current review processes. Copyright © 2013 Elsevier Inc. All rights reserved.

Transformation of Adolescent Peer Relations in the Social Media Context: Part 2-Application to Peer Group Processes and Future Directions for Research.

PubMed

Nesi, Jacqueline; Choukas-Bradley, Sophia; Prinstein, Mitchell J

2018-04-07

As social media use becomes increasingly widespread among adolescents, research in this area has accumulated rapidly. Researchers have shown a growing interest in the impact of social media on adolescents' peer experiences, including the ways that the social media context shapes a variety of peer relations constructs. This paper represents Part 2 of a two-part theoretical review. In this review, we offer a new model for understanding the transformative role of social media in adolescents' peer experiences, with the goal of stimulating future empirical work that is grounded in theory. The transformation framework suggests that the features of the social media context transform adolescents' peer experiences by changing their frequency or immediacy, amplifying demands, altering their qualitative nature, and/or offering new opportunities for compensatory or novel behaviors. In the current paper, we consider the ways that social media may transform peer relations constructs that often occur at the group level. Our review focuses on three key constructs: peer victimization, peer status, and peer influence. We selectively review and highlight existing evidence for the transformation of these domains through social media. In addition, we discuss methodological considerations and key conceptual principles for future work. The current framework offers a new theoretical perspective through which peer relations researchers may consider adolescent social media use.

Peer review of human studies run amok: a break in the fiduciary relation between scientists and the public.

PubMed

Feldstein Ewing, Sarah W; Saitz, Richard

2015-02-01

Peer review aims to ensure the quality and credibility of research reporting. Conducted by volunteer scientists who receive no guidance or direction, peer review widely varies from fast and facilitative, to unclear and obstructive. Poor quality is an issue because most science research is publicly funded, whereby scientists must make an effort to quickly disseminate their findings back to the public. An unfortunately not uncommon barrier in this process is ineffective peer review. Most scientists agree that when done well, editors and reviewers drive and maintain the high standards of science. At the same time, ineffective peer review can cause great delay with no introduced improvement in final product. These delays and requests interfere with the path of communication between scientist and public, at a great cost to editors, reviewers, authors and those who stand to benefit from application of the results of the studies. We offer a series of concrete recommendations to improve this process.

IRIS Toxicological Review of Inorganic Arsenic (Cancer) ...

EPA Pesticide Factsheets

On February 19, 2010, the draft IRIS Toxicological Review of Inorganic Arsenic (Cancer) external review draft document and the charge to external peer reviewers were released for public review and comment. The draft document and the charge to external peer reviewers were reviewed internally by EPA and by other federal agencies and White House Offices before public release. In the new IRIS process, introduced by the EPA Administrator, all written comments on IRIS assessments submitted by other federal agencies and White House Offices will be made publicly available. Accordingly, interagency comments and the interagency science consultation draft of the Toxicological Review of Inorganic Arsenic and the charge to external peer reviewers are posted on this site. This draft IRIS health assessment addresses only cancer human health effects that may result from chronic exposure to this chemical. An assessment of noncancer health effects of inorganic arsenic will be released for external peer review and public comment at a later date.

Prevention of Post Traumatic Stress Disorder among Military Health Care Workers: A Systematic Review

DTIC Science & Technology

2012-01-01

Posttraumatic Stress Disorder (PTSD) is not uncommon among medical personnel serving in the military and that its prevention remains a significant...nonmedical personnel, the purpose for this paper is to perform a review of peer-reviewed and evidence- based literature for post-traumatic stress ...of traumatic stress , depressive symptoms, and psychosocial difficulties in veterans of Operations Enduring Freedom and Iraqi Freedom: The role of

Impact of peer review on reports of randomised trials published in open peer review journals: retrospective before and after study

PubMed Central

Collins, Gary S; Boutron, Isabelle; Yu, Ly-Mee; Cook, Jonathan; Shanyinde, Milensu; Wharton, Rose; Shamseer, Larissa; Altman, Douglas G

2014-01-01

Objective To investigate the effectiveness of open peer review as a mechanism to improve the reporting of randomised trials published in biomedical journals. Design Retrospective before and after study. Setting BioMed Central series medical journals. Sample 93 primary reports of randomised trials published in BMC-series medical journals in 2012. Main outcome measures Changes to the reporting of methodological aspects of randomised trials in manuscripts after peer review, based on the CONSORT checklist, corresponding peer reviewer reports, the type of changes requested, and the extent to which authors adhered to these requests. Results Of the 93 trial reports, 38% (n=35) did not describe the method of random sequence generation, 54% (n=50) concealment of allocation sequence, 50% (n=46) whether the study was blinded, 34% (n=32) the sample size calculation, 35% (n=33) specification of primary and secondary outcomes, 55% (n=51) results for the primary outcome, and 90% (n=84) details of the trial protocol. The number of changes between manuscript versions was relatively small; most involved adding new information or altering existing information. Most changes requested by peer reviewers had a positive impact on the reporting of the final manuscript—for example, adding or clarifying randomisation and blinding (n=27), sample size (n=15), primary and secondary outcomes (n=16), results for primary or secondary outcomes (n=14), and toning down conclusions to reflect the results (n=27). Some changes requested by peer reviewers, however, had a negative impact, such as adding additional unplanned analyses (n=15). Conclusion Peer reviewers fail to detect important deficiencies in reporting of the methods and results of randomised trials. The number of these changes requested by peer reviewers was relatively small. Although most had a positive impact, some were inappropriate and could have a negative impact on reporting in the final publication. PMID:24986891

Correct machine learning on protein sequences: a peer-reviewing perspective.

PubMed

Walsh, Ian; Pollastri, Gianluca; Tosatto, Silvio C E

2016-09-01

Machine learning methods are becoming increasingly popular to predict protein features from sequences. Machine learning in bioinformatics can be powerful but carries also the risk of introducing unexpected biases, which may lead to an overestimation of the performance. This article espouses a set of guidelines to allow both peer reviewers and authors to avoid common machine learning pitfalls. Understanding biology is necessary to produce useful data sets, which have to be large and diverse. Separating the training and test process is imperative to avoid over-selling method performance, which is also dependent on several hidden parameters. A novel predictor has always to be compared with several existing methods, including simple baseline strategies. Using the presented guidelines will help nonspecialists to appreciate the critical issues in machine learning. © The Author 2015. Published by Oxford University Press. For Permissions, please email: journals.permissions@oup.com.

Mitigation of Disagreement in Peer Review among L2 Learners and Native Speakers in a College Writing Class (Mitigación del Impacto de las Opiniones de Desacuerdo en el Proceso de Revisión por Pares entre Estudiantes de una Segunda Lengua y Hablantes Nativos en una Clase de Escritura a Nivel Universitario)

ERIC Educational Resources Information Center

Christoffersen, Katherine O'Donnell

2015-01-01

Peer review is now a commonplace practice in process-oriented writing instruction. A crucial aspect of peer review is assessing another classmate's work, which encompasses the act of disagreement. Given its prevalence in the classroom, it is necessary to analyze how L2 learners mitigate disagreement in the context of peer review with other L2…

Does the Committee Peer Review Select the Best Applicants for Funding? An Investigation of the Selection Process for Two European Molecular Biology Organization Programmes

PubMed Central

Bornmann, Lutz; Wallon, Gerlind; Ledin, Anna

2008-01-01

Does peer review fulfill its declared objective of identifying the best science and the best scientists? In order to answer this question we analyzed the Long-Term Fellowship and the Young Investigator programmes of the European Molecular Biology Organization. Both programmes aim to identify and support the best post doctoral fellows and young group leaders in the life sciences. We checked the association between the selection decisions and the scientific performance of the applicants. Our study involved publication and citation data for 668 applicants to the Long-Term Fellowship programme from the year 1998 (130 approved, 538 rejected) and 297 applicants to the Young Investigator programme (39 approved and 258 rejected applicants) from the years 2001 and 2002. If quantity and impact of research publications are used as a criterion for scientific achievement, the results of (zero-truncated) negative binomial models show that the peer review process indeed selects scientists who perform on a higher level than the rejected ones subsequent to application. We determined the extent of errors due to over-estimation (type I errors) and under-estimation (type 2 errors) of future scientific performance. Our statistical analyses point out that between 26% and 48% of the decisions made to award or reject an application show one of both error types. Even though for a part of the applicants, the selection committee did not correctly estimate the applicant's future performance, the results show a statistically significant association between selection decisions and the applicants' scientific achievements, if quantity and impact of research publications are used as a criterion for scientific achievement. PMID:18941530

Doing peer review and receiving feedback: impact on scientific literacy and writing skills.

PubMed

Geithner, Christina A; Pollastro, Alexandria N

2016-03-01

Doing peer review has been effectively implemented to help students develop critical reading and writing skills; however, its application in Human Physiology programs is limited. The purpose of the present study was to determine the impact of peer review on Human Physiology majors' perceptions of their scientific literacy and writing skills. Students enrolled in the Scientific Writing course completed multiple writing assignments, including three revisions after receiving peer and instructor feedback. Students self-assessed their knowledge, skills, and attitudes related to science and writing in pre- and postcourse surveys (n = 26 with complete data). Seven survey items related to scientific literacy and writing skills impacted by peer review were selected for analysis. Scores on these survey items were summed to form a composite self-rating score. Responses to two questions regarding the most useful learning activities were submitted to frequency analysis. Mean postcourse scores for individual survey items and composite self-rating scores were significantly higher than precourse means (P < 0.05). Peer review was the most frequently noted among 21 learning activities for increasing scientific literacy and in the top 5 for improving writing skills. In conclusion, peer review is an effective teaching/learning approach for improving undergraduate Human Physiology majors' knowledge, skills, and attitudes regarding science and scientific writing. Copyright © 2016 The American Physiological Society.

Peer Acceptance and Friendship in Early Childhood: The Conceptual Distinctions between Them

ERIC Educational Resources Information Center

Beazidou, Eleftheria; Botsoglou, Kafenia

2016-01-01

This paper reviews previous literature about peer acceptance and friendship, two of the most critical aspects of peer relations that have received most of research attention during the past years. In this review, we will focus on the processes explaining the way children use the ability to socialise with peers; explore the hypothesis that certain…

Peer Response to L2 Student Writing: Patterns and Expectations

ERIC Educational Resources Information Center

Abdalla Salih, Abdel Rahman

2013-01-01

This paper reports the corrective feedback patterns in L2 writing and the student writers' preferences for peer feedback. The study examines the actual focus of peer review and the types of corrective feedback provided in L2 composing process. Sixteen L2 matriculation students at a Malaysian university took part in five peer review sessions,…

Iterative Design and Classroom Evaluation of Automated Formative Feedback for Improving Peer Feedback Localization

ERIC Educational Resources Information Center

Nguyen, Huy; Xiong, Wenting; Litman, Diane

2017-01-01

A peer-review system that automatically evaluates and provides formative feedback on free-text feedback comments of students was iteratively designed and evaluated in college and high-school classrooms. Classroom assignments required students to write paper drafts and submit them to a peer-review system. When student peers later submitted feedback…

Peer Review from the Students' Perspective: Invaluable or Invalid?

ERIC Educational Resources Information Center

Brammer, Charlotte; Rees, Mary

2007-01-01

Only a few instances of empirical research examine what the students themselves think of their participation in peer review. Perhaps because peer response is practically instinctive to those who teach writing, few have felt the need to study the student perspective. Instead, studies have focused on the quality of peer comments, their effect on the…

Peer Mentoring and Peer Tutoring among K-12 Students: A Literature Review

ERIC Educational Resources Information Center

Goodrich, Andrew

2018-01-01

The purpose of this literature review is to examine research on peer mentoring among K-12 students to assist practitioners with how to incorporate these instructional techniques into their own music programs. Primary themes across the music education literature of peer mentoring include the role of music teachers, the role of students as they…

Unmanned Maritime Systems Incremental Acquisition Approach

DTIC Science & Technology

2016-12-01

We find that current UMS acquisitions are utilizing previous acquisition reforms, but could benefit from additional contractor peer competition and...peer review. Additional cost and schedule benefits could result from contractor competition during build processes in each incremental process. We...acquisitions are utilizing previous acquisition reforms, but could benefit from additional contractor peer competition and peer review. Additional

IRIS Toxicological Review of Inorganic Arsenic (Cancer) (Interagency Science Consultation Draft)

EPA Science Inventory

On February 19, 2010, the draft IRIS Toxicological Review of Inorganic Arsenic (Cancer) external review draft document and the charge to external peer reviewers were released for public review and comment. The draft document and the charge to external peer reviewers were reviewed...

Challenges in the Ethical Review of Peer Support Interventions

PubMed Central

Simmons, David; Bunn, Christopher; Nakwagala, Fred; Safford, Monika M.; Ayala, Guadalupe X.; Riddell, Michaela; Graffy, Jonathan; Fisher, Edwin B.

2015-01-01

PURPOSE Ethical review processes have become increasingly complex. We have examined how 8 collaborating diabetes peer-support clinical trials were assessed by ethics committees. METHODS The ethical reviews from the 8 peer-support studies were collated and subjected to a thematic analysis. We mapped the recommendations of local Institutional Review Boards and ethics committees onto the “4+1 ethical framework” (autonomy, beneficence, non-maleficence, and justice, along with concern for their scope of application). RESULTS Ethics committees did not consistently focus on tasks within the 4+1 framework: many conducted reviews of scientific, organizational, and administrative activities. Of the 20 themes identified across the ethical reviews, only 4 fell within the scope of the 4+1 framework. Variation in processes and requirements for ethics committees were particularly evident between study countries. Some of the consent processes mandated by ethical review boards were disproportionate for peer support, increased participant burden, and reduced the practicality of testing an ethical intervention. Across the 8 studies, ethics committees’ reviews included the required elements to ensure participant safety; however, they created a range of hurdles that in some cases delayed the research and required consent processes that could hinder the spontaneity and/or empathy of peer support. CONCLUSION Ethics committees should avoid repeating the work of other trusted agencies and consider the ethical validity of “light touch” consent procedures for peer-support interventions. The investigators propose an ethical framework for research on peer support. PMID:26304976

Turnitin and Peer Review in ESL Academic Writing Classrooms

ERIC Educational Resources Information Center

Li, Jinrong; Li, Mimi

2018-01-01

Despite the benefits of peer review, there are still challenges that need to be addressed to make it more effective for L2 students. With the development of technology, computer-mediated peer review has captured increasing attention from L2 writing researchers and instructors. While Turnitin is known for its use in detecting plagiarism, its newly…

Peer-to-Peer Teaching in Higher Education: A Critical Literature Review

ERIC Educational Resources Information Center

Stigmar, Martin

2016-01-01

The aim of my critical literature review is to identify studies where students are engaged as partners in teaching in higher education and to analyze how tutors and tutees benefit from peer teaching. Thirty studies were included for review. Thirteen countries are represented and two thirds of the studies conducted in the United States of America…

Blog Comments vs. Peer Review: Which Way Makes a Book Better?

ERIC Educational Resources Information Center

Young, Jeffrey R.

2008-01-01

What if scholarly books were peer reviewed by anonymous blog comments rather than by traditional, selected peer reviewers? This is the question posed by an unusual experiment that was started recently by Noah Wardrip-Fruin, an an assistant professor of communication at the University of California at San Diego. His experiment was started after his…

U.S. Department of Energy Hydrogen and Fuel Cells Program 2011 Annual Merit Review and Peer Evaluation Report

DOE Office of Scientific and Technical Information (OSTI.GOV)

Satypal, S.

2011-09-01

This document summarizes the comments provided by peer reviewers on hydrogen and fuel cell projects presented at the FY 2011 U.S. Department of Energy (DOE) Hydrogen Program and Vehicle Technologies Program Annual Merit Review and Peer Evaluation Meeting (AMR), held May 9-13, 2011 in Arlington, Virginia

Bound by Tradition? Peer Review and New Scholarship: An Institutional Case Study

ERIC Educational Resources Information Center

White, Barbara Jo; Cruz, Laura; Ellern, Jill; Ford, George; Moss, Hollye

2012-01-01

Peer review is by no means a routine process for traditional, or basic, research. Even so, peer review is even less routinized for other forms of scholarship. In 1990, Ernest Boyer called for a reconsideration of scholarship and extended the definition to be inclusive of non-traditional modes of scholarly production and delivery. However, peer…

Peer Review Improves the Quality of MCQ Examinations

ERIC Educational Resources Information Center

Malau-Aduli, Bunmi S.; Zimitat, Craig

2012-01-01

The aim of this study was to assess the effect of the introduction of peer review processes on the quality of multiple-choice examinations in the first three years of an Australian medical course. The impact of the peer review process and overall quality assurance (QA) processes were evaluated by comparing the examination data generated in earlier…

Academic Excellence: A Commentary and Reflections on the Inherent Value of Peer Review

ERIC Educational Resources Information Center

Roberts, Thomas J.; Shambrook, Jennifer

2012-01-01

Academic peer review is widely viewed as fair, equitable, and essential to academic quality. Successfully completing the process through publication or award is widely deemed as one of the most rigorous and prestigious forms of scholarly accomplishment. Despite this sentiment the academic peer review process is not without fault. It is criticized…

Doing Peer Review and Receiving Feedback: Impact on Scientific Literacy and Writing Skills

ERIC Educational Resources Information Center

Geithner, Christina A.; Pollastro, Alexandria N.

2016-01-01

Doing peer review has been effectively implemented to help students develop critical reading and writing skills; however, its application in Human Physiology programs is limited. The purpose of the present study was to determine the impact of peer review on Human Physiology majors' perceptions of their scientific literacy and writing skills.…

Student Peer Review: Enhancing Formative Feedback with a Rebuttal

ERIC Educational Resources Information Center

Harland, Tony; Wald, Navé; Randhawa, Haseeb

2017-01-01

This study examines the use of peer review in an undergraduate ecology programme, in which students write a research proposal as a grant application, prior to carrying out the research project. Using a theoretical feedback model, we compared teacher and student peer reviews in a double blind exercise, and show how students responded to feedback…

A Review of Peer-Mediated Social Interaction Interventions for Students with Autism in Inclusive Settings

ERIC Educational Resources Information Center

Watkins, Laci; O'Reilly, Mark; Kuhn, Michelle; Gevarter, Cindy; Lancioni, Giulio E.; Sigafoos, Jeff; Lang, Russell

2015-01-01

This review addresses the use of peer-mediated interventions (PMI) to improve the social interaction skills of students with autism spectrum disorder (ASD) in inclusive settings. The purpose of this review is to (a) identify the characteristics and components of peer-mediated social interaction interventions, (b) evaluate the effectiveness of PMI…

Social Workers' Attitudes toward Peer-Reviewed Literature: The Evidence Base

ERIC Educational Resources Information Center

Knight, Carolyn

2013-01-01

Social workers from one state chapter of the National Association of Social Workers were surveyed to assess their use of and attitudes toward the peer-reviewed literature and their engagement in evidence-based practice. Results reveal that, in general, the practitioners in this study did not read the peer-reviewed literature, particularly articles…

Gender Consequences of a National Performance-Based Funding Model: New Pieces in an Old Puzzle

ERIC Educational Resources Information Center

Nielsen, Mathias Wullum

2017-01-01

This article investigates the extent to which the Danish "Bibliometric Research Indicator" (BRI) reflects the performance of men and women differently. The model is based on a differentiated counting of peer-reviewed publications, awarding three and eight points for contributions to "well-regarded" and highly selective journals…

Potential Benefits of Incorporating Peer-to-Peer Interactions Into Digital Interventions for Psychotic Disorders: A Systematic Review.

PubMed

Biagianti, Bruno; Quraishi, Sophia H; Schlosser, Danielle A

2018-04-01

Peer-to-peer interactions and support groups mitigate experiences of social isolation and loneliness often reported by individuals with psychotic disorders. Online peer-to-peer communication can promote broader use of this form of social support. Peer-to-peer interactions occur naturally on social media platforms, but they can negatively affect mental health. Recent digital interventions for persons with psychotic disorders have harnessed the principles of social media to incorporate peer-to-peer communication. This review examined the feasibility, acceptability, and preliminary efficacy of recent digital interventions in order to identify strategies to maximize benefits of online peer-to-peer communication for persons with psychotic disorders. An electronic database search of PubMed, EMBASE, PsycINFO, Ovid MEDLINE, Cochrane Central Register of Controlled Trials, and Health Technology Assessment Database was conducted in February 2017 and yielded a total of 1,015 results. Eight publications that reported data from six independent trials and five interventions were reviewed. The technology supporting peer-to-peer communication varied greatly across studies, from online forums to embedded social networking. When peer-to-peer interactions were moderated by facilitators, retention, engagement, acceptability, and efficacy were higher than for interventions with no facilitators. Individuals with psychotic disorders were actively engaged with moderated peer-to-peer communication and showed improvements in perceived social support. Studies involving service users in intervention design showed higher rates of acceptability. Individuals with psychotic disorders value and benefit from digital interventions that include moderated peer-to-peer interactions. Incorporating peer-to-peer communication into digital interventions for this population may increase compliance with other evidence-based therapies by producing more acceptable and engaging online environments.

Mentorship, productivity, and promotion among academic hospitalists.

PubMed

Reid, Mark B; Misky, Gregory J; Harrison, Rebecca A; Sharpe, Brad; Auerbach, Andrew; Glasheen, Jeffrey J

2012-01-01

United States academic hospitals have rapidly adopted the hospitalist model of care. Academic hospitalists have taken on much of the clinical and teaching responsibilities at many institutions, yet little is known about their academic productivity and promotion. We sought to discover the attitudes and attributes of academic hospitalists regarding mentorship, productivity, and promotion. We performed a web-based email survey of academic hospitalists consisting of 61 questions. Four hundred and twenty academic hospitalists. Demographic details, scholarly production, presence of mentorship and attitudes towards mentor, academic rank Two hundred and sixty-six (63%) of hospitalists responded. The majority were under 41 (80%) and had been working as hospitalists for <5 years (62%). Only 42% of academic hospitalists had a mentor. Forty-four percent of hospitalists had not presented a poster or abstract at national meeting; 51% had not been first author on a peer-reviewed publication. Factors positively associated with publication of a peer-reviewed first author paper included: 1) male gender, AOR = 2.38 (95% CI 1.30, 4.33), 2) >20% "protected" time, AOR = 1.92 (95% CI 1.00, 3.69), and 3) a better-than-average understanding of the criteria for promotion, AOR = 3.66 (95% CI 1.76, 7.62). A lack of mentorship was negatively associated with producing any peer-reviewed first author publications AOR = 0.43 (95% CI 0.23, 0.81); any non-peer reviewed publications AOR = 0.45 (95% CI 0.24, 0.83), and leading a teaching session at a national meeting AOR = 0.41 (95% CI 0.19, 0.88). Most hospitalists promoted to the level of associate professor had been first author on four to six peer-reviewed publications. Most academic hospitalists had not presented a poster at a national meeting, authored an academic publication, or presented grand rounds at their institution. Many academic hospitalists lacked mentorship and this was associated with a failure to produce scholarly activity. Mentorship may improve academic productivity among hospitalists.

Testing the Rebound Peer Review Concept

PubMed Central

Choi, Augustine M.K.

2013-01-01

Abstract This invited editorial addresses the rescue of the article by Skrzypek et al. “Interplay between heme oxygenase-1 and miR-378 affects non-small cell lung carcinoma growth, vascularization, and metastasis.” The work was rejected by the standard peer review system and subsequently rescued by the Rebound Peer Review (RPR) mechanism offered by Antioxidants and Redox Signaling (Antioxid Redox Signal 16: 293–296, 2012). The reviewers who openly rescued the article were James F. George, Justin C. Mason, Mahin D. Maines, and Yasufumi Sato. The initial article was a de novo resubmission of a previously rejected article, which was then reviewed by six reviewers. The reviewers raised substantial scientific concerns, including questions pertaining to the specificity of the findings, quality of the presentation, and other technical concerns; the editor returned a decision of reject. The authors voluntarily chose to exercise the option to rescue the article utilizing the RPR system, where the authors found qualified reviewers who were willing to advocate for acceptance with scientific reasoning. The open reviewers felt that the scientific and technical concerns raised by the reviewers were outweighed by the strengths and novelty of the findings to justify acceptance. The RPR, in this case, was a “success” in that it rescued a rejected article. Despite this assessment, we question the necessity of open peer review as a means to overturn a peer review decision, with concerns for the larger-than-usual peer review process, and the voluntary relinquishing of editorial privilege and disclosure of reviewer identity. Antioxid. Redox Signal. 19, 639–643. PMID:23725371

Editors’ Perspectives on Enhancing Manuscript Quality and Editorial Decisions Through Peer Review and Reviewer Development

PubMed Central

Janke, Kristin K.; Traynor, Andrew P.

2017-01-01

Objectives. To identify peer reviewer and peer review characteristics that enhance manuscript quality and editorial decisions, and to identify valuable elements of peer reviewer training programs. Methods. A three-school, 15-year review of pharmacy practice and pharmacy administration faculty’s publications was conducted to identify high-publication volume journals for inclusion. Editors-in-chief identified all editors managing manuscripts for participation. A three-round modified Delphi process was used. Rounds advanced from open-ended questions regarding actions and attributes of good reviewers to consensus-seeking and clarifying questions related to quality, importance, value, and priority. Results. Nineteen editors representing eight pharmacy journals participated. Three characteristics of reviews were rated required or helpful in enhancing manuscript quality by all respondents: includes a critical analysis of the manuscript (88% required, 12% helpful), includes feedback that contains both strengths and areas of improvement (53% required, 47% helpful), and speaks to the manuscript’s utility in the literature (41% required, 59% helpful). Hands-on experience with review activities (88%) and exposure to good and bad reviews (88%) were identified as very valuable to peer reviewer development. Conclusion. Reviewers, individuals involved in faculty development, and journals should work to assist new reviewers in defining focused areas of expertise, building knowledge in these areas, and developing critical analysis skills. PMID:28630514

Impartial judgment by the "gatekeepers" of science: fallibility and accountability in the peer review process.

PubMed

Hojat, Mohammadreza; Gonnella, Joseph S; Caelleigh, Addeane S

2003-01-01

High publication demands and the low acceptance rate of peer review journals place the journal editors and their reviewers in a powerful position. Journal reviewers have a vital role not only in influencing the journal editor's publication decisions, but also in the very nature and direction of scientific research. Because of their influence in peer review outcomes, journal reviewers are aptly described as the "gatekeepers of science." In this article we describe several pitfalls that can impede reviewers' impartial judgement. These include such issues as confirmatory bias, the negative results bias (the file drawer problem), the Matthew effect, the Doctor Fox effect, and gender, race, theoretical orientation, and "political correctness." We argue that procedures currently used by many professional journals, such as blind or masked review, may not completely alleviate the effects of these pitfalls. Instead, we suggest that increasing reviewers' awareness of the pitfalls, accountability, and vigilance can improve fairness in the peer review process. The ultimate responsibilities belong to the journal editors who are confronted with the difficult task of satisfying journal readers, contributors, reviewers, and owners. We recommend that the journal editors conduct periodic internal and external evaluations of their journals' peer review process and outcomes, with participation of reviewers, contributors, readers and owners.

In-Suit Light Exercise (ISLE) Prebreathe Protocol Peer Review Assessment. Part 2; Appendices

NASA Technical Reports Server (NTRS)

Brady, Timothy K.; Polk, James D.

2011-01-01

The performance of extravehicular activity (EVA) by National Aeronautics and Space Administration astronauts involves the risk of decompression sickness. This risk has been mitigated by the use of oxygen "prebreathe" to effectively wash out tissue nitrogen prior to each EVA. Now that the Space Shuttle Program (SSP) is being retired, high-pressure oxygen will become a limited resource. The In-Suit Light Exercise (ISLE) Prebreathe Protocol offers several potential benefits including its potential to save 6 pounds of oxygen per EVA. At the request of the NASA Engineering and Safety Center, the peer review convened on October 14, 2010. The major recommendation of the Review Committee was that the ISLE protocol was acceptable for operational use as a prebreathe option prior to EVA. The appendices to Volume I of the report are contained in this document.

A randomized trial of peer review: the UK National Chronic Obstructive Pulmonary Disease Resources and Outcomes Project: three-year evaluation.

PubMed

Roberts, Christopher M; Stone, Robert A; Buckingham, Rhona J; Pursey, Nancy A; Lowe, Derek; Potter, Jonathan M

2012-06-01

Peer review has been widely used within the National Health Service to facilitate health quality improvement but evaluation has been limited particularly over the longer-term. Change within the National Health Service (NHS) can take a prolonged period--1-2 years--to occur. We report here a 3-year evaluation of the largest randomized trial of peer review ever conducted in the UK. To evaluate whether targeted mutual peer review of respiratory units brings about improvements in services for chronic obstructive pulmonary disease (COPD) over 3 years. The peer review intervention was a reciprocal supportive exercise that included clinicians, hospital management, commissioners and patients, which focused on the quality of the provision of four specific evidence-based aspects of COPD care. Follow-up at 36 months demonstrated limited significant quantitative differences in the quality of services offered in the two groups but a strong trend in favour of intervention sites. Qualitative data suggested many benefits of peer review in most but not all intervention units and some control teams. The data identify factors that promote and obstruct change. The findings demonstrate significant change in service provision over 3 years in both control and intervention sites with great variability in both groups. The combined quantitative and qualitative findings indicate that targeted mutual peer review is associated with improved quality of care, improvements in service delivery and with changes within departments that promote and are precursors to quality improvement. The generic findings of this study have potential implications for the application of peer review throughout the NHS. © 2011 Blackwell Publishing Ltd.

Peer-based health interventions for people with serious mental illness: A systematic literature review.

PubMed

Cabassa, Leopoldo J; Camacho, David; Vélez-Grau, Carolina M; Stefancic, Ana

2017-01-01

Health interventions delivered by peer specialists or co-facilitated by peer specialists and health professionals can help improve the physical health of people with serious mental illness (SMI). Yet, the quality of the studies examining these health interventions and their impact on health outcomes remains unclear. To address this gap, we conducted a systematic literature review of peer-based health interventions for people with SMI. We rated the methodological quality of studies, summarized intervention strategies and health outcomes, and evaluated the inclusion of racial and ethnic minorities in these studies. We used the Preferred Reporting Items for Systematic Review and Meta-Analysis guidelines to conduct our systematic literature review. Electronic bibliographic databases and manual searches were used to locate articles that were published in English in peer-reviewed journals between 1990 and 2015, described peer-based health interventions for people with SMI, and evaluated the impact of the interventions on physical health outcomes. Two independent reviewers used a standardized instrument to rate studies' methodological quality, abstracted study characteristics, and evaluated the effects of the interventions on different health outcomes. Eighteen articles were reviewed. Findings indicated that the strength of the evidence generated from these studies is limited due to several methodological limitations. Mixed and limited intervention effects were reported for most health outcomes. The most promising interventions were self-management and peer-navigator interventions. Efforts to strengthen the evidence of peer-based interventions require a research agenda that focuses on establishing the efficacy and effectiveness of these interventions across different populations and settings. Copyright © 2016 Elsevier Ltd. All rights reserved.

IRIS Toxicological Review of Trimethylbenzenes (Interagency Science Consultation Draft)

EPA Science Inventory

On June 26, 2012, the draft Toxicological Review of Trimethylbenzenes and the draft charge to external peer reviewers were released for external peer review and public comment. The Toxicological Review and charge were reviewed internally by EPA and by other federal agencies and W...

IRIS Toxicological Review of Trichloroethylene (Interagency Science Consultation Draft)

EPA Science Inventory

On November 3, 2009, the Toxicological Review of Trichloroethylene and the charge to external peer reviewers were released for external peer review and public comment. The Toxicological Review and charge were reviewed internally by EPA and by other federal agencies and White Hous...

IRIS Toxicological Review of Formaldehyde (Interagency Science Consultation Draft)

EPA Science Inventory

On June 2, 2010, the Toxicological Review of Formaldehyde and the charge to external peer reviewers were released for external peer review and public comment. The Toxicological Review and charge were reviewed internally by EPA and by other federal agencies and White House Offices...

IRIS Toxicological Review of Biphenyl (Interagency Science Consultation Draft)

EPA Science Inventory

On September 30, 2011, the draft Toxicological Review of Biphenyl and the charge to external peer reviewers were released for external peer review and public comment. The Toxicological Review and charge were reviewed internally by EPA and by other federal agencies and White House...

IRIS Toxicological Review of Acrylonitrile (Interagency Science Consultation Draft)

EPA Science Inventory

On June 30, 2011, the draft Toxicological Review of Acrylonitrile and the charge to external peer reviewers were released for external peer review and public comment. The Toxicological Review and charge were reviewed internally by EPA and by other federal agencies and White House...

The effect of peer influence and selection processes on adolescent alcohol use: a systematic review of longitudinal studies.

PubMed

Leung, Rachel K; Toumbourou, John W; Hemphill, Sheryl A

2014-01-01

Adolescent alcohol use remains an important public health concern. One of the most salient and consistent predictors for drinking behaviour among young people is peer influence. A systematic review of longitudinal studies that examined the effect of peer influence on adolescent alcohol use between January 1997 and February 2011 is presented. Twenty-two studies fulfilled inclusion criteria and were reviewed. All but one study confirmed affiliation with alcohol-using or deviant peers as prospective predictors for the development of adolescent alcohol use. Findings revealed that existing longitudinal studies that have used multivariate analytic techniques to segregate peer influence (whereby adolescents start drinking after exposure to alcohol-using friends) and peer selection (whereby adolescents that start drinking without alcohol-using friends subsequently seek out drinking peers) effects consistently report significant peer influence effects. However, studies are unable to elucidate the relative contribution and developmental sequence of peer influence and selection. Existing research is synthesised to model the developmental influence of peer processes on adolescent alcohol use. Future research directions are recommended to inform better designed investigations that can lead to more effective endeavours to address peer processes in prevention efforts.

First CytoJournal Peer-Reviewer's Retreat in 2006 – Open access, peer-review, and impact factor

PubMed Central

Shidham, Vinod B; Sandweiss, Lynn; Atkinson, Barbara F

2006-01-01

CytoJournal organized its first Peer-Reviewer's Retreat of 2006 during the United States and Canadian Academy of Pathology Annual Meeting at Atlanta on Feb 12, 2006. The major topics discussed were open access, peer review, and impact factors. Representative participants volunteered to join the task force to prepare an instructional guide for peer-reviewing cytopathology manuscripts. Concern about the impact factor for CytoJournal was discussed. A feedback to its readers and authors was recommended. Impact factor calculation needs at least three years of journal statistics. It is only possible after two years from the time a journal is first accepted by Thomson-ISI for citation tracking. CytoJournal is still too new for an impact factor to be calculated. However, general progress of CytoJournal suggests an encouraging pattern for high impact factor. PMID:16566816

IRIS TOXICOLOGICAL REVIEW AND SUMMARY ...

EPA Pesticide Factsheets

EPA's assessment of the noncancer health effects and carcinogenic potential of Beryllium was added to the IRIS database in 1998. The IRIS program is updating the IRIS assessment for Beryllium. This update will incorporate health effects information published since the last assessment was prepared as well as new risk assessment methods. The IRIS assessment for Beryllium will consist of an updated Toxicological Review and IRIS Summary. The Toxicological Review is a critical review of the physicochemical and toxicokinetic properties of the chemical and its toxicity in humans and experimental systems. The assessment will present reference values for noncancer effects of Beryllium (RfD and RfC) and a cancer assessment. The Toxicological Review and IRIS Summary will be subject to internal peer consultation, Agency and Interagency review, and external scientific peer review. The final products will constitute the Agency's opinion on the toxicity of Beryllium. Beryllium is a light alkaline earth metal used in metal alloys and in high-performance products in the metallurgical, aerospace, and nuclear industries. According to the Superfund database, beryllium is found in over 300 NPL sites

48 CFR 201.170 - Peer Reviews.

Code of Federal Regulations, 2011 CFR

2011-10-01

... Section 201.170 Federal Acquisition Regulations System DEFENSE ACQUISITION REGULATIONS SYSTEM, DEPARTMENT... Peer Reviews, the military departments, defense agencies, and DoD field activities shall provide a... departments, defense agencies, and DoD field activities shall establish procedures for— (1) Pre-award Peer...

48 CFR 201.170 - Peer Reviews.

Code of Federal Regulations, 2010 CFR

2010-10-01

... Section 201.170 Federal Acquisition Regulations System DEFENSE ACQUISITION REGULATIONS SYSTEM, DEPARTMENT... Peer Reviews, the military departments, defense agencies, and DoD field activities shall provide a... departments, defense agencies, and DoD field activities shall establish procedures for— (1) Pre-award Peer...

Expanding Capacity and Promoting Inclusion in Introductory Computer Science: A Focus on Near-Peer Mentor Preparation and Code Review

ERIC Educational Resources Information Center

Pon-Barry, Heather; Packard, Becky Wai-Ling; St. John, Audrey

2017-01-01

A dilemma within computer science departments is developing sustainable ways to expand capacity within introductory computer science courses while remaining committed to inclusive practices. Training near-peer mentors for peer code review is one solution. This paper describes the preparation of near-peer mentors for their role, with a focus on…

Types of Feedback in Peer Review and the Effect on Student Motivation and Writing Quality

ERIC Educational Resources Information Center

Sloan, Christopher Colgan

2017-01-01

In writing classrooms, peer review has been shown to have numerous practical and cognitive benefits. However, little research has been done that examines how different types of peer feedback motivate adolescent students and the effects that different types of feedback have on writing quality. While the literature has indicated that peers give each…

Fragments of peer review: A quantitative analysis of the literature (1969-2015)

PubMed Central

Grimaldo, Francisco; Marušić, Ana

2018-01-01

This paper examines research on peer review between 1969 and 2015 by looking at records indexed from the Scopus database. Although it is often argued that peer review has been poorly investigated, we found that the number of publications in this field doubled from 2005. A half of this work was indexed as research articles, a third as editorial notes and literature reviews and the rest were book chapters or letters. We identified the most prolific and influential scholars, the most cited publications and the most important journals in the field. Co-authorship network analysis showed that research on peer review is fragmented, with the largest group of co-authors including only 2.1% of the whole community. Co-citation network analysis indicated a fragmented structure also in terms of knowledge. This shows that despite its central role in research, peer review has been examined only through small-scale research projects. Our findings would suggest that there is need to encourage collaboration and knowledge sharing across different research communities. PMID:29466467

The Influence of Peers on Diet and Exercise Among Adolescents: A Systematic Review.

PubMed

Chung, Sophia Jihey; Ersig, Anne L; McCarthy, Ann Marie

Adolescents' diet and exercise are modifiable factors contributing to high rates of adolescent obesity. Diverse contextual factors, including family, social environment, and peers, affect adolescents' diet and exercise behaviors. Because peer influence increases during adolescence, peers' contributions to adolescents' diet and exercise behaviors should be examined as potential targets for intervention to reduce the prevalence of adolescent obesity. The purpose of this systematic review is to identify research examining the contribution of peers to diet and exercise of adolescents. The electronic databases PubMed, CINAHL, Web of Science, and SCOPUS were searched. A total of 24 unique articles were included: seven examined diet only, fourteen studied exercise only, and three explored diet and exercise. This review provided evidence that diet and exercise of adolescents were significantly associated with those of their peers. However, these associations differed depending on gender, the type of diet and exercise, and closeness of friends. Findings from this review suggest that peers could be possible targets for interventions to promote healthier diet and exercise among adolescents; however, more studies are needed to identify specific peer influences and develop tailored interventions. Copyright © 2017 Elsevier Inc. All rights reserved.

Exploration and practice of methods and processes of evidence-based rapid review on peer review of WHO EML application.

PubMed

Li, Youping; Yu, Jiajie; Du, Liang; Sun, Xin; Kwong, Joey S W; Wu, Bin; Hu, Zhiqiang; Lu, Jing; Xu, Ting; Zhang, Lingli

2015-11-01

After 38 years of development, the procedure of selection and evaluation of the World Health Organization Essential Medicine List (WHO EML) is increasingly scientific and formal. However, peer review for the applications of World Health Organization Essential Medicine List is always required in a short period. It is necessary to build up a set of methods and processes for rapid review. We identified the process of evidenced-based rapid review on WHO EML application for peer reviews according to 11 items which were required during reporting of the peer review results of the proposals. The most important items for the rapid review of World Health Organization Essential Medicine List peer reviewers are (1) to confirm the requirements and identify the purposes; (2) to establish the research questions and translate the questions into the 'Participants, Interventions, Comparators, Outcomes, Study design' (PICOS) format; (3) to search and screen available evidence, for which high-level evidence is preferred, such as systematic reviews or meta-analyses, health technology assessment, clinical guidelines; (4) to extract data, where we extract primary information based on the purposes; (5) to synthesize data by qualitative methods, assess the quality of evidence, and compare the results; (6) to provide the answers to the applications, quality of evidences and strength of recommendations. Our study established a set of methods and processes for the rapid review of World Health Organization Essential Medicine List peer review, and our findings were used to guide the reviewers to fulfill the 19(th) World Health Organization Essential Medicine List peer review. The methods and processes were feasible and met the necessary requirements in terms of time and quality. Continuous improvement and evaluation in practice are warranted. © 2015 Chinese Cochrane Center, West China Hospital of Sichuan University and Wiley Publishing Asia Pty Ltd.

Validity of peer grading using Calibrated Peer Review in a guided-inquiry, conceptual physics course

NASA Astrophysics Data System (ADS)

Price, Edward; Goldberg, Fred; Robinson, Steve; McKean, Michael

2016-12-01

Constructing and evaluating explanations are important science practices, but in large classes it can be difficult to effectively engage students in these practices and provide feedback. Peer review and grading are scalable instructional approaches that address these concerns, but which raise questions about the validity of the peer grading process. Calibrated Peer Review (CPR) is a web-based system that scaffolds peer evaluation through a "calibration" process where students evaluate sample responses and receive feedback on their evaluations before evaluating their peers. Guided by an activity theory framework, we developed, implemented, and evaluated CPR-based tasks in guided-inquiry, conceptual physics courses for future teachers and general education students. The tasks were developed through iterative testing and revision. Effective tasks had specific and directed prompts and evaluation instructions. Using these tasks, over 350 students at three universities constructed explanations or analyzed physical phenomena, and evaluated their peers' work. By independently assessing students' responses, we evaluated the CPR calibration process and compared students' peer reviews with expert evaluations. On the tasks analyzed, peer scores were equivalent to our independent evaluations. On a written explanation item included on the final exam, students in the courses using CPR outperformed students in similar courses using traditional writing assignments without a peer evaluation element. Our research demonstrates that CPR can be an effective way to explicitly include the science practices of constructing and evaluating explanations into large classes without placing a significant burden on the instructor.

IRIS Toxicological Review of Dichloromethane (Methylene Chloride) (Interagency Science Consultation Draft)

EPA Science Inventory

On March 31, 2010, the draft IRIS Toxicological Review of Dichloromethane (Methylene Chloride) external review draft document and the charge to external peer reviewers were released for public review and comment. The draft document and the charge to external peer reviewers were r...

IRIS TOXICOLOGICAL REVIEW OF HEXAVALENT CHROMIUM (INTERAGENCY SCIENCE CONSULTATION DRAFT)

EPA Science Inventory

On Septemeber 30, 2010, the draft Toxicological Review of Hexavalent Chromium and the charge to external peer reviewers were released for external peer review and public comment. The Toxicological Review and charge were reviewed internally by EPA and by other federal agenc...

IRIS Toxicological Review of Libby Amphibole Asbestos (Interagency Science Consultation Draft)

EPA Science Inventory

On August 25, 2011, the draft Toxicological Review of Libby Amphibole Asbestos and the charge to external peer reviewers were released for external peer review and public comment. The Toxicological Review and charge were reviewed internally by EPA and by other federal agencies an...

IRIS Toxicological Review of Urea (Interagency Science Consultation Draft)

EPA Science Inventory

On September 28, 2010, the Toxicological Review of Urea and the charge to external peer reviewers were released for external peer review and public comment. The Toxicological Review and charge were reviewed internally by EPA and by other federal agencies and White House Of...

IRIS Toxicological Review of Ammonia (Interagency Science Consultation Draft)

EPA Science Inventory

On June 1, 2012, the draft Toxicological Review of Ammonia and the draft charge to external peer reviewers were released for external peer review and public comment. The Toxicological Review and charge were reviewed internally by EPA and by other federal agencies and White House ...

IRIS Toxicological Review of Vanadium Pentoxide (Interagency Science Consultation Draft)

EPA Science Inventory

On September 30, 2011, the draft Toxicological Review of Vanadium Pentoxide and the charge to external peer reviewers were released for external peer review and public comment. The Toxicological Review and charge were reviewed internally by EPA and by other federal agencies and W...

IRIS Toxicological Review of Tert-Butyl Alcohol (Tert-Butanol) ...

EPA Pesticide Factsheets

The IRIS Toxicological Review of tert-Butyl Alcohol (tert-Butanol) was released for external peer review in June 2017. EPA’s Science Advisory Board’s (SAB) Chemical Assessment Advisory Committee (CAAC) will conduct a peer review of the scientific basis supporting the tert-butanol assessment and release a final report of their review. Information regarding the peer review can be found on the SAB website. EPA is conducting an Integrated Risk Information System (IRIS) health assessment for tert-butanol. The outcome of this project is a Toxicological Review and IRIS Summary for tert-butanol that will be entered into the IRIS database.

Beyond Homophily: A Decade of Advances in Understanding Peer Influence Processes.

PubMed

Brechwald, Whitney A; Prinstein, Mitchell J

2011-03-01

This article reviews empirical and theoretical contributions to a multidisciplinary understanding of peer influence processes in adolescence over the past decade. Five themes of peer influence research from this decade were identified, including a broadening of the range of behaviors for which peer influence occurs, distinguishing the sources of influence, probing the conditions under which influence is amplified/attenuated (moderators), testing theoretically based models of peer influence processes (mechanisms), and preliminary exploration of behavioral neuroscience perspectives on peer influence. This review highlights advances in each of these areas, underscores gaps in current knowledge of peer influence processes, and outlines important challenges for future research.

Beyond Homophily: A Decade of Advances in Understanding Peer Influence Processes

PubMed Central

Brechwald, Whitney A.; Prinstein, Mitchell J.

2013-01-01

This article reviews empirical and theoretical contributions to a multidisciplinary understanding of peer influence processes in adolescence over the past decade. Five themes of peer influence research from this decade were identified, including a broadening of the range of behaviors for which peer influence occurs, distinguishing the sources of influence, probing the conditions under which influence is amplified/attenuated (moderators), testing theoretically based models of peer influence processes (mechanisms), and preliminary exploration of behavioral neuroscience perspectives on peer influence. This review highlights advances in each of these areas, underscores gaps in current knowledge of peer influence processes, and outlines important challenges for future research. PMID:23730122

Assessing Postgraduate Student Perceptions and Measures of Learning in a Peer Review Feedback Process

ERIC Educational Resources Information Center

Simpson, Genevieve; Clifton, Julian

2016-01-01

Peer review feedback, developed to assist students with increasing the quality of group reports and developing peer review skills, was added to a master's level Climate Change Policy and Planning unit. A pre- and post-survey was conducted to determine whether students found the process a valuable learning opportunity: 87% of students responding to…

The Effect of Peer Review on Student Learning Outcomes in a Research Methods Course

ERIC Educational Resources Information Center

Crowe, Jessica A.; Silva, Tony; Ceresola, Ryan

2015-01-01

In this study, we test the effect of in-class student peer review on student learning outcomes using a quasiexperimental design. We provide an assessment of peer review in a quantitative research methods course, which is a traditionally difficult and technical course. Data were collected from 170 students enrolled in four sections of a…

Using Peer Reviews to Examine Micropolitics and Disciplinary Development of Engineering Education: A Case Study

ERIC Educational Resources Information Center

Beddoes, Kacey

2014-01-01

This article presents a case study of the peer review process for a feminist article submitted to an engineering education journal. It demonstrates how an examination of peer review can be a useful approach to further understanding the development of feminist thought in education fields. Rather than opposition to feminist thought per se, my…

Adding Value to the Learning Process by Online Peer Review Activities: Towards the Elaboration of a Methodology to Promote Critical Thinking in Future Engineers

ERIC Educational Resources Information Center

Dominguez, Caroline; Nascimento, Maria M.; Payan-Carreira, Rita; Cruz, Gonçalo; Silva, Helena; Lopes, José; Morais, Maria da Felicidade A.; Morais, Eva

2015-01-01

Considering the results of research on the benefits and difficulties of peer review, this paper describes how teaching faculty, interested in endorsing the acquisition of communication and critical thinking (CT) skills among engineering students, has been implementing a learning methodology throughout online peer review activities. While…

Accelerating Educational Innovation in the MPH Degree Program: What Is the Role of Peer Review of Teaching?

ERIC Educational Resources Information Center

Vian, Taryn; Ashigbie, Paul G.

2015-01-01

Purpose: The environment of public health practice is rapidly changing, creating the need to adapt graduate education and accelerate educational innovation. Formative peer review is a strategy designed to promote critical reflection on teaching and to develop faculty as teachers. Through case study methods, we explore how peer review of teaching…

Issues in Peer Review of the Scientific Basis for Regulatory Decisions.

ERIC Educational Resources Information Center

American Chemical Society, Washington, DC.

This document is intended to provide a discussion of the issues that need to be addressed in the development of peer review guidelines, the options for addressing the issues, and a range of views about such options. The document focuses on peer review with regard to regulatory decisions and contains major sections which deal with: (1) what should…

Investigating Peer Review as an Intentional Learning Strategy to Foster Collaborative Knowledge-Building in Students of Instructional Design

ERIC Educational Resources Information Center

Brill, Jennifer M.; Hodges, Charles B.

2011-01-01

Peer review has been advocated for as an intentional strategy to support the knowledge and skill attainment of adult learners preparing for professional practice, including those students preparing for instructional design and technology practice. The purposes of this article are to discuss the practical application of peer review as an…

Peer Review and the Dilemmas of Quality Control in Programme Accreditation in South African Higher Education: Challenges and Possibilities

ERIC Educational Resources Information Center

Cross, Michael; Naidoo, Devika

2011-01-01

The paper scrutinises the dynamics and the nature of peer review in the programme evaluation and accreditation process within the context of diverse individual and institutional legacies in South Africa. It analyses the peer review process and highlights the contestation at political, policy and epistemological levels. The paper argues that,…

The Multiple Faces of Peer Review in Higher Education. Five Learning Scenarios Developed for Digital Business

ERIC Educational Resources Information Center

Herzog, Michael A.; Katzlinger, Elisabeth

2017-01-01

Peer review, as an e-assessment tool incorporates the human factor to treat complexity for rating and grading students. It could address the qualitative more than quantitative aspects with flexible human feedback that leads up to metacognitive knowledge aspects, which e-assessment usually is not able to achieve. Peer review is an internationally…

Teaching Assistants in Inclusive Classrooms: A Systematic Analysis of the International Research

ERIC Educational Resources Information Center

Sharma, Umesh; Salend, Spencer J.

2016-01-01

This article reviewed international data from English-language peer-reviewed studies on the use of TAs in inclusive classrooms from the past 10 years concerning: (a) the roles of TAs; (b) the impact of TAs on students, educators, and inclusive education; and (c) the factors that influence the performance of TAs. These studies suggest that unclear…

Bristol Bay Assessment – Supplemental Peer Review Reports ...

EPA Pesticide Factsheets

These reports represent the results of independent peer reviews of several technical reports submitted to the public docket for the May 2012 draft of the Bristol Bay Assessment, An Assessment of Potential Mining Impacts on Salmon Ecosystems of Bristol Bay, Alaska. Background In May 2012, the U.S. Environmental Protection Agency (USEPA) released the draft assessment entitled An Assessment of Potential Mining Impacts on Salmon Ecosystems of Bristol Bay, Alaska, or the Bristol Bay Assessment. The purpose of the assessment is to provide a characterization of the biological and mineral resources of the Bristol Bay watershed, increase understanding of the potential impacts of large-scale mining on the region’s fish resources, and inform future governmental decisions. During the public comment period for the May 2012 draft, numerous technical reports were submitted to the public docket. The USEPA identified several of these reports as providing information about issues raised by the peer reviewers, but the reports did not show evidence of prior peer review. The USEPA made arrangements for a contractor to conduct independent peer reviews of seven such reports. The reports and the results of these supplemental peer reviews are provided here to document that the reports are of

A Retrospective Performance Assessment of the Developmental Neurotoxicity Study in Support of OECD Test Guideline 426

PubMed Central

Makris, Susan L.; Raffaele, Kathleen; Allen, Sandra; Bowers, Wayne J.; Hass, Ulla; Alleva, Enrico; Calamandrei, Gemma; Sheets, Larry; Amcoff, Patric; Delrue, Nathalie; Crofton, Kevin M.

2009-01-01

Objective We conducted a review of the history and performance of developmental neurotoxicity (DNT) testing in support of the finalization and implementation of Organisation of Economic Co-operation and Development (OECD) DNT test guideline 426 (TG 426). Information sources and analysis In this review we summarize extensive scientific efforts that form the foundation for this testing paradigm, including basic neurotoxicology research, interlaboratory collaborative studies, expert workshops, and validation studies, and we address the relevance, applicability, and use of the DNT study in risk assessment. Conclusions The OECD DNT guideline represents the best available science for assessing the potential for DNT in human health risk assessment, and data generated with this protocol are relevant and reliable for the assessment of these end points. The test methods used have been subjected to an extensive history of international validation, peer review, and evaluation, which is contained in the public record. The reproducibility, reliability, and sensitivity of these methods have been demonstrated, using a wide variety of test substances, in accordance with OECD guidance on the validation and international acceptance of new or updated test methods for hazard characterization. Multiple independent, expert scientific peer reviews affirm these conclusions. PMID:19165382

Healthcare system intervention for prevention of birth injuries – process evaluation of self-assessment, peer review, feedback and agreement for change

PubMed Central

2012-01-01

Background Patient safety is fundamental in high quality healthcare systems but despite an excellent record of perinatal care in Sweden some children still suffer from substandard care and unnecessary birth injuries. Sustainable patient safety improvements assume changes in key actors’ mental models, norms and culture as well as in the tools, design and organisation of work. Interventions positively affecting team mental models on safety issues are a first step to enhancing change. Our purpose was to study a national intervention programme for the prevention of birth injuries with the aim to elucidate how the main interventions of self-assessment, peer review, feedback and written agreement for change affected the teams and their mental model of patient safety, and thereby their readiness for change. Knowledge of relevant considerations before implementing this type of patient safety intervention series could thereby be increased. Methods Eighty participants in twenty-seven maternity units were interviewed after the first intervention sequence of the programme. A content analysis using a priori coding was performed in order to relate results to the anticipated outcomes of three basic interventions: self-assessment, peer review and written feedback, and agreement for change. Results The self-assessment procedure was valuable and served as a useful tool for elucidating strengths and weaknesses and identifying areas for improvement for a safer delivery in maternity units. The peer-review intervention was appreciated, despite it being of less value when considering the contribution to explicit outcome effects (i.e. new input to team mental models and new suggestions for actions). The feedback report and the mutual agreement on measures for improvements reached when signing the contract seemed exert positive pressures for change. Conclusions Our findings are in line with several studies stressing the importance of self-evaluation by encouraging a thorough review of objectives, practices and outcomes for the continuous improvement of an organisation. Even though effects of the peer review were limited, feedback from peers, or other change agents involved, and the support that a clear and well-structured action plan can provide are considered to be two important complements to future self-assessment procedures related to patient safety improvement. PMID:22920327

Learning from peer support schemes--can prison listeners support offenders who self-injure in custody?

PubMed

Griffiths, Louise; Bailey, Di

2015-01-01

The purpose of this paper is to critically evaluate the current evidence for peer support in prisons, in particular its contribution to working with prisoners who self-injure and the extent to which the success of peer support schemes such as the prison listeners, hinges upon staff's willingness to engage with the initiative. The review was constructed by using primary and secondary terms to search the literature. The studies focused on peer support in custody with reference to mental health and self-injury. Searches identified papers on the prison listener scheme and staff perspectives on prison peer support, as these formed a central focus of the review. Studies were excluded from the review if the participants' behaviours was explicitly linked to suicidal intent, as the review focused on self-injury as a coping strategy. A total of 24 studies were selected according to specific inclusion criteria (six were grey literature, 18 academic literature). Of the 24 studies ten studies focused on peer support and self-injury. Of the 24 studies the listener scheme was the focus of 16 studies, of these 16 studies self-injury and the listener scheme was a focus of eight studies. Evidence from the review suggests that prison peer support could be considered on a continuum depending on the different degrees of peer involvement.

Peer review and competition in the Art Exhibition Game.

PubMed

Balietti, Stefano; Goldstone, Robert L; Helbing, Dirk

2016-07-26

To investigate the effect of competitive incentives under peer review, we designed a novel experimental setup called the Art Exhibition Game. We present experimental evidence of how competition introduces both positive and negative effects when creative artifacts are evaluated and selected by peer review. Competition proved to be a double-edged sword: on the one hand, it fosters innovation and product diversity, but on the other hand, it also leads to more unfair reviews and to a lower level of agreement between reviewers. Moreover, an external validation of the quality of peer reviews during the laboratory experiment, based on 23,627 online evaluations on Amazon Mechanical Turk, shows that competition does not significantly increase the level of creativity. Furthermore, the higher rejection rate under competitive conditions does not improve the average quality of published contributions, because more high-quality work is also rejected. Overall, our results could explain why many ground-breaking studies in science end up in lower-tier journals. Differences and similarities between the Art Exhibition Game and scholarly peer review are discussed and the implications for the design of new incentive systems for scientists are explained.

IRIS Toxicological Review of cis- & trans-1,2-Dichloroethylene (Interagency Science Consultation Draft)

EPA Science Inventory

On September 24, 2009, the Toxicological Review of cis- and trans-1,2-dichloroethylene and the charge to external peer reviewers were released for external peer review and public comment. The Toxicological Review and charge were reviewed internally by EPA and by other federal ag...

7 CFR 3400.14 - Proposal review.

Code of Federal Regulations, 2011 CFR

2011-01-01

... RESEARCH GRANTS PROGRAM Scientific Peer Review of Research Grant Applications § 3400.14 Proposal review. (a... review will be made for responsiveness to the request for proposals (e.g., relationship of application to... peer review group, and ad hoc reviewers, as required. Written comments will be solicited from ad hoc...

Improving Geoscience Learning and Increasing Student Engagement Using Online Interactive Writing Assignments with Calibrated Peer Review.

NASA Astrophysics Data System (ADS)

Harbor, Jon

2014-05-01

Peer review is a hallmark of the publication process for scientific research, yet it is rarely used as a pedagogical approach in university geoscience courses. Learning outcomes for university geoscience courses include content knowledge and critical thinking and analysis skills, and often include written communication of scientific issues or concepts. Because lecture and memorization is not the most effective learning approach for many students, instructors are increasingly exploring teaching approaches that involve active engagement. In this context, writing assignments that engage students in using content, constructing arguments, and critiquing other students' work are highly desirable. However, many of us struggle with extensive writing requirements in our courses because the workload associated with having the instructor provide detailed comments on writing is daunting, especially in large-enrollment courses, and organizing effective peer review by students is very challenging. Calibrated Peer Review (CPR) is a web-based program that involves students in writing and in reviewing each other's writing. It is designed to allow for more involved writing and feedback experiences with much less instructor time. Here we report on the results of a qualitative-methods analysis of narrative survey responses from students using CPR in an introductory geoscience class. In addition to an impact on the students' writing and their understanding of what goes in to effective writing, the results indicate that CPR acted as reinforcement for content learning, and an impetus for gaining a deeper understanding of content material. It allowed students to see how other students explained and analyzed content, and to check their understanding of a topic in relation to other students in the class. Not surprisingly, the instructor reported that students performed far better on exam questions that tested knowledge covered by CPR assignments.

IRIS Toxicological Review of Mirex (2003 External Review Draft)

EPA Science Inventory

EPA is providing for public information a draft Toxicological Review, draft IRIS Summary, and charge to external peer reviewers for EPA's Health Assessment of Mirex. These documents are provided for public viewing during an external scientific peer review period. While EPA is not...

Impacts of a Course-based Undergraduate Research Experience in Introductory Astronomy Using Robotic Telescopes

NASA Astrophysics Data System (ADS)

Dobaria, Archana S.; Coble, Kimberly A.; Alejandra, Le; Berryhill, Katie; McLin, Kevin M.; Cominsky, Lynn R.

2018-06-01

As part of a general education undergraduate astronomy course at a minority-serving university in the Midwestern US, students completed an observing project with the Global Telescope Network (GTN), where they participated in realistic practices used by professional astronomers, including proposal writing and peer review. First, students went through the process of applying for telescope time by choosing an astronomical object and writing an observing proposal. Then they performed an NSF-style review of classmates’ proposals, including written peer reviews and a review panel. After obtaining images from GTN telescopes, students presented their project and findings in front of the class.This study investigates students’ experiences and perceived impacts of participation in the project. The data analyzed includes an essay assignment [N = 59] administered over seven semesters and individual interviews [N = 8] collected over two semesters. Students were prompted to address what they liked, disliked, or would change about the project experience. These data were coded iteratively into nine categories. A Kruskal-Wallis (KW) test was used to determine that essay results from different semesters could be combined. We find that students expressed an overall strong positive affect, increased perception of self-efficacy, enjoyment of the experience of peer review, an appreciation for being able to use real scientific tools and to take on the role of astronomers, as well as a small number of dislikes such as real-world constraints on observing.

Process modeling and bottleneck mining in online peer-review systems.

PubMed

Premchaiswadi, Wichian; Porouhan, Parham

2015-01-01

This paper is divided into three main parts. In the first part of the study, we captured, collected and formatted an event log describing the handling of reviews for proceedings of an international conference in Thailand. In the second part, we used several process mining techniques in order to discover process models, social, organizational, and hierarchical structures from the proceeding's event log. In the third part, we detected the deviations and bottlenecks of the peer review process by comparing the observed events (i.e., authentic dataset) with a pre-defined model (i.e., master map). Finally, we investigated the performance information as well as the total waiting time in order to improve the effectiveness and efficiency of the online submission and peer review system for the prospective conferences and seminars. Consequently, the main goals of the study were as follows: (1) to convert the collected event log into the appropriate format supported by process mining analysis tools, (2) to discover process models and to construct social networks based on the collected event log, and (3) to find deviations, discrepancies and bottlenecks between the collected event log and the master pre-defined model. The results showed that although each paper was initially sent to three different reviewers; it was not always possible to make a decision after the first round of reviewing; therefore, additional reviewers were invited. In total, all the accepted and rejected manuscripts were reviewed by an average of 3.9 and 3.2 expert reviewers, respectively. Moreover, obvious violations of the rules and regulations relating to careless or inappropriate peer review of a manuscript-committed by the editorial board and other staff-were identified. Nine blocks of activity in the authentic dataset were not completely compatible with the activities defined in the master model. Also, five of the activity traces were not correctly enabled, and seven activities were missed within the online submission system. On the other hand, dealing with the feedback (comments) received from the first and the third reviewers; the conference committee members and the organizers did not attend to those feedback/comments in a timely manner.

High Performance Computer Cluster for Theoretical Studies of Roaming in Chemical Reactions

DTIC Science & Technology

2016-08-30

High-performance Computer Cluster for Theoretical Studies of Roaming in Chemical Reactions A dedicated high-performance computer cluster was...SPONSORING/MONITORING AGENCY NAME(S) AND ADDRESS (ES) U.S. Army Research Office P.O. Box 12211 Research Triangle Park, NC 27709-2211 Computer cluster ...peer-reviewed journals: Final Report: High-performance Computer Cluster for Theoretical Studies of Roaming in Chemical Reactions Report Title A dedicated

A Multiple Use MF/HF Radio Array for Radio Research, Development, and Education

DTIC Science & Technology

2016-04-27

reviewed journals: Number of Papers published in non peer-reviewed journals: Final Report: A Multiple Use MF/HF Radio Array for Radio Research , Development...inspiring high school and university- level student projects. (a) Papers published in peer-reviewed journals (N/A for none) Enter List of papers ...references, in the following categories: (b) Papers published in non-peer-reviewed journals (N/A for none) An MF/HF antenna array for radio and radar imaging

Multisource Feedback in the Ambulatory Setting

PubMed Central

Warm, Eric J.; Schauer, Daniel; Revis, Brian; Boex, James R.

2010-01-01

Background The Accreditation Council for Graduate Medical Education has mandated multisource feedback (MSF) in the ambulatory setting for internal medicine residents. Few published reports demonstrate actual MSF results for a residency class, and fewer still include clinical quality measures and knowledge-based testing performance in the data set. Methods Residents participating in a year-long group practice experience called the “long-block” received MSF that included self, peer, staff, attending physician, and patient evaluations, as well as concomitant clinical quality data and knowledge-based testing scores. Residents were given a rank for each data point compared with peers in the class, and these data were reviewed with the chief resident and program director over the course of the long-block. Results Multisource feedback identified residents who performed well on most measures compared with their peers (10%), residents who performed poorly on most measures compared with their peers (10%), and residents who performed well on some measures and poorly on others (80%). Each high-, intermediate-, and low-performing resident had a least one aspect of the MSF that was significantly lower than the other, and this served as the basis of formative feedback during the long-block. Conclusion Use of multi-source feedback in the ambulatory setting can identify high-, intermediate-, and low-performing residents and suggest specific formative feedback for each. More research needs to be done on the effect of such feedback, as well as the relationships between each of the components in the MSF data set. PMID:21975632

Assessing the Academic, Social, and Language Production Outcomes of English Language Learners Engaged in Peer Tutoring: A Systematic Review

ERIC Educational Resources Information Center

Bowman-Perrott, Lisa; deMarín, Sharon; Mahadevan, Lakshmi; Etchells, Matthew

2016-01-01

Peer tutoring is an instructional strategy that allows students to help one another learn content material through the repetition of key concepts. In more than 40 years of published studies, literature reviews, and meta-analyses of peer tutoring, this quantitative synthesis of the literature is the first to examine the impact of peer tutoring on…

On the Effectiveness of Supplemental Instruction: A Systematic Review of Supplemental Instruction and Peer-Assisted Study Sessions Literature between 2001 and 2010

ERIC Educational Resources Information Center

Dawson, Phillip; van der Meer, Jacques; Skalicky, Jane; Cowley, Kym

2014-01-01

Supplemental instruction (SI)--variously known as peer-assisted learning, peer-assisted study sessions, and other names--is a type of academic support intervention popular in higher education. In SI sessions, a senior student facilitates peer learning between undergraduates studying a high-risk course. This article presents a systematic review of…

Behind the Spam: A "Spectral Analysis" of Predatory Publishers

NASA Astrophysics Data System (ADS)

Beall, Jeffrey

2015-08-01

Most researchers today are bombarded with spam email solicitations from questionable scholarly publishers. These emails solicit article manuscripts, editorial board service, and even ad hoc peer reviews. These "predatory" publishers exploit the scholarly publishing process, patterning themselves after legitimate scholarly publishers yet performing little or no peer review and quickly accepting submitted manuscripts and collecting fees from submitting authors. These counterfeit publishers and journals have published much junk science — especially in the field of cosmology — threatening the integrity of the academic record. This presentation examines the current state of predatory publishing and related scams such as fake impact factors and advises researchers how to navigate scholarly publishing to best avoid predatory publishers and other scholarly publishing-related perils.

42 CFR 67.103 - Peer review of contract proposals.

Code of Federal Regulations, 2010 CFR

2010-10-01

... 67.103 Public Health PUBLIC HEALTH SERVICE, DEPARTMENT OF HEALTH AND HUMAN SERVICES FELLOWSHIPS, INTERNSHIPS, TRAINING AGENCY FOR HEALTH CARE POLICY AND RESEARCH GRANTS AND CONTRACTS Peer Review of Contracts for Health Services Research, Evaluation, Demonstration, and Dissemination Projects § 67.103 Peer...

Fairness in peer review

NASA Astrophysics Data System (ADS)

Adams, Bob

2014-06-01

In reply to Penny Gowland's article “Turning a double-blind eye” (Forum, May p17), which argued that a paper's authors, as well as its reviewers, should be anonymous during the peer-review process.

Argument-Driven Inquiry: Using the Laboratory to Improve Undergraduates' Science Writing Skills through Meaningful Science Writing, Peer-Review, and Revision

ERIC Educational Resources Information Center

Walker, Joi Phelps; Sampson, Victor

2013-01-01

This paper presents preliminary evidence supporting the use of peer review in undergraduate science as a means to improve student writing and to alleviate barriers, such as lost class time, by incorporation of the peer-review process into the laboratory component of the course. The study was conducted in a single section of an undergraduate…

A Case Study of Peer Review Practices of Four Adolescent English Language Learners in Face-to-Face and Online Contexts

ERIC Educational Resources Information Center

Vorobel, Oksana

2013-01-01

Peer review is a complex collaborative activity, which may engage English language learners in reading, writing, listening, and speaking and carry many potential benefits for their language learning (Hu, 2005). While many research studies focused on peer review practices of adult language learners in academic settings in the USA or abroad in…

Most Courses Are Not Born Digital: An Overview of the Quality Matters Peer Review Process for Online Course Design

ERIC Educational Resources Information Center

Varonis, Evageline Marlos

2014-01-01

Purpose: The purpose of this paper is to discuss benefits of and barriers to online learning and describe utilization of the Quality Matters (QM) peer review process as a method to assure the quality of online courses. It outlines the QM higher education rubric, explains how the collaborative QM peer review process facilitates online course design…

IRIS Toxicological Review of Benzo[a]pyrene (External Review Draft)

EPA Science Inventory

The IRIS Toxicological Review of Benzo[a]pyrene was released for external peer review in September 2014. The EPA’s Science Advisory Board’s (SAB) Chemical Assessment Advisory Committee (CAAC) conducted a peer review of the scientific basis supporting the benzo[a]pyrene assessmen...

7 CFR 3400.14 - Proposal review.

Code of Federal Regulations, 2012 CFR

2012-01-01

... RESEARCH GRANTS PROGRAM Scientific Peer Review of Research Grant Applications § 3400.14 Proposal review. (a... review will be made for responsiveness to the request for proposals (e.g., relationship of application to... carefully reviewed by the Director, qualified officers or employees of the Department, the respective peer...

7 CFR 3400.14 - Proposal review.

Code of Federal Regulations, 2014 CFR

2014-01-01

... RESEARCH GRANTS PROGRAM Scientific Peer Review of Research Grant Applications § 3400.14 Proposal review. (a... review will be made for responsiveness to the request for proposals (e.g., relationship of application to... carefully reviewed by the Director, qualified officers or employees of the Department, the respective peer...