Blog Comments vs. Peer Review: Which Way Makes a Book Better?

ERIC Educational Resources Information Center

Young, Jeffrey R.

2008-01-01

What if scholarly books were peer reviewed by anonymous blog comments rather than by traditional, selected peer reviewers? This is the question posed by an unusual experiment that was started recently by Noah Wardrip-Fruin, an an assistant professor of communication at the University of California at San Diego. His experiment was started after his…

Medical students-as-teachers: a systematic review of peer-assisted teaching during medical school

PubMed Central

Yu, Tzu-Chieh; Wilson, Nichola C; Singh, Primal P; Lemanu, Daniel P; Hawken, Susan J; Hill, Andrew G

2011-01-01

Introduction International interest in peer-teaching and peer-assisted learning (PAL) during undergraduate medical programs has grown in recent years, reflected both in literature and in practice. There, remains however, a distinct lack of objective clarity and consensus on the true effectiveness of peer-teaching and its short- and long-term impacts on learning outcomes and clinical practice. Objective To summarize and critically appraise evidence presented on peer-teaching effectiveness and its impact on objective learning outcomes of medical students. Method A literature search was conducted in four electronic databases. Titles and abstracts were screened and selection was based on strict eligibility criteria after examining full-texts. Two reviewers used a standard review and analysis framework to independently extract data from each study. Discrepancies in opinions were resolved by discussion in consultation with other reviewers. Adapted models of “Kirkpatrick’s Levels of Learning” were used to grade the impact size of study outcomes. Results From 127 potential titles, 41 were obtained as full-texts, and 19 selected after close examination and group deliberation. Fifteen studies focused on student-learner outcomes and four on student-teacher learning outcomes. Ten studies utilized randomized allocation and the majority of study participants were self-selected volunteers. Written examinations and observed clinical evaluations were common study outcome assessments. Eleven studies provided student-teachers with formal teacher training. Overall, results suggest that peer-teaching, in highly selective contexts, achieves short-term learner outcomes that are comparable with those produced by faculty-based teaching. Furthermore, peer-teaching has beneficial effects on student-teacher learning outcomes. Conclusions Peer-teaching in undergraduate medical programs is comparable to conventional teaching when utilized in selected contexts. There is evidence to suggest that participating student-teachers benefit academically and professionally. Long-term effects of peer-teaching during medical school remain poorly understood and future research should aim to address this. PMID:23745087

Impact of interventions to improve the quality of peer review of biomedical journals: a systematic review and meta-analysis.

PubMed

Bruce, Rachel; Chauvin, Anthony; Trinquart, Ludovic; Ravaud, Philippe; Boutron, Isabelle

2016-06-10

The peer review process is a cornerstone of biomedical research. We aimed to evaluate the impact of interventions to improve the quality of peer review for biomedical publications. We performed a systematic review and meta-analysis. We searched CENTRAL, MEDLINE (PubMed), Embase, Cochrane Database of Systematic Reviews, and WHO ICTRP databases, for all randomized controlled trials (RCTs) evaluating the impact of interventions to improve the quality of peer review for biomedical publications. We selected 22 reports of randomized controlled trials, for 25 comparisons evaluating training interventions (n = 5), the addition of a statistical peer reviewer (n = 2), use of a checklist (n = 2), open peer review (i.e., peer reviewers informed that their identity would be revealed; n = 7), blinded peer review (i.e., peer reviewers blinded to author names and affiliation; n = 6) and other interventions to increase the speed of the peer review process (n = 3). Results from only seven RCTs were published since 2004. As compared with the standard peer review process, training did not improve the quality of the peer review report and use of a checklist did not improve the quality of the final manuscript. Adding a statistical peer review improved the quality of the final manuscript (standardized mean difference (SMD), 0.58; 95 % CI, 0.19 to 0.98). Open peer review improved the quality of the peer review report (SMD, 0.14; 95 % CI, 0.05 to 0.24), did not affect the time peer reviewers spent on the peer review (mean difference, 0.18; 95 % CI, -0.06 to 0.43), and decreased the rate of rejection (odds ratio, 0.56; 95 % CI, 0.33 to 0.94). Blinded peer review did not affect the quality of the peer review report or rejection rate. Interventions to increase the speed of the peer review process were too heterogeneous to allow for pooling the results. Despite the essential role of peer review, only a few interventions have been assessed in randomized controlled trials. Evidence-based peer review needs to be developed in biomedical journals.

The evolution of peer review as a basis for scientific publication: directional selection towards a robust discipline?

PubMed

Ferreira, Catarina; Bastille-Rousseau, Guillaume; Bennett, Amanda M; Ellington, E Hance; Terwissen, Christine; Austin, Cayla; Borlestean, Adrian; Boudreau, Melanie R; Chan, Kevin; Forsythe, Adrian; Hossie, Thomas J; Landolt, Kristen; Longhi, Jessica; Otis, Josée-Anne; Peers, Michael J L; Rae, Jason; Seguin, Jacob; Watt, Cristen; Wehtje, Morgan; Murray, Dennis L

2016-08-01

Peer review is pivotal to science and academia, as it represents a widely accepted strategy for ensuring quality control in scientific research. Yet, the peer-review system is poorly adapted to recent changes in the discipline and current societal needs. We provide historical context for the cultural lag that governs peer review that has eventually led to the system's current structural weaknesses (voluntary review, unstandardized review criteria, decentralized process). We argue that some current attempts to upgrade or otherwise modify the peer-review system are merely sticking-plaster solutions to these fundamental flaws, and therefore are unlikely to resolve them in the long term. We claim that for peer review to be relevant, effective, and contemporary with today's publishing demands across scientific disciplines, its main components need to be redesigned. We propose directional changes that are likely to improve the quality, rigour, and timeliness of peer review, and thereby ensure that this critical process serves the community it was created for. © 2015 Cambridge Philosophical Society.

Systematic review of social network analysis in adolescent cigarette smoking behavior.

PubMed

Seo, Dong-Chul; Huang, Yan

2012-01-01

Social networks are important in adolescent smoking behavior. Previous research indicates that peer context is a major causal factor of adolescent smoking behavior. To date, however, little is known about the influence of peer group structure on adolescent smoking behavior. Studies that examined adolescent social networks with regard to their cigarette smoking behavior were identified through online and manual literature searches. Ten social network analysis studies involving a total of 28,263 adolescents were included in the final review. Of the 10 reviewed studies, 6 identify clique members, liaisons, and isolates as contributing factors to adolescent cigarette smoking. Significantly higher rates of smoking are noted among isolates than clique members or liaisons in terms of peer network structure. Eight of the reviewed studies indicate that peer selection or influence precedes adolescents' smoking behavior and intent to smoke. Such peer selection or influence accounts for a large portion of similarities among smoking adolescents. Adolescents who are identified as isolates are more likely to smoke and engage in risk-taking behaviors than others in the peer network structure. Given that the vast majority of current adult smokers started their smoking habits during adolescence, adolescent smoking prevention efforts will likely benefit from incorporating social network analytic approaches and focusing the efforts on isolates and other vulnerable adolescents from a peer selection and influence perspective. © 2011, American School Health Association.

A Case Study to Examine Peer Grouping and Aspirant Selection. Professional File. Article 132, Fall 2013

ERIC Educational Resources Information Center

D'Allegro, Mary Lou; Zhou, Kai

2013-01-01

Peer selection based on the similarity of a couple of institutional parameters, by itself, is insufficient. Several other considerations, including clarity of purpose, alignment of institutional information to that purpose, identification of appropriate statistical procedures, review of preliminary peer sets, and the application of additional…

Engineered Resilient Systems: A DoD Perspective

DTIC Science & Technology

2014-01-01

Selection and peer-review under responsibility of the University of Southern California. doi: 10.1016/j.procs.2014.03.103 ScienceDirect Conference...Selection and peer-review under responsibility of the University of Southern California. Keywords:rResilience, decision analysis, ERS, Engineered...Michael Sievers, Jet Propulsion Laboratory; Marilee Wheaton, The Aerospace Corporation Redondo Beach, CA, March 21-22, 2014 Engineered Resilient

Evaluation for the Allocation of University Research Project Funding: Can Rules Improve the Peer Review?

ERIC Educational Resources Information Center

Reale, Emanuela; Zinilli, Antonio

2017-01-01

Evaluation for the allocation of project-funding schemes devoted to sustain academic research often undergoes changes of the rules for the ex-ante selection, which are supposed to improve the capability of peer review to select the best proposals. How modifications of the rules realize a more accountable evaluation result? Do the changes suggest…

A narrative review of undergraduate peer-based healthcare ethics teaching.

PubMed

Hindmarch, Thomas; Allikmets, Silvia; Knights, Felicity

2015-12-12

This study explores the literature in establishing the value of undergraduate peer-based healthcare ethics teaching as an educational methodology. A narrative review of the literature concerning peer-based ethics teaching was conducted. MEDLINE, EMBASE, CINAHL, SCOPUS databases, and the Cochrane Library, were systematically searched for studies of peer-based ethics or professionalism teaching. Selected studies related peer-based teaching to ethics education outcomes. Ten publications were identified. Selected studies were varied in their chosen intervention methodology and analysis. Collectively, the identified studies suggest peer-based ethics education is an effective and valued educational methodology in training healthcare professionals. One paper suggests peer-based ethics teaching has advantages over traditional didactic methods. Peer-based ethics teaching also receives positive feedback from student participants. However, the limited literature base demonstrates a clear need for more evaluation of this pedagogy. The current literature base suggests that undergraduate peer based healthcare ethics teaching is valuable in terms of efficacy and student satisfaction. We conclude that the medical community should invest in further study in order to capitalise upon the potential of peer-based ethics teaching in undergraduate healthcare education.

Changing the Peer Review or Changing the Peers--Recent Development in Assessment of Large Research Collaborations

ERIC Educational Resources Information Center

Hansson, Finn; Monsted, Mette

2012-01-01

Peer review of research programmes is changing. The problem is discussed through detailed study of a selection process to a call for collaborations in the energy sector for the European Institute of Innovation and Technology. The authors were involved in the application for a Knowledge Innovation Community. Through the analysis of the case the…

Factors associated with the implementation of community-based peer-led health promotion programs: A scoping review.

PubMed

Lorthios-Guilledroit, Agathe; Richard, Lucie; Filiatrault, Johanne

2018-06-01

Peer education is growing in popularity as a useful health promotion strategy. However, optimal conditions for implementing peer-led health promotion programs (HPPs) remain unclear. This scoping review aimed to describe factors that can influence implementation of peer-led HPPs targeting adult populations. Five databases were searched using the keywords "health promotion/prevention", "implementation", "peers", and related terms. Studies were included if they reported at least one factor associated with the implementation of community-based peer-led HPPs. Fifty-five studies were selected for the analysis. The method known as "best fit framework synthesis" was used to analyze the factors identified in the selected papers. Many factors included in existing implementation conceptual frameworks were deemed applicable to peer-led HPPs. However, other factors related to individuals, programs, and implementation context also emerged from the analysis. Based on this synthesis, an adapted theoretical framework was elaborated, grounded in a complex adaptive system perspective and specifying potential mechanisms through which factors may influence implementation of community-based peer-led HPPs. Further research is needed to test the theoretical framework against empirical data. Findings from this scoping review increase our knowledge of the optimal conditions for implementing peer-led HPPs and thereby maximizing the benefits of such programs. Copyright © 2018 Elsevier Ltd. All rights reserved.

Clinical perspective: creating an effective practice peer review process-a primer.

PubMed

Gandhi, Manisha; Louis, Frances S; Wilson, Shae H; Clark, Steven L

2017-03-01

Peer review serves as an important adjunct to other hospital quality and safety programs. Despite its importance, the available literature contains virtually no guidance regarding the structure and function of effective peer review committees. This Clinical Perspective provides a summary of the purposes, structure, and functioning of effective peer review committees. We also discuss important legal considerations that are a necessary component of such processes. This discussion includes useful templates for case selection and review. Proper committee structure, membership, work flow, and leadership as well as close cooperation with the hospital medical executive committee and legal representatives are essential to any effective peer review process. A thoughtful, fair, systematic, and organized approach to creating a peer review process will lead to confidence in the committee by providers, hospital leadership, and patients. If properly constructed, such committees may also assist in monitoring and enforcing compliance with departmental protocols, thus reducing harm and promoting high-quality practice. Copyright © 2016 Elsevier Inc. All rights reserved.

Research management peer exchange hosted by the Oregon Department of Transportation, August 24-27, 2009.

DOT National Transportation Integrated Search

2009-08-01

The team began this peer exchange with a review of the most recent Oregon Peer Exchange conducted in : October 24-29, 2004. : The primary focus of the current peer exchange at Oregon DOT was Research Project Selection. : However, all aspects of the r...

Some opinions on the review process of research papers destined for publication.

PubMed

Roohi, Ehsan; Mahian, Omid

2015-06-01

The current paper discusses the peer review process in journals that publish research papers purveying new science and understandings (scientific journals). Different aspects of peer review including the selection of reviewers, the review process and the decision policy of editor are discussed in details. Here, the pros and cons of different conventional methods of review processes are mentioned. Finally, a suggestion is presented for the review process of scientific papers.

A Descriptive Study of Nursing Peer-Review Programs in US Magnet® Hospitals.

PubMed

Roberts, Holli; Cronin, Sherill Nones

2017-04-01

The goal of this study was to assess the types of nursing peer review (NPR) programs in US Magnet® organizations. The 2 most predominant models of NPR programs in the literature are performance evaluation and clinical peer review. The literature on clinical peer review is primarily descriptive, outlining structures and anecdotal outcomes. Participants from hospitals holding Magnet recognition were selected using a stratified random-sampling method. A survey developed by the researchers assessed the presence of NPR. If clinical NPR was in place, program design, evaluation measurements, and barriers were explored. Findings suggest wide variability in NPR models. More than one-third of the respondents conduct peer evaluation as the only mechanism of NPR. Most hospitals with a clinical peer-review program reported a case review structure and process measurements not supported by data. The variations noted in this study suggest more research is needed to measure the effectiveness of NPR models and associated outcomes.

Maintaining live discussion in two-stage open peer review.

PubMed

Sandewall, Erik

2012-01-01

Open peer review has been proposed for a number of reasons, in particular, for increasing the transparency of the article selection process for a journal, and for obtaining a broader basis for feedback to the authors and for the acceptance decision. The review discussion may also in itself have a value for the research community. These goals rely on the existence of a lively review discussion, but several experiments with open-process peer review in recent years have encountered the problem of faltering review discussions. The present article addresses the question of how lively review discussion may be fostered by relating the experience of the journal Electronic Transactions on Artificial Intelligence (ETAI) which was an early experiment with open peer review. Factors influencing the discussion activity are identified. It is observed that it is more difficult to obtain lively discussion when the number of contributed articles increases, which implies difficulties for scaling up the open peer review model. Suggestions are made for how this difficulty may be overcome.

Maintaining Live Discussion in Two-Stage Open Peer Review

PubMed Central

Sandewall, Erik

2011-01-01

Open peer review has been proposed for a number of reasons, in particular, for increasing the transparency of the article selection process for a journal, and for obtaining a broader basis for feedback to the authors and for the acceptance decision. The review discussion may also in itself have a value for the research community. These goals rely on the existence of a lively review discussion, but several experiments with open-process peer review in recent years have encountered the problem of faltering review discussions. The present article addresses the question of how lively review discussion may be fostered by relating the experience of the journal Electronic Transactions on Artificial Intelligence (ETAI) which was an early experiment with open peer review. Factors influencing the discussion activity are identified. It is observed that it is more difficult to obtain lively discussion when the number of contributed articles increases, which implies difficulties for scaling up the open peer review model. Suggestions are made for how this difficulty may be overcome. PMID:22363282

Teaching undergraduates the process of peer review: learning by doing.

PubMed

Rangachari, P K

2010-09-01

An active approach allowed undergraduates in Health Sciences to learn the dynamics of peer review at first hand. A four-stage process was used. In stage 1, students formed self-selected groups to explore specific issues. In stage 2, each group posted their interim reports online on a specific date. Each student read all the other reports and prepared detailed critiques. In stage 3, each report was discussed at sessions where the lead discussant was selected at random. All students participated in the peer review process. The written critiques were collated and returned to each group, who were asked to resubmit their revised reports within 2 wk. In stage 4, final submissions accompanied by rebuttals were graded. Student responses to a questionnaire were highly positive. They recognized the individual steps in the standard peer review, appreciated the complexities involved, and got a first-hand experience of some of the inherent variabilities involved. The absence of formal presentations and the opportunity to read each other's reports permitted them to study issues in greater depth.

Interventional radiology peer, a newly developed peer-review scoring system designed for interventional radiology practice.

PubMed

d'Othée, Bertrand Janne; Haskal, Ziv J

2013-10-01

Existing diagnostic radiology peer-review systems do not address the specificities of interventional radiology (IR) practice. The purpose of this study was to assess the feasibility of a specifically developed interventional peer review method, IR Peer. Retrospective review of a prospectively encoded pilot database aimed at demonstrating the feasibility of IR Peer in a multiphysician practice was performed. This scoring system used morning peer review of selected IR cases from the previous day in the form of a five-item questionnaire and an ordinal answer scale that grades reviewers' agreement with imaging findings, procedural/technical management, early outcomes, and follow-up plan. Patient lists from IR Peer and morbidity and mortality (M&M) conferences were compared to evaluate the amount of overlap and capability of IR Peer to help detect adverse events (AEs). A total of 417 consecutive reviews of IR attending physician cases by peers were performed in 163 consecutive patients over 18 months, and 94% of cases were reviewed by two or three IR attending physicians. Each question was answered 99%-100% of the time. Answers showed disagreement in 10% of cases (2% by a single reviewer, 8% by several), most related to procedural technique. Overall AE incidence was 1.8%. IR Peer contributed 10.7% of cases to the M&M list. IR Peer is feasible, relevant, and easy to implement in a multiphysician IR practice. When used along with other quality-assurance processes, it might help in the detection of AEs for M&M; the latter will require further confirmatory research. © SIR, 2013.

A narrative review of undergraduate peer-based healthcare ethics teaching

PubMed Central

Allikmets, Silvia; Knights, Felicity

2015-01-01

Objectives This study explores the literature in establishing the value of undergraduate peer-based healthcare ethics teaching as an educational methodology. Methods A narrative review of the literature concerning peer-based ethics teaching was conducted. MEDLINE, EMBASE, CINAHL, SCOPUS databases, and the Cochrane Library, were systematically searched for studies of peer-based ethics or professionalism teaching. Selected studies related peer-based teaching to ethics education outcomes. Results Ten publications were identified. Selected studies were varied in their chosen intervention methodology and analysis. Collectively, the identified studies suggest peer-based ethics education is an effective and valued educational methodology in training healthcare professionals. One paper suggests peer-based ethics teaching has advantages over traditional didactic methods. Peer-based ethics teaching also receives positive feedback from student participants. However, the limited literature base demonstrates a clear need for more evaluation of this pedagogy. Conclusions The current literature base suggests that undergraduate peer based healthcare ethics teaching is valuable in terms of efficacy and student satisfaction. We conclude that the medical community should invest in further study in order to capitalise upon the potential of peer-based ethics teaching in undergraduate healthcare education. PMID:26668050

Online Peer-to-Peer Communities in the Daily Lives of People With Chronic Illness: A Qualitative Systematic Review.

PubMed

Kingod, Natasja; Cleal, Bryan; Wahlberg, Ayo; Husted, Gitte R

2017-01-01

This qualitative systematic review investigated how individuals with chronic illness experience online peer-to-peer support and how their experiences influence daily life with illness. Selected studies were appraised by quality criteria focused upon research questions and study design, participant selection, methods of data collection, and methods of analysis. Four themes were identified: (a) illness-associated identity work, (b) social support and connectivity, (c) experiential knowledge sharing, and (d) collective voice and mobilization. Findings indicate that online peer-to-peer communities provide a supportive space for daily self-care related to chronic illness. Online communities provided a valued space to strengthen social ties and exchange knowledge that supported offline ties and patient-doctor relationships. Individuals used online communities to exchange experiential knowledge about everyday life with illness. This type of knowledge was perceived as extending far beyond medical care. Online communities were also used to mobilize and raise collective awareness about illness-specific concerns. © The Author(s) 2016.

Context-Aware Reviewer Assignment for Trust Enhanced Peer Review

PubMed Central

Li, Lei; Wang, Yan; Liu, Guanfeng; Wang, Meng; Wu, Xindong

2015-01-01

Reviewer assignment is critical to peer review systems, such as peer-reviewed research conferences or peer-reviewed funding applications, and its effectiveness is a deep concern of all academics. However, there are some problems in existing peer review systems during reviewer assignment. For example, some of the reviewers are much more stringent than others, leading to an unfair final decision, i.e., some submissions (i.e., papers or applications) with better quality are rejected. In this paper, we propose a context-aware reviewer assignment for trust enhanced peer review. More specifically, in our approach, we first consider the research area specific expertise of reviewers, and the institution relevance and co-authorship between reviewers and authors, so that reviewers with the right expertise are assigned to the corresponding submissions without potential conflict of interest. In addition, we propose a novel cross-assignment paradigm, and reviewers are cross-assigned in order to avoid assigning a group of stringent reviewers or a group of lenient reviewers to the same submission. More importantly, on top of them, we propose an academic CONtext-aware expertise relevanCe oriEnted Reviewer cross-assignmenT approach (CONCERT), which aims to effectively estimate the “true” ratings of submissions based on the ratings from all reviewers, even though no prior knowledge exists about the distribution of stringent reviewers and lenient reviewers. The experiments illustrate that compared with existing approaches, our proposed CONCERT approach can less likely assign more than one stringent reviewers or lenient reviewers to a submission simultaneously and significantly reduce the influence of ratings from stringent reviewers and lenient reviewers, leading to trust enhanced peer review and selection, no matter what kind of distributions of stringent reviewers and lenient reviewers are. PMID:26090849

Peer review and competition in the Art Exhibition Game.

PubMed

Balietti, Stefano; Goldstone, Robert L; Helbing, Dirk

2016-07-26

To investigate the effect of competitive incentives under peer review, we designed a novel experimental setup called the Art Exhibition Game. We present experimental evidence of how competition introduces both positive and negative effects when creative artifacts are evaluated and selected by peer review. Competition proved to be a double-edged sword: on the one hand, it fosters innovation and product diversity, but on the other hand, it also leads to more unfair reviews and to a lower level of agreement between reviewers. Moreover, an external validation of the quality of peer reviews during the laboratory experiment, based on 23,627 online evaluations on Amazon Mechanical Turk, shows that competition does not significantly increase the level of creativity. Furthermore, the higher rejection rate under competitive conditions does not improve the average quality of published contributions, because more high-quality work is also rejected. Overall, our results could explain why many ground-breaking studies in science end up in lower-tier journals. Differences and similarities between the Art Exhibition Game and scholarly peer review are discussed and the implications for the design of new incentive systems for scientists are explained.

Idaho Transportation Department : 2010 research program peer exchange.

DOT National Transportation Integrated Search

2010-05-01

The objectives of the peer exchange were to: : 1. Identify strengths, challenges, and opportunities for program and project management; : 2. Understand management expectations of the ITD Research Program; : 3. Review processes for project selection a...

The Validity of Online Patient Ratings of Physicians: Analysis of Physician Peer Reviews and Patient Ratings.

PubMed

McGrath, Robert J; Priestley, Jennifer Lewis; Zhou, Yiyun; Culligan, Patrick J

2018-04-09

Information from ratings sites are increasingly informing patient decisions related to health care and the selection of physicians. The current study sought to determine the validity of online patient ratings of physicians through comparison with physician peer review. We extracted 223,715 reviews of 41,104 physicians from 10 of the largest cities in the United States, including 1142 physicians listed as "America's Top Doctors" through physician peer review. Differences in mean online patient ratings were tested for physicians who were listed and those who were not. Overall, no differences were found between the online patient ratings based upon physician peer review status. However, statistical differences were found for four specialties (family medicine, allergists, internal medicine, and pediatrics), with online patient ratings significantly higher for those physicians listed as a peer-reviewed "Top Doctor" versus those who were not. The results of this large-scale study indicate that while online patient ratings are consistent with physician peer review for four nonsurgical, primarily in-office specializations, patient ratings were not consistent with physician peer review for specializations like anesthesiology. This result indicates that the validity of patient ratings varies by medical specialization. ©Robert J McGrath, Jennifer Lewis Priestley, Yiyun Zhou, Patrick J Culligan. Originally published in the Interactive Journal of Medical Research (http://www.i-jmr.org/), 09.04.2018.

A systematic review of the effectiveness and cost-effectiveness of peer education and peer support in prisons.

PubMed

Bagnall, Anne-Marie; South, Jane; Hulme, Claire; Woodall, James; Vinall-Collier, Karen; Raine, Gary; Kinsella, Karina; Dixey, Rachael; Harris, Linda; Wright, Nat M J

2015-03-25

Prisoners experience significantly worse health than the general population. This review examines the effectiveness and cost-effectiveness of peer interventions in prison settings. A mixed methods systematic review of effectiveness and cost-effectiveness studies, including qualitative and quantitative synthesis was conducted. In addition to grey literature identified and searches of websites, nineteen electronic databases were searched from 1985 to 2012. Study selection criteria were: Prisoners resident in adult prisons and children resident in Young Offender Institutions (YOIs). Peer-based interventions. Review questions 3 and 4 compared peer and professionally led approaches. Prisoner health or determinants of health; organisational/process outcomes; views of prison populations. Quantitative, qualitative and mixed method evaluations. Fifty-seven studies were included in the effectiveness review and one study in the cost-effectiveness review; most were of poor methodological quality. Evidence suggested that peer education interventions are effective at reducing risky behaviours, and that peer support services are acceptable within the prison environment and have a positive effect on recipients, practically or emotionally. Consistent evidence from many, predominantly qualitative, studies, suggested that being a peer deliverer was associated with positive effects. There was little evidence on cost-effectiveness of peer-based interventions. There is consistent evidence from a large number of studies that being a peer worker is associated with positive health; peer support services are also an acceptable source of help within the prison environment and can have a positive effect on recipients. Research into cost-effectiveness is sparse. PROSPERO ref: CRD42012002349.

Doing peer review and receiving feedback: impact on scientific literacy and writing skills.

PubMed

Geithner, Christina A; Pollastro, Alexandria N

2016-03-01

Doing peer review has been effectively implemented to help students develop critical reading and writing skills; however, its application in Human Physiology programs is limited. The purpose of the present study was to determine the impact of peer review on Human Physiology majors' perceptions of their scientific literacy and writing skills. Students enrolled in the Scientific Writing course completed multiple writing assignments, including three revisions after receiving peer and instructor feedback. Students self-assessed their knowledge, skills, and attitudes related to science and writing in pre- and postcourse surveys (n = 26 with complete data). Seven survey items related to scientific literacy and writing skills impacted by peer review were selected for analysis. Scores on these survey items were summed to form a composite self-rating score. Responses to two questions regarding the most useful learning activities were submitted to frequency analysis. Mean postcourse scores for individual survey items and composite self-rating scores were significantly higher than precourse means (P < 0.05). Peer review was the most frequently noted among 21 learning activities for increasing scientific literacy and in the top 5 for improving writing skills. In conclusion, peer review is an effective teaching/learning approach for improving undergraduate Human Physiology majors' knowledge, skills, and attitudes regarding science and scientific writing. Copyright © 2016 The American Physiological Society.

[Impact of quality measurement, transparency and peer review on in-hospital mortality - retrospective before-after study with 63 hospitals].

PubMed

Nimptsch, Ulrike; Peschke, Dirk; Mansky, Thomas

2016-10-01

In 2008 the 'Initiative Qualitätsmedizin' (initiative for quality in medical care, IQM) was established as a voluntary non-profit association of hospital providers of all kinds of ownership. Currently, about 350 hospitals from Germany and Switzerland participate in IQM. Member hospitals are committed to a quality strategy based on measuring outcome indicators using administrative data, peer review procedures to improve medical quality, and transparency by public reporting. This study aims to investigate whether voluntary implementation of this approach is associated with improvements in medical outcome. Within a retrospective before-after study 63 hospitals, which started to participate in IQM between 2009 and 2011, were monitored. In-hospital mortality in these hospitals was studied for 14 selected inpatient services in comparison to the German national average. The analyses examine whether in-hospital mortality declined after participation of the studied hospitals in IQM, independently of secular trends or deviations in case mix when compared to the national average, and whether such findings were associated with initial hospital performance or peer review procedures. Declining in-hospital mortality was observed in hospitals with initially subpar performance. These declines were statistically significant for treatment of myocardial infarction, heart failure, pneumonia, and septicemia. Similar, but statistically non-significant trends were observed for nine further treatments. Following peer-review procedures significant declines in in-hospital mortality were observed for treatments of myocardial infarction, heart failure, and pneumonia. Mortality declines after peer reviews regarding stroke, hip fracture and colorectal resection were not significant, and after peer reviews regarding mechanically ventilated patients no changes were observed. The results point to a positive impact of the quality approach applied by IQM on clinical outcomes. A more targeted selection of hospitals to be peer-reviewed might further enhance the impact of this approach. Copyright © 2016. Published by Elsevier GmbH.

Transformation of Adolescent Peer Relations in the Social Media Context: Part 2-Application to Peer Group Processes and Future Directions for Research.

PubMed

Nesi, Jacqueline; Choukas-Bradley, Sophia; Prinstein, Mitchell J

2018-04-07

As social media use becomes increasingly widespread among adolescents, research in this area has accumulated rapidly. Researchers have shown a growing interest in the impact of social media on adolescents' peer experiences, including the ways that the social media context shapes a variety of peer relations constructs. This paper represents Part 2 of a two-part theoretical review. In this review, we offer a new model for understanding the transformative role of social media in adolescents' peer experiences, with the goal of stimulating future empirical work that is grounded in theory. The transformation framework suggests that the features of the social media context transform adolescents' peer experiences by changing their frequency or immediacy, amplifying demands, altering their qualitative nature, and/or offering new opportunities for compensatory or novel behaviors. In the current paper, we consider the ways that social media may transform peer relations constructs that often occur at the group level. Our review focuses on three key constructs: peer victimization, peer status, and peer influence. We selectively review and highlight existing evidence for the transformation of these domains through social media. In addition, we discuss methodological considerations and key conceptual principles for future work. The current framework offers a new theoretical perspective through which peer relations researchers may consider adolescent social media use.

Peers and Obesity during Childhood and Adolescence: A Review of the Empirical Research on Peers, Eating, and Physical Activity

PubMed Central

Salvy, Sarah-Jeanne; Bowker, Julie C.

2015-01-01

Obesity during childhood and adolescence is a growing problem in the United States, Canada, and around the world that leads to significant physical, psychological, and social impairment. In recent years, empirical research on factors that contribute to the development and maintenance of obesity has begun to consider peer experiences, such as peer rejection, peer victimization, and friendship. Peer experiences have been theoretically and empirically related to the “Big Two” contributors to the obesity epidemic, eating and physical activity, but there has not been a comprehensive review of the extant empirical literature. In this article, we review and synthesize the emerging theoretical and empirical literatures on peer experiences in relation to: (a) eating (food consumption and food selection); and (b) physical activity, during childhood and adolescence. A number of limitations and issues in the theoretical and empirical literatures are also discussed, along with future research directions. In conclusion, we argue that the involvement of children and adolescents’ peer networks in prevention and intervention efforts may be critical for promoting and maintaining positive behavioral health trajectories. PMID:28090396

Research funding. Big names or big ideas: do peer-review panels select the best science proposals?

PubMed

Li, Danielle; Agha, Leila

2015-04-24

This paper examines the success of peer-review panels in predicting the future quality of proposed research. We construct new data to track publication, citation, and patenting outcomes associated with more than 130,000 research project (R01) grants funded by the U.S. National Institutes of Health from 1980 to 2008. We find that better peer-review scores are consistently associated with better research outcomes and that this relationship persists even when we include detailed controls for an investigator's publication history, grant history, institutional affiliations, career stage, and degree types. A one-standard deviation worse peer-review score among awarded grants is associated with 15% fewer citations, 7% fewer publications, 19% fewer high-impact publications, and 14% fewer follow-on patents. Copyright © 2015, American Association for the Advancement of Science.

Successful peer review of courses: a case study.

PubMed

Horowitz, S; Van Eyck, S; Albanese, M

1998-03-01

The authors describe their school's system of peer review for courses, established in 1988 to facilitate faculty evaluation and continual course and curriculum improvement. (The system has been temporarily suspended while the school's new curriculum becomes established.) They explain how the system was created and then report how faculty reviews of courses over the five-year operation of the system compared with students' reviews of the same courses. The faculty and students' ratings were in agreement 75% of the time. When not in agreement, the students' ratings tended to upgrade courses that were not very demanding, had easy grading, and emphasized clinical details, often at the expense of basic concepts and the big picture. The authors then document how the work of the peer review system favorably influenced the transformation of the school's curriculum. They also provide guidelines for the creation and operation of a course review process that uses faculty peers. The authors maintain that the peer review system worked because it was run by a committee of experienced and respected teachers who had been selected by their peers, the other faculty. Additional reasons for its success were that the school's faculty supported and respected the committee and its work, that course directors helped evaluate their courses, and that peer reviewers took their work seriously despite having no remuneration, and the clearly positive impact of the review system on faculty interaction, faculty-student interaction, and the reform of the curriculum.

Manuscript peer review at the AJR: facts, figures, and quality assessment.

PubMed

Friedman, D P

1995-04-01

Concern by the government, funding institutions, and the public for quality assurance in all aspects of medical endeavors mandates critical examination of various professional activities. Although peer review is generally regarded as the best system for selecting and improving scientific papers for publication, the efficacy of this process has never been proved. Moreover, the administrative functions of the editorial staff are often poorly understood. The purpose of this article is to make peer review a the AJR less esoteric and more understandable by quantifying some of its activities. This information is then assessed as it relates to the quality of this important step in scientific publication.

A scoping review protocol on the roles and tasks of peer reviewers in the manuscript review process in biomedical journals.

PubMed

Glonti, Ketevan; Cauchi, Daniel; Cobo, Erik; Boutron, Isabelle; Moher, David; Hren, Darko

2017-10-22

The primary functions of peer reviewers are poorly defined. Thus far no body of literature has systematically identified the roles and tasks of peer reviewers of biomedical journals. A clear establishment of these can lead to improvements in the peer review process. The purpose of this scoping review is to determine what is known on the roles and tasks of peer reviewers. We will use the methodological framework first proposed by Arksey and O'Malley and subsequently adapted by Levac et al and the Joanna Briggs Institute. The scoping review will include all study designs, as well as editorials, commentaries and grey literature. The following eight electronic databases will be searched (from inception to May 2017): Cochrane Library, Cumulative Index to Nursing and Allied Health Literature, Educational Resources Information Center, EMBASE, MEDLINE, PsycINFO, Scopus and Web of Science. Two reviewers will use inclusion and exclusion criteria based on the 'Population-Concept-Context' framework to independently screen titles and abstracts of articles considered for inclusion. Full-text screening of relevant eligible articles will also be carried out by two reviewers. The search strategy for grey literature will include searching in websites of existing networks, biomedical journal publishers and organisations that offer resources for peer reviewers. In addition we will review journal guidelines to peer reviewers on how to perform the manuscript review. Journals will be selected using the 2016 journal impact factor. We will identify and assess the top five, middle five and lowest-ranking five journals across all medical specialties. This scoping review will undertake a secondary analysis of data already collected and does not require ethical approval. The results will be disseminated through journals and conferences targeting stakeholders involved in peer review in biomedical research. © Article author(s) (or their employer(s) unless otherwise stated in the text of the article) 2017. All rights reserved. No commercial use is permitted unless otherwise expressly granted.

Peer review and competition in the Art Exhibition Game

PubMed Central

Goldstone, Robert L.; Helbing, Dirk

2016-01-01

To investigate the effect of competitive incentives under peer review, we designed a novel experimental setup called the Art Exhibition Game. We present experimental evidence of how competition introduces both positive and negative effects when creative artifacts are evaluated and selected by peer review. Competition proved to be a double-edged sword: on the one hand, it fosters innovation and product diversity, but on the other hand, it also leads to more unfair reviews and to a lower level of agreement between reviewers. Moreover, an external validation of the quality of peer reviews during the laboratory experiment, based on 23,627 online evaluations on Amazon Mechanical Turk, shows that competition does not significantly increase the level of creativity. Furthermore, the higher rejection rate under competitive conditions does not improve the average quality of published contributions, because more high-quality work is also rejected. Overall, our results could explain why many ground-breaking studies in science end up in lower-tier journals. Differences and similarities between the Art Exhibition Game and scholarly peer review are discussed and the implications for the design of new incentive systems for scientists are explained. PMID:27402744

Learning from peer support schemes--can prison listeners support offenders who self-injure in custody?

PubMed

Griffiths, Louise; Bailey, Di

2015-01-01

The purpose of this paper is to critically evaluate the current evidence for peer support in prisons, in particular its contribution to working with prisoners who self-injure and the extent to which the success of peer support schemes such as the prison listeners, hinges upon staff's willingness to engage with the initiative. The review was constructed by using primary and secondary terms to search the literature. The studies focused on peer support in custody with reference to mental health and self-injury. Searches identified papers on the prison listener scheme and staff perspectives on prison peer support, as these formed a central focus of the review. Studies were excluded from the review if the participants' behaviours was explicitly linked to suicidal intent, as the review focused on self-injury as a coping strategy. A total of 24 studies were selected according to specific inclusion criteria (six were grey literature, 18 academic literature). Of the 24 studies ten studies focused on peer support and self-injury. Of the 24 studies the listener scheme was the focus of 16 studies, of these 16 studies self-injury and the listener scheme was a focus of eight studies. Evidence from the review suggests that prison peer support could be considered on a continuum depending on the different degrees of peer involvement.

Subspecialty Influence on Scientific Peer Review for an Obstetrics and Gynecology Journal With a High Impact Factor.

PubMed

Parikh, Laura I; Benner, Rebecca S; Riggs, Thomas W; Hazen, Nicholas; Chescheir, Nancy C

2017-02-01

To evaluate whether quality of peer review and reviewer recommendation differ based on reviewer subspecialty in obstetrics and gynecology and to determine the role of experience on reviewer recommendation. We performed a retrospective cohort study of reviews submitted to Obstetrics & Gynecology between January 2010 and December 2014. Subspecialties were determined based on classification terms selected by each reviewer and included all major obstetrics and gynecology subspecialties, general obstetrics and gynecology, and nonobstetrics and gynecology categories. Review quality (graded on a 5-point Likert scale by the journal's editors) and reviewer recommendation of "reject" were compared across subspecialties using χ, analysis of variance, and multivariate logistic regression. There were 20,027 reviews from 1,889 individual reviewers. Reviewers with family planning subspecialty provided higher-quality peer reviews compared with reviewers with gynecology only, reproductive endocrinology and infertility, gynecologic oncology, and general obstetrics and gynecology specialties (3.61±0.75 compared with 3.44±0.78, 3.42±0.72, 3.35±0.75, and 3.32±0.81, respectively, P<.05). Reviewers with gynecology-only subspecialty recommended rejection more often compared with reviewers with a nonobstetrics and gynecology subspecialty (57.7% compared with 38.7%, P<.05). Editorial Board members recommended rejection more often than new reviewers (68.0% compared with 41.5%, P<.05). Increased adjusted odds of manuscript rejection recommendation were associated with reproductive endocrinology, female pelvic medicine and reconstructive surgery, and gynecology-only reviewer subspecialty (adjusted odds ratio [OR] 1.23 [1.07-1.41], 1.21 [1.05-1.39], and 1.11 [1.02-1.20]). Manuscript rejection recommendation rate was also increased for reviewers who had completed the highest quintile of peer reviews (greater than 195) compared with the lowest quintile (one to seven) (adjusted OR 2.85 [2.60-3.12]). Peer review quality differs based on obstetrics and gynecology subspecialty. Obstetrics and gynecology subspecialty and reviewer experience have implications for manuscript rejection recommendation. Reviewer assignment is pivotal to maintaining a rigorous manuscript selection process.

Peers and adolescent smoking.

PubMed

Kobus, Kimberly

2003-05-01

There is a considerable body of empirical research that has identified adolescent peer relationships as a primary factor involved in adolescent cigarette smoking. Despite this large research base, many questions remain unanswered about the mechanisms by which peers affect youths' smoking behavior. Understanding these processes of influence is key to the development of prevention and intervention programs designed to address adolescent smoking as a significant public health concern. In this paper, theoretical frameworks and empirical findings are reviewed critically which inform the current state of knowledge regarding peer influences on teenage smoking. Specifically, social learning theory, primary socialization theory, social identity theory and social network theory are discussed. Empirical findings regarding peer influence and selection, as well as multiple reference points in adolescent friendships, including best friendships, romantic relationships, peer groups and social crowds, are also reviewed. Review of this work reveals the contribution that peers have in adolescents' use of tobacco, in some cases promoting use, and in other cases deterring it. This review also suggests that peer influences on smoking are more subtle than commonly thought and need to be examined more carefully, including consideration of larger social contexts, e.g. the family, neighborhood, and media. Recommendations for future investigations are made, as well as suggestions for specific methodological approaches that offer promise for advancing our knowledge of the contribution of peers on adolescent tobacco use.

Medical students as peer tutors: a systematic review

PubMed Central

2014-01-01

Background While Peer Assisted Learning (PAL) has long occurred informally in medical education, in the past ten years, there has been increasing international interest in formally organised PAL, with many benefits for both the students and institutions. We conducted a systematic review of the literature to establish why and how PAL has been implemented, focussing on the recruitment and training process for peer tutors, the benefits for peer tutors, and the competency of peer tutors. Method A literature search was conducted in three electronic databases. Selection of titles and abstracts were made based on pre-determined eligibility criteria. We utilized the ‘AMEE Peer assisted learning: a planning and implementation framework: AMEE Guide no. 30’ to assist us in establishing the review aims in a systematic review of the literature between 2002 and 2012. Six key questions were developed and used in our analysis of particular aspects of PAL programs within medical degree programs. Results We found nineteen articles that satisfied our inclusion criteria. The PAL activities fell into three broad categories of teacher training, peer teaching and peer assessment. Variability was found in the reporting of tutor recruitment and training processes, tutor outcomes, and tutor competencies. Conclusion Results from this review suggest that there are many perceived learning benefits for student tutors. However, there were mixed results regarding the accuracy of peer assessment and feedback, and no substantial evidence to conclude that participation as a peer tutor improves one’s own examination performance. Further research into PAL in medicine is required if we are to better understand the relative impact and benefits for student tutors. PMID:24912500

Pediatric Feeding Disorders: A Quantitative Synthesis of Treatment Outcomes

ERIC Educational Resources Information Center

Sharp, William G.; Jaquess, David L.; Morton, Jane F.; Herzinger, Caitlin V.

2010-01-01

A systematic review of the literature regarding treatment of pediatric feeding disorders was conducted. Articles in peer-reviewed scientific journals (1970-2010) evaluating treatment of severe food refusal or selectivity were identified. Studies demonstrating strict experimental control were selected and analyzed. Forty-eight single-case research…

Performance results for a workstation-integrated radiology peer review quality assurance program.

PubMed

O'Keeffe, Margaret M; Davis, Todd M; Siminoski, Kerry

2016-06-01

To assess review completion rates, RADPEER score distribution, and sources of disagreement when using a workstation-integrated radiology peer review program, and to evaluate radiologist perceptions of the program. Retrospective review of prospectively collected data. Large private outpatient radiology practice. Radiologists (n = 66) with a mean of 16.0 (standard deviation, 9.2) years of experience. Prior studies and reports of cases being actively reported were randomly selected for peer review using the RADPEER scoring system (a 4-point scale, with a score of 1 indicating agreement and scores of 2-4 indicating increasing levels of disagreement). Assigned peer review completion rates, review scores, sources of disagreement and radiologist survey responses. Of 31 293 assigned cases, 29 044 (92.8%; 95% CI 92.5-93.1%) were reviewed. Discrepant scores (score = 2, 3 or 4) were given in 0.69% (95% CI 0.60-0.79%) of cases and clinically significant discrepancy (score = 3 or 4) was assigned in 0.42% (95% CI 0.35-0.50%). The most common cause of disagreement was missed diagnosis (75.2%; 95% CI 66.8-82.1%). By anonymous survey, 94% of radiologists felt that peer review was worthwhile, 90% reported that the scores they received were appropriate and 78% felt that the received feedback was valuable. Workstation-based peer review can increase completion rates and levels of radiologist acceptance while producing RADPEER scores similar to those previously reported. This approach may be one way to increase radiologist engagement in peer review quality assurance. © The Author 2016. Published by Oxford University Press in association with the International Society for Quality in Health Care; all rights reserved.

Peer-reviewed articles on inclusive research: Do co-researchers with intellectual disabilities have a voice?

PubMed

Strnadová, Iva; Walmsley, Jan

2018-01-01

Inclusive research is increasingly common in intellectual disabilities research, but ways in which voice of co-researchers with intellectual disabilities is presented remain underexplored in the literature. The authors conducted a literature review and analysis of peer-reviewed journal articles reporting on inclusive research. The aim was to explore the ways the voices of co-researchers with intellectual disabilities are represented in published peer-reviewed journal articles. The findings indicate that there are a wide range of ways in which inclusive research projects are reported in peer-reviewed journals. However, the experiences, views and opinions of co-researchers are often either absent or very selectively reported. The article concludes that although inclusive research has proliferated in the 21st century, more attention needs to be paid to the ways in which the voices of co-researchers with intellectual disabilities are heard in formal academic contexts. Guidelines for future practice are offered. © 2017 John Wiley & Sons Ltd.

Customer satisfaction with the FHWA peer-to-peer program : a qualitative assessment

DOT National Transportation Integrated Search

1989-07-01

This report is a synthesis of research findings and current practices in controlling and protecting pedestrian traffic in work zones. The information presented here is based on a review of research reports and work zone manuals from a selection of st...

Predictors of the accuracy of quotation of references in peer-reviewed orthopaedic literature in relation to publications on the scaphoid.

PubMed

Buijze, G A; Weening, A A; Poolman, R W; Bhandari, M; Ring, D

2012-02-01

Using inaccurate quotations can propagate misleading information, which might affect the management of patients. The aim of this study was to determine the predictors of quotation inaccuracy in the peer-reviewed orthopaedic literature related to the scaphoid. We randomly selected 100 papers from ten orthopaedic journals. All references were retrieved in full text when available or otherwise excluded. Two observers independently rated all quotations from the selected papers by comparing the claims made by the authors with the data and expressed opinions of the reference source. A statistical analysis determined which article-related factors were predictors of quotation inaccuracy. The mean total inaccuracy rate of the 3840 verified quotes was 7.6%. There was no correlation between the rate of inaccuracy and the impact factor of the journal. Multivariable analysis identified the journal and the type of study (clinical, biomechanical, methodological, case report or review) as important predictors of the total quotation inaccuracy rate. We concluded that inaccurate quotations in the peer-reviewed orthopaedic literature related to the scaphoid were common and slightly more so for certain journals and certain study types. Authors, reviewers and editorial staff play an important role in reducing this inaccuracy.

Special Issue: 14th International Symposium on Novel and Nano Materials

NASA Astrophysics Data System (ADS)

Kim, Woo-Byoung; Choa, Yong-Ho; Ahn, Hyo-Jin; Park, Il-Kyu

2017-09-01

This Special Issue of Applied Surface Science is intended to provide a collection of peer-reviewed contributions presented at the 14th International Symposium on Novel Nano Materials (ISNNM) held in Budapest, Hungary as one of the most beautiful cities in Europe from July 3 to July 8, 2016. All selected papers underwent the regular peer review process as set by the journal of Applied Surface Science and its publisher (Elsevier).

Exploration and practice of methods and processes of evidence-based rapid review on peer review of WHO EML application.

PubMed

Li, Youping; Yu, Jiajie; Du, Liang; Sun, Xin; Kwong, Joey S W; Wu, Bin; Hu, Zhiqiang; Lu, Jing; Xu, Ting; Zhang, Lingli

2015-11-01

After 38 years of development, the procedure of selection and evaluation of the World Health Organization Essential Medicine List (WHO EML) is increasingly scientific and formal. However, peer review for the applications of World Health Organization Essential Medicine List is always required in a short period. It is necessary to build up a set of methods and processes for rapid review. We identified the process of evidenced-based rapid review on WHO EML application for peer reviews according to 11 items which were required during reporting of the peer review results of the proposals. The most important items for the rapid review of World Health Organization Essential Medicine List peer reviewers are (1) to confirm the requirements and identify the purposes; (2) to establish the research questions and translate the questions into the 'Participants, Interventions, Comparators, Outcomes, Study design' (PICOS) format; (3) to search and screen available evidence, for which high-level evidence is preferred, such as systematic reviews or meta-analyses, health technology assessment, clinical guidelines; (4) to extract data, where we extract primary information based on the purposes; (5) to synthesize data by qualitative methods, assess the quality of evidence, and compare the results; (6) to provide the answers to the applications, quality of evidences and strength of recommendations. Our study established a set of methods and processes for the rapid review of World Health Organization Essential Medicine List peer review, and our findings were used to guide the reviewers to fulfill the 19(th) World Health Organization Essential Medicine List peer review. The methods and processes were feasible and met the necessary requirements in terms of time and quality. Continuous improvement and evaluation in practice are warranted. © 2015 Chinese Cochrane Center, West China Hospital of Sichuan University and Wiley Publishing Asia Pty Ltd.

Ethics of reviewing scientific publications.

PubMed

Napolitani, Federica; Petrini, Carlo; Garattini, Silvio

2017-05-01

The approval or rejection of scientific publications can have important consequences for scientific knowledge, so considerable responsibility lies on those who have to assess or review them. Today it seems that the peer review process, far from being considered an outdated system to be abandoned, is experiencing a new upturn. This article proposes criteria for the conduct of reviewers and of those who select them. While commenting on new emerging models, it provides practical recommendations for improving the peer-review system, like strengthening the role of guidelines and training and supporting reviewers. The process of peer review is changing, it is getting more open and collaborative, but those same ethical principles which guided it from its very origin should remain untouched and be firmly consolidated. The paper highlights how the ethics of reviewing scientific publications is needed now more than ever, in particular with regard to competence, conflict of interest, willingness to discuss decisions, complete transparency and integrity. Copyright © 2016 European Federation of Internal Medicine. Published by Elsevier B.V. All rights reserved.

How Sensor, Signal, and Imaging Informatics May Impact Patient Centered Care and Care Coordination

PubMed Central

Moreau-Gaudry, A.

2015-01-01

Summary Objective This synopsis presents a selection for the IMIA (International Medical Informatics Association) Yearbook 2015 of excellent research in the broad field of Sensor, Signal, and Imaging Informatics published in the year 2014, with a focus on patient centered care coordination. Methods The two section editors performed a systematic initial selection and a double blind peer review process to select a list of candidate best papers in the domain published in 2014, from the PubMed and Web of Science databases. A set of MeSH keywords provided by experts was used. This selection was peer-reviewed by external reviewers. Results The review process highlighted articles illustrating two current trends related to care coordination and patient centered care: the enhanced capacity to predict the evolution of a disease based on patient-specific information can impact care coordination; similarly, better perception of the patient and his treatment could lead to enhanced personalized care with a potential impact on care coordination. Conclusions This review shows the multiplicity of angles from which the question of patient-centered care can be addressed, with consequences on care coordination that will need to be confirmed and demonstrated in the future. PMID:26293856

Advanced Practitioners Are Peers in Trauma Performance Improvement Peer Review.

PubMed

Collins, Tara Ann; Sicoutris, Corinna P; McNicholas, Amanda; Krumrie, Nicole; Eddinger, Abby; Fernandez, Forrest B; Schwab, C William; Reilly, Patrick M; Kim, Patrick K

2016-01-01

Advanced practitioners (APs) have been successfully integrated into the clinical care of injured patients. Given the expanding role of APs in trauma care, we hypothesized that APs can perform Performance Improvement and Patient Safety (PIPS) peer review at a level comparable with trauma surgeons. For Phase 1, cases previously reviewed by a trauma surgeon were randomly selected by the PIPS coordinator and peer reviewed by an AP. The trauma surgeons' and APs' reviews were compared. For Phase 2, cases requiring concurrent review were peer reviewed by both an AP and an MD, who were blinded to each other's review. Both the APs' and trauma surgeons' reviews of the same medical record were presented at a bimonthly performance improvement (PI) meeting. In Phase 1, 46 PI cases were reviewed including 22 deaths. Trauma surgeons and APs had high concordance (96.0%) regarding appropriateness or inappropriateness of care (κ = 0.774). Among disagreements, APs were 3 times more likely than trauma surgeons to determine care to be inappropriate. Trauma surgeons and APs had similarly high concordance (95.5%) regarding preventability of mortality (κ = 0.861). In Phase 2, 38 PI cases were reviewed, including 31 deaths. Trauma surgeons and APs had high concordance (89.0%) regarding appropriateness or inappropriateness of care (κ = 0.585). Among disagreements, trauma surgeons and APs had similarly high concordance (86.2%) regarding preventability of mortality (κ = 0.266). We found that APs had high concordance with trauma surgeons regarding medical record reviews and are thus able to effectively review medical records for the purposes of PIPS.

Emerging trends in peer review—a survey

PubMed Central

Walker, Richard; Rocha da Silva, Pascal

2015-01-01

“Classical peer review” has been subject to intense criticism for slowing down the publication process, bias against specific categories of paper and author, unreliability, inability to detect errors and fraud, unethical practices, and the lack of recognition for unpaid reviewers. This paper surveys innovative forms of peer review that attempt to address these issues. Based on an initial literature review, we construct a sample of 82 channels of scientific communication covering all forms of review identified by the survey, and analyze the review mechanisms used by each channel. We identify two major trends: the rapidly expanding role of preprint servers (e.g., ArXiv) that dispense with traditional peer review altogether, and the growth of “non-selective review,” focusing on papers' scientific quality rather than their perceived importance and novelty. Other potentially important developments include forms of “open review,” which remove reviewer anonymity, and interactive review, as well as new mechanisms for post-publication review and out-of-channel reader commentary, especially critical commentary targeting high profile papers. One of the strongest findings of the survey is the persistence of major differences between the peer review processes used by different disciplines. None of these differences is likely to disappear in the foreseeable future. The most likely scenario for the coming years is thus continued diversification, in which different review mechanisms serve different author, reader, and publisher needs. Relatively little is known about the impact of these innovations on the problems they address. These are important questions for future quantitative research. PMID:26074753

Understanding the Federal Proposal Review Process.

ERIC Educational Resources Information Center

Cavin, Janis I.

Information on the peer review process for the evaluation of federal grant proposals is presented to help college grants administrators and faculty develop good proposals. This guidebook provides an overview of the policies and conventions that govern the review and selection of proposals for funding, and details the review procedures of the…

EFL Writing Revision with Blind Expert and Peer Review Using a CMC Open Forum

ERIC Educational Resources Information Center

Wu, Wen-Chi Vivian; Petit, Emily; Chen, Ching-Huei

2015-01-01

This exploratory computer assisted-language learning (CALL) study used a computer-mediated communication (CMC) interface to allow English as a foreign language (EFL) writing students in classes at two universities to give each other anonymous peer feedback about essay-writing assignments reacting to selected news stories. Experts also provided…

Peer Victimization and Pediatric Obesity: A Review of the Literature

ERIC Educational Resources Information Center

Gray, Wendy N.; Kahhan, Nicole A.; Janicke, David M.

2009-01-01

Childhood obesity is associated with a variety of medical and psychosocial consequences. Children who are obese are at an increased risk of being victims of weight-based stigmatization by their peers. Negative views toward obese individuals may be expressed through children's friendship selections and expressed levels of overt (e.g., pushing,…

34 CFR 356.21 - What is the fellowship review process?

Code of Federal Regulations, 2010 CFR

2010-07-01

... fellowship review process? The Secretary reviews applications for Fellowships in accordance with the peer review requirements governing grants in 34 CFR 350.31 and 350.32 and the selection criteria contained in... 34 Education 2 2010-07-01 2010-07-01 false What is the fellowship review process? 356.21 Section...

IRIS Toxicological Review of Naphthalene (2004, External Review Draft, Update)

EPA Science Inventory

[Update Jun 2004] This document contains revision of the inhalation cancer assessment and other selected text from the 1998 draft as indicated: Sections of this document pertaining to the inhalation cancer assessment are presented as draft for external peer review purposes only ...

Statistical Reviewers Improve Reporting in Biomedical Articles: A Randomized Trial

PubMed Central

Cobo, Erik; Selva-O'Callagham, Albert; Ribera, Josep-Maria; Cardellach, Francesc; Dominguez, Ruth; Vilardell, Miquel

2007-01-01

Background Although peer review is widely considered to be the most credible way of selecting manuscripts and improving the quality of accepted papers in scientific journals, there is little evidence to support its use. Our aim was to estimate the effects on manuscript quality of either adding a statistical peer reviewer or suggesting the use of checklists such as CONSORT or STARD to clinical reviewers or both. Methodology and Principal Findings Interventions were defined as 1) the addition of a statistical reviewer to the clinical peer review process, and 2) suggesting reporting guidelines to reviewers; with “no statistical expert” and “no checklist” as controls. The two interventions were crossed in a 2×2 balanced factorial design including original research articles consecutively selected, between May 2004 and March 2005, by the Medicina Clinica (Barc) editorial committee. We randomized manuscripts to minimize differences in terms of baseline quality and type of study (intervention, longitudinal, cross-sectional, others). Sample-size calculations indicated that 100 papers provide an 80% power to test a 55% standardized difference. We specified the main outcome as the increment in quality of papers as measured on the Goodman Scale. Two blinded evaluators rated the quality of manuscripts at initial submission and final post peer review version. Of the 327 manuscripts submitted to the journal, 131 were accepted for further review, and 129 were randomized. Of those, 14 that were lost to follow-up showed no differences in initial quality to the followed-up papers. Hence, 115 were included in the main analysis, with 16 rejected for publication after peer review. 21 (18.3%) of the 115 included papers were interventions, 46 (40.0%) were longitudinal designs, 28 (24.3%) cross-sectional and 20 (17.4%) others. The 16 (13.9%) rejected papers had a significantly lower initial score on the overall Goodman scale than accepted papers (difference 15.0, 95% CI: 4.6–24.4). The effect of suggesting a guideline to the reviewers had no effect on change in overall quality as measured by the Goodman scale (0.9, 95% CI: −0.3–+2.1). The estimated effect of adding a statistical reviewer was 5.5 (95% CI: 4.3–6.7), showing a significant improvement in quality. Conclusions and Significance This prospective randomized study shows the positive effect of adding a statistical reviewer to the field-expert peers in improving manuscript quality. We did not find a statistically significant positive effect by suggesting reviewers use reporting guidelines. PMID:17389922

Journal policy on ethics in scientific publication.

PubMed

Callaham, Michael L

2003-01-01

Medical journals aspire to select, through peer review, the highest quality science, and their reputations depend on the trust of readers, authors, researchers, reviewers, and patients. Almost every aspect of this process involves important ethical principles and decisions, which are seldom explicitly stated and even less often shared with the readership. A comprehensive policy on publication ethics is summarized in this article. A few of the topics addressed are study design; research subject consent; definitions and responsibilities of authorship; declaration of paid writers; types of potential conflicts of interest; management of conflicts of interest on the part of authors, journal reviewers, and members of the editorial board; blinding and confidentiality of peer review; assessment of peer review quality; public identification of degree of peer review of various portions of the journal; criteria for manuscript decisions; management of author appeals; definitions of prior publication; plagiarism; criteria for advertising and relationship between advertising and editorial matter; allegations of misconduct and journal policies for responding to them; and the relationship of the journal to the sponsoring society. Our goal in publishing these policies is to make the guiding ethical principles of this journal accessible to all of our readers and contributors.

Space station attached payload program support

NASA Technical Reports Server (NTRS)

Estes, Maurice G., Jr.; Brown, Bardle D.

1989-01-01

The USRA is providing management and technical support for the peer review of the Space Station Freedom Attached Payload proposals. USRA is arranging for consultants to evaluate proposals, arranging meeting facilities for the reviewers to meet in Huntsville, Alabama and management of the actual review meetings. Assistance in developing an Experiment Requirements Data Base and Engineering/Technical Assessment support for the MSFC Technical Evaluation Team is also being provided. The results of the project will be coordinated into a consistent set of reviews and reports by USRA. The strengths and weaknesses analysis provided by the peer panel reviewers will by used NASA personnel in the selection of experiments for implementation on the Space Station Freedom.

Wikipedia vs peer-reviewed medical literature for information about the 10 most costly medical conditions.

PubMed

Hasty, Robert T; Garbalosa, Ryan C; Barbato, Vincenzo A; Valdes, Pedro J; Powers, David W; Hernandez, Emmanuel; John, Jones S; Suciu, Gabriel; Qureshi, Farheen; Popa-Radu, Matei; San Jose, Sergio; Drexler, Nathaniel; Patankar, Rohan; Paz, Jose R; King, Christopher W; Gerber, Hilary N; Valladares, Michael G; Somji, Alyaz A

2014-05-01

Since its launch in 2001, Wikipedia has become the most popular general reference site on the Internet and a popular source of health care information. To evaluate the accuracy of this resource, the authors compared Wikipedia articles on the most costly medical conditions with standard, evidence-based, peer-reviewed sources. The top 10 most costly conditions in terms of public and private expenditure in the United States were identified, and a Wikipedia article corresponding to each topic was chosen. In a blinded process, 2 randomly assigned investigators independently reviewed each article and identified all assertions (ie, implication or statement of fact) made in it. The reviewer then conducted a literature search to determine whether each assertion was supported by evidence. The assertions found by each reviewer were compared and analyzed to determine whether assertions made by Wikipedia for these conditions were supported by peer-reviewed sources. For commonly identified assertions, there was statistically significant discordance between 9 of the 10 selected Wikipedia articles (coronary artery disease, lung cancer, major depressive disorder, osteoarthritis, chronic obstructive pulmonary disease, hypertension, diabetes mellitus, back pain, and hyperlipidemia) and their corresponding peer-reviewed sources (P<.05) and for all assertions made by Wikipedia for these medical conditions (P<.05 for all 9). Most Wikipedia articles representing the 10 most costly medical conditions in the United States contain many errors when checked against standard peer-reviewed sources. Caution should be used when using Wikipedia to answer questions regarding patient care.

Role of inspectors in external review mechanisms: criteria for selection, training and appraisal.

PubMed

Plebani, M

2001-07-20

There is a wide consensus that an external review mechanism, both in the form of a peer review, accreditation and certification according to the ISO 9000 series, is more than its standards. The survey process, the role of inspectors and standard interpretation contribute to the essence of the programme itself. Above all, the criteria used for the selection, training and appraisal of inspectors are of paramount importance. While the ISO norms do not require certification bodies to employ "peer reviewers" for the healthcare sector, experience in this sector is the main criterion for recruiting inspectors in accreditation and peer review programmes. However, the ISO/IEC Guide 58, for the setting up and operation of a laboratory accreditation body, specifies that inspectors should have appropriate technical knowledge of the specific calibrations, tests or types of calibration or tests for which accreditation is sought. Training, updating and assessment of inspectors are clearly defined under ISO, but are also systematic under accreditation programmes. Part-time inspectors who are professionals currently practising in a healthcare facility and are in touch with the day-to-day work reality are preferred for accreditation programmes which have self-regulation, education and quality improvement as their main concerns, while full-time and external inspectors are used in external review mechanisms with registration and certification as their main concerns. As well as harmonising the standards for accreditation, it is important to obtain consensus on the criteria to use for the selection, training and assessment of inspectors in order to ensure that different national or international programmes gain mutual recognition.

Sarcomas in north west England: I. Histopathological peer review.

PubMed

Harris, M; Hartley, A L; Blair, V; Birch, J M; Banerjee, S S; Freemont, A J; McClure, J; McWilliam, L J

1991-08-01

A total of 468 cases of bone, soft tissue and visceral sarcomas (and certain other tumours) diagnosed during the years 1982-84 in North West England were entered in a study of histopathological peer review, incidence and survival. This paper describes the effects of peer review. Material was reviewed by a panel of five pathologists for 413 of the 450 cases originally registered as sarcomas with the Regional Cancer Registry. The diagnosis of sarcomas was confirmed in 76% cases and and there was agreement on sub-type for 53% cases. Measures of agreement were lowest for the two sub-types most commonly diagnosed i.e. malignant fibrous histiocytoma and leiomyosarcoma. Degree of agreement between individual pathologists and final panel diagnosis was also very variable but never less than 65%. It is concluded that second opinion is essential in cases of presumed sarcomas for studies of incidence and aetiology and to ensure that appropriate treatment is selected.

The EUVE Proposal Database

NASA Astrophysics Data System (ADS)

Christian, C. A.; Olson, E. C.

1993-01-01

The proposal database and scheduling system for the Extreme Ultraviolet Explorer is described. The proposal database has been implemented to take input for approved observations selected by the EUVE Peer Review Panel and output target information suitable for the scheduling system to digest. The scheduling system is a hybrid of the SPIKE program and EUVE software which checks spacecraft constraints, produces a proposed schedule and selects spacecraft orientations with optimal configurations for acquiring star trackers, etc. This system is used to schedule the In Orbit Calibration activities that took place this summer, following the EUVE launch in early June 1992. The strategy we have implemented has implications for the selection of approved targets, which have impacted the Peer Review process. In addition, we will discuss how the proposal database, founded on Sybase, controls the processing of EUVE Guest Observer data.

Guest Editorial

NASA Astrophysics Data System (ADS)

Saravanan, Padmanapan; Babu, Dhanakotti Rajan; Chelvane, Jeyaramane Arout; Vizhi, Rajasekaran Ezhil

2016-11-01

This special issue of Journal of Magnetism and Magnetic Materials (JMMM) is a collection of selected papers presented at the International Conference on Magnetic Materials and Applications (ICMAGMA-2015), held at VIT University, Vellore, India during December 2 - 4, 2015. The papers were screened and selected for publication after an intensive peer review, with a minimum of two reviewers for every paper. The editors would like to place on record the unstinted support received from over 100 reviewers which culminated in the selection of 49 manuscripts for publication. We take this opportunity to thank everyone for participating in the ICMAGMA-2015.

Peer teaching as an educational tool in Pharmacy schools; fruitful or futile.

PubMed

Aburahma, Mona Hassan; Mohamed, Heba Moustafa

2017-11-01

In the past decade, various health care programs have implemented diverse types of peer-assisted learning (PAL) programs, in particularly peer teaching (PT), due to their reported benefits for students (both those undertaking teaching and those being taught), teachers, and educational institutes. Unfortunately, peer teaching is still under-recognized in pharmacy programs worldwide when compared to other health care programs. The aim of this review is to provide an overview of the published literature centered on formal PT programs that are implemented in pharmacy schools. In addition, this review focuses on the methodologies adopted for peer teacher recruitment and training as well as the benefits gained by students (both those undertaking teaching and those being taught). The rationales behind PT implementation are recapitulated as well. Finally, a simple scheme for successful implementation of PT activity is provided to serve as a groundwork for educators. Pre-defined key terms were used to search for experimental peer teaching activities in pharmacy schools between January 2000 and June 2016. Titles were selected based on pre-set eligibility criteria. Only complete research articles with clear design and evaluation sections were included in this review. Studies about inter-professional peer teaching activities between pharmacy students and other healthcare professions were also included. Six relevant educational research articles containing peer teaching activities were included. A lot of variety exists between different pharmacy courses implementing PT, the format/setting of PT, how peer teachers are selected, and how training and evaluation are implemented. The studies reviewed confirmed that PT was well received by most of the students and had a positive impact on their learning outcome. These findings cannot be generalized due to the insufficient number of studies published beside their methodological limitations and inadequate descriptions of the PT format. Though PT may be regarded as a feasible teaching strategy, care must be taken during implementation to ensure the fulfillment of the educational objectives. Proper validation of any PT initiative is required before incorporation into the pharmacy curriculum. More research using proper design and suitable sample sizes are recommended to determine the effect of PT activity on students' learning, skills development and confidence. Copyright © 2017 Elsevier Inc. All rights reserved.

Daily peer review of abnormal cervical smears in the assessment of individual practice as an additional method of internal quality control.

PubMed

Confortini, M; Di Stefano, C; Biggeri, A; Bulgaresi, P; Di Claudio, G; Grisotto, L; Maddau, C; Matucci, M; Petreschi, C; Troni, G M; Turco, P; Foxi, P

2016-02-01

An important internal quality control system used in the Cancer Prevention and Research Institute cytopathology laboratory in Florence is the peer review procedure, based on the review of all abnormal cytological smears which routinely emerge. Peer review is an important training opportunity for all cytologists, especially for those with less experience. This article shows the results of the peer review procedure. Of the 63 754 Papanicolaou (Pap) smears screened in 2011, 1086 were considered to be abnormal [at least atypical squamous cells of undetermined significance (ASC-US+)] on primary screening (selected by a single cytologist) and were subjected to the peer review procedure. The overall performance of the laboratory's cytologists was evaluated using a multiple rater analysis and the comparison of each cytologist with the final diagnosis. Further, the agreement was assessed by means of Cohen's kappa and weighted kappa statistics. In general, a moderate/substantial level of agreement between the ten cytologists and the final diagnoses was evident. Kappa values for each reader compared with the final diagnosis ranged from 0.54 to 0.69. The overall kappa value was 0.62 [95% confidence interval (CI), 0.58-0.66] and overall weighted kappa value was 0.76 (95% CI, 0.74-0.79). The category-specific agreement showed the lowest values for atypical squamous cells, cannot exclude high-grade squamous intraepithelial lesion (ASC-H). In summary, peer review represents an important internal quality control in the evaluation and improvement of inter-observer agreement and of the functioning of the laboratory as a whole. Multi-head microscope sessions may improve particularly the reproducibility of borderline diagnoses and, above all, can be an important training contribution for cytologists. © 2014 John Wiley & Sons Ltd.

A systematic review protocol: social network analysis of tobacco use.

PubMed

Maddox, Raglan; Davey, Rachel; Lovett, Ray; van der Sterren, Anke; Corbett, Joan; Cochrane, Tom

2014-08-08

Tobacco use is the single most preventable cause of death in the world. Evidence indicates that behaviours such as tobacco use can influence social networks, and that social network structures can influence behaviours. Social network analysis provides a set of analytic tools to undertake methodical analysis of social networks. We will undertake a systematic review to provide a comprehensive synthesis of the literature regarding social network analysis and tobacco use. The review will answer the following research questions: among participants who use tobacco, does social network structure/position influence tobacco use? Does tobacco use influence peer selection? Does peer selection influence tobacco use? We will follow the Preferred Reporting Items for Systemic Reviews and Meta-Analyses (PRISMA) guidelines and search the following databases for relevant articles: CINAHL (Cumulative Index to Nursing and Allied Health Literature); Informit Health Collection; PsycINFO; PubMed/MEDLINE; Scopus/Embase; Web of Science; and the Wiley Online Library. Keywords include tobacco; smoking; smokeless; cigarettes; cigar and 'social network' and reference lists of included articles will be hand searched. Studies will be included that provide descriptions of social network analysis of tobacco use.Qualitative, quantitative and mixed method data that meets the inclusion criteria for the review, including methodological rigour, credibility and quality standards, will be synthesized using narrative synthesis. Results will be presented using outcome statistics that address each of the research questions. This systematic review will provide a timely evidence base on the role of social network analysis of tobacco use, forming a basis for future research, policy and practice in this area. This systematic review will synthesise the evidence, supporting the hypothesis that social network structures can influence tobacco use. This will also include exploring the relationship between social network structure, social network position, peer selection, peer influence and tobacco use across all age groups, and across different demographics. The research will increase our understanding of social networks and their impact on tobacco use, informing policy and practice while highlighting gaps in the literature and areas for further research.

Entering new publication territory in chemoinformatics and chemical information science.

PubMed

Bajorath, Jürgen

2015-01-01

The F1000Research publishing platform offers the opportunity to launch themed article collections as a part of its dynamic publication environment. The idea of article collections is further expanded through the generation of publication channels that focus on specific scientific areas or disciplines. This editorial introduces the Chemical Information Science channel of F1000Research designed to collate high-quality publications and foster a culture of open peer review. Articles will be selected by guest editor(s) and a group of experts, the channel Editorial Board, and subjected to open peer review.

Does the Committee Peer Review Select the Best Applicants for Funding? An Investigation of the Selection Process for Two European Molecular Biology Organization Programmes

PubMed Central

Bornmann, Lutz; Wallon, Gerlind; Ledin, Anna

2008-01-01

Does peer review fulfill its declared objective of identifying the best science and the best scientists? In order to answer this question we analyzed the Long-Term Fellowship and the Young Investigator programmes of the European Molecular Biology Organization. Both programmes aim to identify and support the best post doctoral fellows and young group leaders in the life sciences. We checked the association between the selection decisions and the scientific performance of the applicants. Our study involved publication and citation data for 668 applicants to the Long-Term Fellowship programme from the year 1998 (130 approved, 538 rejected) and 297 applicants to the Young Investigator programme (39 approved and 258 rejected applicants) from the years 2001 and 2002. If quantity and impact of research publications are used as a criterion for scientific achievement, the results of (zero-truncated) negative binomial models show that the peer review process indeed selects scientists who perform on a higher level than the rejected ones subsequent to application. We determined the extent of errors due to over-estimation (type I errors) and under-estimation (type 2 errors) of future scientific performance. Our statistical analyses point out that between 26% and 48% of the decisions made to award or reject an application show one of both error types. Even though for a part of the applicants, the selection committee did not correctly estimate the applicant's future performance, the results show a statistically significant association between selection decisions and the applicants' scientific achievements, if quantity and impact of research publications are used as a criterion for scientific achievement. PMID:18941530

Teaching Students with Intellectual or Developmental Disabilities to Write: A Review of the Literature

ERIC Educational Resources Information Center

Joseph, Laurice M.; Konrad, Moira

2009-01-01

The purpose of this review was to identify effective methods for teaching writing to students with intellectual disabilities. After criteria were established, database searches and hand searches of selected peer-reviewed journals were conducted. Findings revealed a relatively small number of studies that met the criteria for inclusion.…

Effectiveness of community-based peer support for mothers to improve their breastfeeding practices: A systematic review and meta-analysis

PubMed Central

Koyama, Momoko; Rai, Sarju Sing; Miyaguchi, Moe; Dhakal, Sumi; Sandy, Su; Sunguya, Bruno Fokas; Jimba, Masamine

2017-01-01

Breastfeeding is associated with reduced mortality in children aged less than 5 years. We conducted a systematic review and meta-analysis (registered as PROSPERO 2015: CRD42015019105) to examine the effectiveness of community-based peer support for mothers on their breastfeeding practices as compared to mothers who have not received such a support. Methods We searched for evidence regarding community-based peer support for mothers in databases, such as PubMed/MEDLINE, the Cochrane Library, CINAHL, Web of Science, SocINDEX, and PsycINFO. We selected three outcome variables for breastfeeding practices, namely, exclusive breastfeeding duration, breastfeeding within the first hour of life, and prelacteal feeding. We conducted meta-analyses of the included randomized controlled trials and quasi-experimental studies. Results For our review, we selected 47 articles for synthesis out of 1,855 retrieved articles. In low- and middle-income countries, compared to usual care, community-based peer support increased exclusive breastfeeding at 3 months (RR: 1.90, 95% CI: 1.62–2.22), at 5 months (RR: 9.55, 95% CI: 6.65–13.70) and at 6 months (RR: 3.53, 95% CI: 2.49–5.00). In high-income countries, compared to usual care, peer support increased exclusive breastfeeding at 3 months (RR: 2.61, 95% CI: 1.15–5.95). In low- and middle-income countries, compared to usual care, peer support increased the initiation of breastfeeding within the first hour of life (RR: 1.51, 95% CI: 1.04–2.21) and decreased the risk of prelacteal feeding (RR: 0.38, 95% CI: 0.33–0.45). Conclusions Community-based peer support for mothers is effective in increasing the duration of exclusive breastfeeding, particularly for infants aged 3–6 months in low- and middle-income countries. Such support also encourages mothers to initiate breastfeeding early and prevents newborn prelacteal feeding. PMID:28510603

NASA Product Peer Review Process

NASA Technical Reports Server (NTRS)

Jenks, Ken

2009-01-01

This viewgraph presentation describes NASA's product peer review process. The contents include: 1) Inspection/Peer Review at NASA; 2) Reasons for product peer reviews; 3) Different types of peer reviews; and 4) NASA requirements for peer reviews. This presentation also includes a demonstration of an actual product peer review.

Do continuing medical education articles foster shared decision making?

PubMed

Labrecque, Michel; Lafortune, Valérie; Lajeunesse, Judith; Lambert-Perrault, Anne-Marie; Manrique, Hermes; Blais, Johanne; Légaré, France

2010-01-01

Defined as reviews of clinical aspects of a specific health problem published in peer-reviewed and non-peer-reviewed medical journals, offered without charge, continuing medical education (CME) articles form a key strategy for translating knowledge into practice. This study assessed CME articles for mention of evidence-based information on benefits and harms of available treatment and/or preventive options that are deemed essential for shared decision making (SDM) to occur in clinical practice. Articles were selected from 5 medical journals that publish CME articles and are provided free of charge to primary-care physicians of the Province of Quebec, Canada. Two individuals independently scored each article with the use of a 10-item checklist based on the International Patient Decision Aid Standards. In case of discrepancy, the item score was established by team consensus. Scores were added to produce a total article score ranging from 0 (no item present) to 10 (all items present). Thirty articles (6 articles per journal) were selected. Total article scores ranged from 1 to 9, with a mean (+/- SD) of 3.1 +/- 2.0 (95% confidence interval 2.8-4.3). Health conditions and treatment options were the items most frequently discussed in the articles; next came treatment benefits. Possible harms, the use of the same denominators for benefits and harms, and methods to facilitate the communication of benefits and harms to patients were almost never described. No significant differences between journals were observed. The CME articles evaluated did not include the evidence-based information necessary to foster SDM in clinical practice. Peer-reviewed and non-peer-reviewed medical journals should require CME articles to include this type of information.

28 CFR 34.109 - Qualifications of peer reviewers.

Code of Federal Regulations, 2010 CFR

2010-07-01

... Section 34.109 Judicial Administration DEPARTMENT OF JUSTICE OJJDP COMPETITION AND PEER REVIEW PROCEDURES Peer Review § 34.109 Qualifications of peer reviewers. The general reviewer qualification criteria to...). Additional details concerning peer reviewer qualifications are provided in the OJJDP “Peer Review Guideline”. ...

Self-Report Measures of Parent-Adolescent Attachment and Separation-Individuation: A Selective Review.

ERIC Educational Resources Information Center

Lopez, Frederick G.; Gover, Mark R.

1993-01-01

Reviews and critiques three self-report measures of parent-adolescent attachment (Parental Bonding Instrument, Parental Attachment Questionnaire, Inventory of Parent and Peer Attachment) and three self-report measures of parent-adolescent separation-individuation (Psychological Separation Inventory, Personal Authority in the Family System…

The Impact of Computer-Mediated Communication Environments on Foreign Language Learning: A Review of the Literature

ERIC Educational Resources Information Center

Mahdi, Hassan Saleh

2014-01-01

This article reviews the literature on the implementation of computer-mediated communication (CMC) in language learning, aiming at understanding how CMC environments have been implemented to foster language learning. The paper draws on 40 recent research articles selected from 10 peer-reviewed journals, 2 book chapters and one conference…

Literature and Practice: A Critical Review of MOOCs

ERIC Educational Resources Information Center

Chiappe-Laverde, Andres; Hine, Nicolas; Martínez-Silva, Jose Andres

2015-01-01

This article focuses on a review of both literature and practical experiences concerning MOOCs. The literature analyzed was published in peer-reviewed journals between 2007 and 2013. 268 items were selected for this study, of which 100 were analyzed in detail. The issues raised by this analysis were used as the criteria for the analysis of 10…

A qualitative synthesis of the positive and negative impacts related to delivery of peer-based health interventions in prison settings.

PubMed

South, Jane; Woodall, James; Kinsella, Karina; Bagnall, Anne-Marie

2016-09-29

Peer interventions involving prisoners in delivering peer education and peer support in a prison setting can address health need and add capacity for health services operating in this setting. This paper reports on a qualitative synthesis conducted as part of a systematic review of prison-based peer interventions. One of the review questions aimed to investigate the positive and negative impacts of delivering peer interventions within prison settings. This covered organisational and process issues relating to peer interventions, including prisoner and staff views. A qualitative synthesis of qualitative and mixed method studies was undertaken. The overall study design comprised a systematic review involving searching, study selection, data extraction and validity assessment. Studies reporting interventions with prisoners or ex-prisoners delivering education or support to prisoners resident in any type of prison or young offender institution, all ages, male and female, were included. A thematic synthesis was undertaken with a subset of studies reporting qualitative data (n = 33). This involved free coding of text reporting qualitative findings to develop a set of codes, which were then grouped into thematic categories and mapped back to the review question. Themes on process issues and wider impacts were grouped into four thematic categories: peer recruitment training and support; organisational support; prisoner relationships; prison life. There was consistent qualitative evidence on the need for organisational support within the prison to ensure smooth implementation and on managing security risks when prisoners were involved in service delivery. A suite of factors affecting the delivery of peer interventions and the wider organisation of prison life were identified. Alongside reported benefits of peer delivery, some reasons for non-utilisation of services by other prisoners were found. There was weak qualitative evidence on wider impacts on the prison system, including better communication between staff and prisoners. Gaps in evidence were identified. The quality of included studies limited the strength of the conclusions. The main conclusion is that peer interventions cannot be seen as independent of prison life and health services need to work in partnership with prison services to deliver peer interventions. More research is needed on long-term impacts. PROSPERO ref: CRD42012002349 .

Readers' evaluation of effect of peer review and editing on quality of articles in the Nederlands Tijdschrift voor Geneeskunde.

PubMed

Pierie, J P; Walvoort, H C; Overbeke, A J

1996-11-30

Academic biomedical journals use peer review and editing to help to select and improve the quality of articles. We have investigated whether articles accepted by the Nederlands Tijdschrift voor Geneeskunde, the Dutch Journal of Medicine, were improved after peer review and editing (post-acceptance scientific and copy editing). 400 readers of the journal (100 each of medical students, recent medical graduates, general practitioners, and specialists) were invited to participate in a questionnaire survey. The first 25 from each group who agreed to participate were included. We posted a pack containing a set of identically appearing typescripts (ie, blinding) of the submitted, accepted, and published versions of 50 articles that had been published in Ned Tijdschr Geneeskd. Each evaluator received two of the sets of versions, and each set was evaluated by one person from each group. The package also included two questionnaires: the first was used to compare the submitted with the accepted version (25 questions), the second compared the accepted with the published version (17 questions). The questions were answered on five-point scales, and were about the quality of the articles or were general/overall scores. We analysed the data as scores of 3-5 (ie, improvement) versus 1-2. After peer review, the quality in 14 of 23 questions (61%) was significantly improved (p = 0.03 or smaller). In particular, the overall score and general medical value were significantly improved (p = 0.00001 for each). Editing led to significant improvement in 11 of 16 questions (69%, p = 0.017 or smaller), and especially in style and readability (p = 0.001 and p = 0.004). Generally, we found no differences between the scores of the four categories of evaluators. 72% of the evaluators correctly identified which version was which. Evaluations by readers of the Ned Tijdschr Geneeskd indicated significant improvement of published articles after both peer review and editing. We think that peer review and editing are worthwhile tasks. We also think that possible biases would have had a negligible effect on our results (including the fact that we selected the first 25 evaluators who responded, that some evaluators may have read the published version, and that one questionnaire may have looked more scientific than the other, more editorial one).

Peer reviewing e-learning: opportunities, challenges, and solutions.

PubMed

Ruiz, Jorge G; Candler, Chris; Teasdale, Thomas A

2007-05-01

Peer review is the foundation of academic publication and a necessary step in the scrutiny of any scholarly work. Simply defined, peer review is the attentive, unbiased assessment of any scholarly work that is submitted for formal scrutiny. Although medical school faculty increasingly use technology in clinical teaching, e-learning materials are often not subjected to a rigorous peer review process. The authors contrast peer review of e-learning materials with that of print materials, describe peer review issues regarding e-learning materials, propose approaches to address the challenges of peer review of e-learning materials, and outline directions for refinement of the e-learning peer review process. At its core, the peer review of e-learning materials should not differ substantially from that of traditional manuscripts. However, e-learning introduces new demands that impel reviewers to consider aspects that are unique to educational technology, including pedagogy, format, usability, navigation, interactivity, delivery, ease of updating, distribution, and access. Four approaches are offered to ease the burden and improve the quality of e-learning peer review: develop peer review training, embrace multidisciplinary peer review, develop guidelines, and provide incentives and compensation. The authors conclude with suggestions about peer review research.

Factors that Affect Emergent Literacy Development When Engaging with Electronic Books

ERIC Educational Resources Information Center

Salmon, Lynda G.

2014-01-01

This article reviews extant literature with the purpose of identifying factors that affect the potential efficacy of electronic books to support literacy development during early childhood. Selection criteria include experimental, quasi-experimental, and observational studies from peer-reviewed journals from 2000 to 2013 with a target population…

28 CFR 34.106 - Number of peer reviewers.

Code of Federal Regulations, 2010 CFR

2010-07-01

... 28 Judicial Administration 1 2010-07-01 2010-07-01 false Number of peer reviewers. 34.106 Section 34.106 Judicial Administration DEPARTMENT OF JUSTICE OJJDP COMPETITION AND PEER REVIEW PROCEDURES Peer Review § 34.106 Number of peer reviewers. The number of peer reviewers will vary by program (as...

28 CFR 34.106 - Number of peer reviewers.

Code of Federal Regulations, 2013 CFR

2013-07-01

... 28 Judicial Administration 1 2013-07-01 2013-07-01 false Number of peer reviewers. 34.106 Section 34.106 Judicial Administration DEPARTMENT OF JUSTICE OJJDP COMPETITION AND PEER REVIEW PROCEDURES Peer Review § 34.106 Number of peer reviewers. The number of peer reviewers will vary by program (as...

How to Write a Scholarly Book Review for Publication in a Peer-Reviewed Journal

PubMed Central

Lee, Alexander D.; Green, Bart N.; Johnson, Claire D.; Nyquist, Julie

2010-01-01

Purpose: To describe and discuss the processes used to write scholarly book reviews for publication in peer-reviewed journals and to provide a recommended strategy and book appraisal worksheet to use when conducting book reviews. Methods: A literature search of MEDLINE, EMBASE, CINAHL, and the Index to Chiropractic Literature was conducted in June 2009 using a combination of controlled vocabulary and truncated text words to capture articles relevant to writing scholarly book reviews for publication in peer-reviewed journals. Results: The initial search identified 839 citations. Following the removal of duplicates and the application of selection criteria, a total of 78 articles were included in this review including narrative commentaries (n = 26), editorials or journal announcements (n = 25), original research (n = 18), and journal correspondence pieces (n = 9). Discussion: Recommendations for planning and writing an objective and quality book review are presented based on the evidence gleaned from the articles reviewed and from the authors' experiences. A worksheet for conducting a book review is provided. Conclusions: The scholarly book review serves many purposes and has the potential to be an influential literary form. The process of publishing a successful scholarly book review requires the reviewer to appreciate the book review publication process and to be aware of the skills and strategies involved in writing a successful review. PMID:20480015

Do peer review models affect clinicians' trust in journals? A survey of junior doctors.

PubMed

Patel, Jigisha; Pierce, Mary; Boughton, Stephanie L; Baldeweg, Stephanie E

2017-01-01

The aim of this survey was to determine the level of awareness and understanding of peer review and peer review models amongst junior hospital doctors and whether this influences clinical decision-making. A 30-question online anonymous survey was developed aimed at determining awareness of peer review models and the purpose of peer review, perceived trustworthiness of different peer review models and the role of peer review in clinical decision-making. It was sent to 800 trainee doctors in medical specialties on the University College London Partners trainee database. The response rate was (178/800) 22%. Most respondents were specialist registrars. Checking that research is conducted correctly (152/178, 85%) and the data interpreted correctly (148/178, 83%) were viewed as the most important purposes of peer review. Most respondents were aware of open (133/178, 75%), double-blind (125/178, 70%) and single-blind peer review (121/178, 68%). 101/178 (57%) had heard of collaborative, 87/178 (49%) of post publication and 29/178 (16%) of decoupled peer review. Of those who were aware of double-blind, single-blind open and collaborative peer review, 85 (68%), 82 (68%), 74 (56%) and 24 (24%), respectively, understood how they worked. The NEJM , Lancet and The BMJ were deemed to have most trustworthy peer review, 137/178 (77%), 129/178 (72%) and 115/178 (65%), respectively. That peer review had taken place was important for a journal content to be used for clinical decision-making 152/178 (85%), but the ability to see peer review reports was not as important 22/178 (12%). Most felt there was a need for peer review training and that this should be at the specialist registrar stage of training. Junior hospital doctors view peer review to be important as a means of quality control, but do not value the ability to scrutinize peer review themselves. The unquestioning acceptance of peer review as final validation in the field of medicine emphasises not only the responsibility held by medical journals to ensure peer review is done well but also the need to raise awareness amongst the medical community of the limitations of the current peer review process.

LactMed: Drugs and Lactation Database

MedlinePlus

... App LactMed Record Format Database Creation & Peer Review Process Help Fact Sheet Sample Record TOXNET FAQ Glossary Selected References About Dietary Supplements Breastfeeding Links Get LactMed Widget Contact Us Email: tehip@ ...

Clinical peer review in the United States: history, legal development and subsequent abuse.

PubMed

Vyas, Dinesh; Hozain, Ahmed E

2014-06-07

The Joint Commission on Accreditation requires hospitals to conduct peer review to retain accreditation. Despite the intended purpose of improving quality medical care, the peer review process has suffered several setbacks throughout its tenure. In the 1980s, abuse of peer review for personal economic interest led to a highly publicized multimillion-dollar verdict by the United States Supreme Court against the perpetrating physicians and hospital. The verdict led to decreased physician participation for fear of possible litigation. Believing that peer review was critical to quality medical care, Congress subsequently enacted the Health Care Quality Improvement Act (HCQIA) granting comprehensive legal immunity for peer reviewers to increase participation. While serving its intended goal, HCQIA has also granted peer reviewers significant immunity likely emboldening abuses resulting in Sham Peer Reviews. While legal reform of HCQIA is necessary to reduce sham peer reviews, further measures including the need for standardization of the peer review process alongside external organizational monitoring are critical to improving peer review and reducing the prevalence of sham peer reviews.

Clinical peer review in the United States: History, legal development and subsequent abuse

PubMed Central

Vyas, Dinesh; Hozain, Ahmed E

2014-01-01

The Joint Commission on Accreditation requires hospitals to conduct peer review to retain accreditation. Despite the intended purpose of improving quality medical care, the peer review process has suffered several setbacks throughout its tenure. In the 1980s, abuse of peer review for personal economic interest led to a highly publicized multimillion-dollar verdict by the United States Supreme Court against the perpetrating physicians and hospital. The verdict led to decreased physician participation for fear of possible litigation. Believing that peer review was critical to quality medical care, Congress subsequently enacted the Health Care Quality Improvement Act (HCQIA) granting comprehensive legal immunity for peer reviewers to increase participation. While serving its intended goal, HCQIA has also granted peer reviewers significant immunity likely emboldening abuses resulting in Sham Peer Reviews. While legal reform of HCQIA is necessary to reduce sham peer reviews, further measures including the need for standardization of the peer review process alongside external organizational monitoring are critical to improving peer review and reducing the prevalence of sham peer reviews. PMID:24914357

Open peer review at four STEM journals: an observational overview.

PubMed

Ford, Emily

2015-01-01

Open peer review, peer review where authors' and reviewers' identities are disclosed to one another, is a growing trend in scholarly publishing. Through observation of four journals in STEM disciplines, PLOS One, Atmospheric Chemistry & Physics, PeerJ, and F1000Research, an observational overview is conducted. The overview relies on defined characteristics of open peer review. Results show that despite differing open peer review implementations, each journal retains editorial involvement in scholarly publishing. Further, the analysis shows that only one of these implementations is fully transparent in its peer review and decision making process. Finally, the overview contends that journals should clearly outline peer review and editorial processes in order to allow for open peer review to be better understood and adopted by authors, reviewers, editors, and readers of science communications.

Southeastern Virtual Institute for Health Equity and Wellness (SE VIEW)

DTIC Science & Technology

2014-07-01

The Obesity Society (September 2012). We intend to publish at least one manuscript but additional analysis for publication in a peer reviewed ... reviewed by an academic as well as a community reviewer and were selected based on the strength of the partnership and the potential for continued...Clinical Endocrinology and Metabolism and Diabetes Reviews . He is a member of the American Society for Clinical Investigation, the

Open Peer Review by a Selected-Papers Network

PubMed Central

Lee, Christopher

2011-01-01

A selected-papers (SP) network is a network in which researchers who read, write, and review articles subscribe to each other based on common interests. Instead of reviewing a manuscript in secret for the Editor of a journal, each reviewer simply publishes his review (typically of a paper he wishes to recommend) to his SP network subscribers. Once the SP network reviewers complete their review decisions, the authors can invite any journal editor they want to consider these reviews and initial audience size, and make a publication decision. Since all impact assessment, reviews, and revisions are complete, this decision process should be short. I show how the SP network can provide a new way of measuring impact, catalyze the emergence of new subfields, and accelerate discovery in existing fields, by providing each reader a fine-grained filter for high-impact. I present a three phase plan for building a basic SP network, and making it an effective peer review platform that can be used by journals, conferences, users of repositories such as arXiv, and users of search engines such as PubMed. I show how the SP network can greatly improve review and dissemination of research articles in areas that are not well-supported by existing journals. Finally, I illustrate how the SP network concept can work well with existing publication services such as journals, conferences, arXiv, PubMed, and online citation management sites. PMID:22291635

Perspective from the Department of Defense Breast Cancer Research Program.

PubMed

Rich, I M; Andejeski, Y; Alciati, M H; Crawford Bisceglio, I; Breslau, E S; McCall, L; Valadez, A

1998-12-01

The Department of Defense (DOD), Breast Cancer Research Program (BCRP) was established in 1993. Since its inception, Congress has appropriated more than 878 million dollars for the BCRP, a unique public-private partnership between the DOD, consumer advocacy, and scientific communities which has funded approximately 1,800 breast cancer research grants. Through this partnership, the BCRP designed a model program for consumer involvement in scientific peer review. This paper describes the BCRP's approach to the processes of recruitment, selection, and preparation of consumers for this expanded role. Further, factors critical to program implementation, such as effective program management, ongoing process improvement, strong program leadership, and allocation of resources, that led to the BCRP's success in developing the previously undefined role of breast cancer survivors as members of scientific peer review panels are discussed. The BCRP demonstrates the feasibility and unique contributions of consumers in scientific peer review and provides a critical foundation for future efforts to ensure consumer involvement in scientific research programs.

An approach to peer review in forensic pathology.

PubMed

Sims, D Noel; Langlois, Neil E I; Byard, Roger W

2013-07-01

Peer review in forensic pathology has been a long time in evolution but may provide a very useful mechanism to check for, and to correct, errors, in addition to establishing an important educative vehicle for pathologists. A process is reported that has been established at our institution that involves both informal peer review in the mortuary and formal auditing of a set number of cases. Every autopsy case is discussed at a daily meeting of pathologists before a provisional cause of death is released. In addition, one in ten cases including all homicides, deaths in custody, suspicious and paediatric cases, and randomly selected additional cases undergo formal auditing by a second pathologist. Finally, administrative staff check the completed report. This formalized process, in a jurisdiction where autopsies are usually performed by only one pathologist, has been extremely useful in standardizing autopsy reports and in enabling pathologists to discuss cases and associated issues on a regular basis. Copyright © 2013 Elsevier Ltd and Faculty of Forensic and Legal Medicine. All rights reserved.

A re-audit of the use of definitions of sudden infant death syndrome (SIDS) in peer-reviewed literature.

PubMed

Byard, Roger W; Lee, Vivian

2012-11-01

The use of different definitions of sudden infant death syndrome (SIDS) may make comparison of data among studies difficult. Fifty randomly selected papers dealing with SIDS that were published between 2010 and 2011 in peer-reviewed journals were reviewed to determine whether one of three internationally accepted definitions of SIDS had been either written in the text or referenced. A significant improvement in the use of definitions has occurred since 2005, with the percentage of papers either quoting or referencing a standard definition increasing by 26%, from 42 to 68%. The 1989 NICHD definition remained the most commonly used definition (35.1%) followed by the 2004 San Diego definition (26.3%). Although the percentage of papers where either no definition was provided or where an idiosyncratic or mis-cited definition was used fell 26%, from 58 to 32%, nearly one in three papers published on SIDS in peer-reviewed journals that were included in this study still did not cite a standard definition. Copyright © 2012 Elsevier Ltd and Faculty of Forensic and Legal Medicine. All rights reserved.

Group consensus peer review in radiation oncology: commitment to quality.

PubMed

Duggar, W Neil; Bhandari, Rahul; Yang, Chunli Claus; Vijayakumar, Srinivasan

2018-03-27

Peer review, especially prospective peer review, has been supported by professional organizations as an important element in optimal Radiation Oncology practice based on its demonstration of efficacy at detecting and preventing errors prior to patient treatment. Implementation of peer review is not without barriers, but solutions do exist to mitigate or eliminate some of those barriers. Peer review practice at our institution involves three key elements: new patient conference, treatment planning conference, and chart rounds. The treatment planning conference is an adaptation of the group consensus peer review model from radiology which utilizes a group of peers reviewing each treatment plan prior to implementation. The peer group in radiation oncology includes Radiation Oncologists, Physician Residents, Medical Physicists, Dosimetrists, and Therapists. Thus, technical and clinical aspects of each plan are evaluated simultaneously. Though peer review is held in high regard in Radiation Oncology, many barriers commonly exist preventing optimal implementation such as time intensiveness, repetition, and distraction from clinic time with patients. Through the use of automated review tools and commitment by individuals and administration in regards to staffing, scheduling, and responsibilities, these barriers have been mitigated to implement this Group Consensus Peer Review model into a Radiation Oncology Clinic. A Group Consensus Peer Review model has been implemented with strategies to address common barriers to effective and efficient peer review.

28 CFR 34.110 - Management of peer reviews.

Code of Federal Regulations, 2010 CFR

2010-07-01

... 28 Judicial Administration 1 2010-07-01 2010-07-01 false Management of peer reviews. 34.110 Section 34.110 Judicial Administration DEPARTMENT OF JUSTICE OJJDP COMPETITION AND PEER REVIEW PROCEDURES Peer Review § 34.110 Management of peer reviews. A technical support contractor may assist in managing...

28 CFR 34.102 - Peer review procedures.

Code of Federal Regulations, 2010 CFR

2010-07-01

...” describes a process that evolves in accordance with experience and opportunities to effect improvements. The... Review § 34.102 Peer review procedures. The OJJDP peer review process is contained in an OJJDP “Peer... substantive and procedural matters related to the peer review process, the “Guideline” addresses such issues...

Clinical Nurse Specialists Guide Staff Nurses to Promote Practice Accountability Through Peer Review.

PubMed

Semper, Julie; Halvorson, Betty; Hersh, Mary; Torres, Clare; Lillington, Linda

2016-01-01

The aim of the study was to describe the clinical nurse specialist role in developing and implementing a staff nurse education program to promote practice accountability using peer review principles. Peer review is essential for professional nursing practice demanding a significant culture change. Clinical nurse specialists in a Magnet-designated community hospital were charged with developing a staff nurse peer review education program. Peer review is a recognized mechanism of professional self-regulation to ensure delivery of quality care. The American Nurses Association strongly urges incorporating peer review in professional nursing practice models. Clinical nurse specialists play a critical role in educating staff nurses about practice accountability. Clinical nurse specialists developed an education program guided by the American Nurses Association's principles of peer review. A baseline needs assessment identified potential barriers and learning needs. Content incorporated tools and strategies to build communication skills, collaboration, practice change, and peer accountability. The education program resulted in increased staff nurse knowledge about peer review and application of peer review principles in practice. Clinical nurse specialists played a critical role in helping staff nurses understand peer review and its application to practice. The clinical nurse specialist role will continue to be important in sustaining the application of peer review principles in practice.

The ethics of peer review in bioethics

PubMed Central

Wendler, David; Miller, Franklin

2014-01-01

A good deal has been written on the ethics of peer review, especially in the scientific and medical literatures. In contrast, we are unaware of any articles on the ethics of peer review in bioethics. Recognising this gap, we evaluate the extant proposals regarding ethical standards for peer review in general and consider how they apply to bioethics. We argue that scholars have an obligation to perform peer review based on the extent to which they personally benefit from the peer review process. We also argue, contrary to existing proposals and guidelines, that it can be appropriate for peer reviewers to benefit in their own scholarship from the manuscripts they review. With respect to bioethics in particular, we endorse double-blind review and suggest several ways in which the peer review process might be improved. PMID:24131903

Barriers and Facilitators to Scientific Writing Among Applied Epidemiologists.

PubMed

Pittman, Jessica; Stahre, Mandy; Tomedi, Laura; Wurster, Jessica

Communication in the form of written and oral reports and presentations is a core competency for epidemiologists at governmental public health agencies. Many applied epidemiologists do not publish peer-reviewed articles, limiting the scientific literature of best practices in evidence-based public health. To describe the writing and publishing experiences of applied epidemiologists and identify barriers and facilitators to publishing. Telephone focus groups and an 18-question multiple-choice and short-answer Web-based assessment were fielded in 2014. Six focus groups composed of 26 applied epidemiologists and an online assessment answered by 396 applied epidemiologists. Sample selection was stratified by years of experience. Past publishing experience, current job duties as related to publishing, barriers and facilitators to writing and publishing, and desired training in writing and publishing were assessed through focus groups and the online assessment. Focus groups identified 4 themes: job expectations, barriers to publishing, organizational culture, and the understanding of public health practice among reviewers as issues related to writing and publishing. Most respondents (80%) expressed a desire to publish; however, only 59% had published in a peer-reviewed journal. An academic appointment (among doctoral educated respondents) was identified as a facilitator to publishing as was access to peer-reviewed literature. Time (68%) was identified as the greatest barrier to writing and publishing. Other major barriers included lack of encouragement or support (33%) within the public health agency and agency clearance processes (32%). Assistance with journal selection (62%), technical writing skills (60%), and manuscript formatting (57%) were listed as the most needed trainings. Public health agencies can be facilitators for epidemiologists to contribute to the scientific literature through increasing access to the peer-reviewed literature, creating a supportive environment for writing and publishing, and investing in desired and needed training. The results have implications for modifying workplace policies surrounding writing and publishing.

HST Peer Review, Where We've Been, Where We Are Now and Possibly Where the Future Lies

NASA Astrophysics Data System (ADS)

Blacker, Brett S.; Macchetto, Duccio; Meylan, Georges; Stanghellini, Letizia; van der Marel, Roeland P.

2002-12-01

In some eyes, the Phase I proposal selection process is the most important activity handled by the Space Telescope Science Institute (STScI). Proposing for HST and other missions consists of requesting observing time and/or archival research funding. This step is called Phase I, where the scientific merit of a proposal is considered by a community based peer-review process. Accepted proposals then proceed thru Phase II, where the observations are specified in sufficient detail to enable scheduling on the telescope. Each cycle the Hubble Space Telescope (HST) Telescope Allocation Committee (TAC) reviews proposals and awards observing time that is valued at $0.5B, when the total expenditures for HST over its lifetime are figured on an annual basis. This is in fact a very important endeavor that we continue to fine-tune and tweak. This process is open to the science community and we constantly receive comments and praise for this process. Several cycles ago we instituted several significant changes to the process to address concerns such as: Fewer, broader panels, with redundancy to avoid conflicts of interest; Redefinition of the TAC role, to focus on Larger programs; and incentives for the panels to award time to medium sized proposals. In the last cycle, we offered new initiatives to try to enhance the scientific output of the telescope. Some of these initiatives were: Hubble Treasury Program; AR Legacy Program; and the AR Theory Program. This paper will outline the current HST Peer review process. We will discuss why we made changes and how we made changes from our original system. We will also discuss some ideas as to where we may go in the future to generate a stronger science program for HST and to reduce the burden on the science community. This paper is an update of the status of the HST Peer Review Process that was described in the published paper "Evolution of the HST Proposal Selection Process".

75 FR 52958 - Solicitation for Nominations for Members of the U.S. Preventive Services Task Force (USPSTF)

Federal Register 2010, 2011, 2012, 2013, 2014

2010-08-30

... on specific topics or methods. A diversity of perspectives is valuable to the work of the USPSTF. To... of research published in peer reviewed literature and in the methods of evidence review; 2... primary health care clinical experience may be selected based on their expertise in methodological issues...

Utilization and Limitations of the American College Health Association's National College Health Assessment Instrument: A Systematic Review

ERIC Educational Resources Information Center

Rahn, Rhonda N.; Pruitt, Buster; Goodson, Patricia

2016-01-01

Objective: To analyze the literature in which researchers have utilized the National College Health Assessment (NCHA) I or the NCHA II. Participants and Methods: The authors selected peer-reviewed articles published between 2004 and July 2013 utilizing a single search term: National College Health Assessment. Articles were assessed for instrument…

45 CFR 1388.9 - Peer review.

Code of Federal Regulations, 2010 CFR

2010-10-01

... 45 Public Welfare 4 2010-10-01 2010-10-01 false Peer review. 1388.9 Section 1388.9 Public Welfare... PROGRAM THE UNIVERSITY AFFILIATED PROGRAMS § 1388.9 Peer review. (a) The purpose of the peer review... D, Section 152 of the Act, must be evaluated through the peer review process. (c) Panels must be...

Peer Review in Higher Education: Student Perceptions before and after Participation

ERIC Educational Resources Information Center

Mulder, Raoul A.; Pearce, Jon M.; Baik, Chi

2014-01-01

Peer review is integral to academic endeavour, but opportunities for students to benefit from peer review in higher education remain limited, and relatively little is known about how student perceptions influence their appreciation of peer review. University student perceptions were examined before and after experiencing student peer review in…

Peer Review: Has It a Future?

ERIC Educational Resources Information Center

Soh, Kay Cheng

2013-01-01

Although its history is short, peer review has fast become a fixture of journal publications acquiring the status of a ritual in the academia. Many relevant and important issues have been raised leading to doubts about the value of peer review. The advent of electronic publishing further threatens the future of peer review. For peer review to…

40 CFR 194.27 - Peer review.

Code of Federal Regulations, 2010 CFR

2010-07-01

... 40 Protection of Environment 24 2010-07-01 2010-07-01 false Peer review. 194.27 Section 194.27... § 194.27 Peer review. (a) Any compliance application shall include documentation of peer review that has... barrier evaluation as required in § 194.44. (b) Peer review processes required in paragraph (a) of this...

The cancer of bureaucracy: how it will destroy science, medicine, education; and eventually everything else.

PubMed

Charlton, Bruce G

2010-06-01

Everyone living in modernizing 'Western' societies will have noticed the long-term, progressive growth and spread of bureaucracy infiltrating all forms of social organization: nobody loves it, many loathe it, yet it keeps expanding. Such unrelenting growth implies that bureaucracy is parasitic and its growth uncontrollable - in other words it is a cancer that eludes the host immune system. Old-fashioned functional, 'rational' bureaucracy that incorporated individual decision-making is now all-but extinct, rendered obsolete by computerization. But modern bureaucracy evolved from it, the key 'parasitic' mutation being the introduction of committees for major decision-making or decision-ratification. Committees are a fundamentally irrational, incoherent, unpredictable decision-making procedure; which has the twin advantages that it cannot be formalized and replaced by computerization, and that it generates random variation or 'noise' which provides the basis for natural selection processes. Modern bureaucracies have simultaneously grown and spread in a positive feedback cycle; such that interlinking bureaucracies now constitute the major environmental feature of human society which affects organizational survival and reproduction. Individual bureaucracies must become useless parasites which ignore the 'real-world' in order to adapt to rapidly-changing 'bureaucratic reality'. Within science, the major manifestation of bureaucracy is peer review, which - cancer-like - has expanded to obliterate individual authority and autonomy. There has been local elaboration of peer review and metastatic spread of peer review to include all major functions such as admissions, appointments, promotions, grant review, project management, research evaluation, journal and book refereeing and the award of prizes. Peer review eludes the immune system of science since it has now been accepted by other bureaucracies as intrinsically valid, such that any residual individual decision-making (no matter how effective in real-world terms) is regarded as intrinsically unreliable (self-interested and corrupt). Thus the endemic failures of peer review merely trigger demands for ever-more elaborate and widespread peer review. Just as peer review is killing science with its inefficiency and ineffectiveness, so parasitic bureaucracy is an un-containable phenomenon; dangerous to the extent that it cannot be allowed to exist unmolested, but must be utterly extirpated. Or else modernizing societies will themselves be destroyed by sclerosis, resource misallocation, incorrigibly-wrong decisions and the distortions of 'bureaucratic reality'. However, unfortunately, social collapse is the more probable outcome, since parasites can evolve more rapidly than host immune systems.

A prospective study on an innovative online forum for peer reviewing of surgical science.

PubMed

Almquist, Martin; von Allmen, Regula S; Carradice, Dan; Oosterling, Steven J; McFarlane, Kirsty; Wijnhoven, Bas

2017-01-01

Peer review is important to the scientific process. However, the present system has been criticised and accused of bias, lack of transparency, failure to detect significant breakthrough and error. At the British Journal of Surgery (BJS), after surveying authors' and reviewers' opinions on peer review, we piloted an open online forum with the aim of improving the peer review process. In December 2014, a web-based survey assessing attitudes towards open online review was sent to reviewers with a BJS account in Scholar One. From April to June 2015, authors were invited to allow their manuscripts to undergo online peer review in addition to the standard peer review process. The quality of each review was evaluated by editors and editorial assistants using a validated instrument based on a Likert scale. The survey was sent to 6635 reviewers. In all, 1454 (21.9%) responded. Support for online peer review was strong, with only 10% stating that they would not subject their manuscripts to online peer review. The most prevalent concern was about intellectual property, being highlighted in 118 of 284 comments (41.5%). Out of 265 eligible manuscripts, 110 were included in the online peer review trial. Around 7000 potential reviewers were invited to review each manuscript. In all, 44 of 110 manuscripts (40%) received 100 reviews from 59 reviewers, alongside 115 conventional reviews. The quality of the open forum reviews was lower than for conventional reviews (2.13 (± 0.75) versus 2.84 (± 0.71), P<0.001). Open online peer review is feasible in this setting, but it attracts few reviews, of lower quality than conventional peer reviews.

The Effects of Resident Peer- and Self-Chart Review on Outpatient Laboratory Result Follow-up.

PubMed

Hale, Andrew J; Nall, Ryan W; Mukamal, Kenneth J; Libman, Howard; Smith, C Christopher; Sternberg, Scot B; Kim, Hans S; Kriegel, Gila

2016-05-01

Performing and teaching appropriate follow-up of outpatient laboratory results (LRs) is a challenge. The authors tested peer-review among residents as a potentially valuable intervention. Investigators assigned residents to perform self-review (n = 27), peer-review (n = 21), or self- + peer-review (n = 30) of outpatient charts. They also compared residence performance with that of historical controls (n = 20). In September 2012, residents examined 10 LRs from April 2012 onward. A second review in November 2012 ascertained whether performing chart review improved residents' practice behaviors. Initially, the least-square (LS) mean number of LRs without documentation of follow-up per resident in the self-, peer-, and self- + peer-review group was, respectively, 0.5 (SD 1.0), 1.0 (SD 1.7), and 0.9 (SD 1.3), and post intervention, this was 1.0 (SD 0.2), 0.3 (SD 0.2), and 0.6 (SD 0.2) (self- versus peer-review P = .03). Initially the LS mean follow-up time per resident in the self-, peer-, and self- + peer-review group was, respectively, 4.2 (SD 1.2), 6.9 (SD 1.4), and 5.9 (SD 1.2) days, and after the intervention, LS mean time was 5.0 (SD 0.5), 2.5 (SD 0.6), and 3.9 (SD 0.5) days (self- versus peer-review P < .01). Self-review was not associated with significant improvements in practice. In this comparison of self- and peer-review, only residents who performed peer-review demonstrated significant improvements in their documentation practices. These findings support the use of resident peer-review in improving LR follow-up, and potentially, in other, broader resident quality improvement initiatives.

A prospective study on an innovative online forum for peer reviewing of surgical science

PubMed Central

von Allmen, Regula S.; Carradice, Dan; Oosterling, Steven J.; McFarlane, Kirsty; Wijnhoven, Bas

2017-01-01

Background Peer review is important to the scientific process. However, the present system has been criticised and accused of bias, lack of transparency, failure to detect significant breakthrough and error. At the British Journal of Surgery (BJS), after surveying authors’ and reviewers’ opinions on peer review, we piloted an open online forum with the aim of improving the peer review process. Methods In December 2014, a web-based survey assessing attitudes towards open online review was sent to reviewers with a BJS account in Scholar One. From April to June 2015, authors were invited to allow their manuscripts to undergo online peer review in addition to the standard peer review process. The quality of each review was evaluated by editors and editorial assistants using a validated instrument based on a Likert scale. Results The survey was sent to 6635 reviewers. In all, 1454 (21.9%) responded. Support for online peer review was strong, with only 10% stating that they would not subject their manuscripts to online peer review. The most prevalent concern was about intellectual property, being highlighted in 118 of 284 comments (41.5%). Out of 265 eligible manuscripts, 110 were included in the online peer review trial. Around 7000 potential reviewers were invited to review each manuscript. In all, 44 of 110 manuscripts (40%) received 100 reviews from 59 reviewers, alongside 115 conventional reviews. The quality of the open forum reviews was lower than for conventional reviews (2.13 (± 0.75) versus 2.84 (± 0.71), P<0.001). Conclusion Open online peer review is feasible in this setting, but it attracts few reviews, of lower quality than conventional peer reviews. PMID:28662046

Variability in Students' Evaluating Processes in Peer Assessment with Calibrated Peer Review

ERIC Educational Resources Information Center

Russell, J.; Van Horne, S.; Ward, A. S.; Bettis, E. A., III; Gikonyo, J.

2017-01-01

This study investigated students' evaluating process and their perceptions of peer assessment when they engaged in peer assessment using Calibrated Peer Review. Calibrated Peer Review is a web-based application that facilitates peer assessment of writing. One hundred and thirty-two students in an introductory environmental science course…

Peer Review as a Strategy for Improving Students' Writing Process

ERIC Educational Resources Information Center

Baker, Kimberly M.

2016-01-01

Peer review is an established strategy for improving the quality of students' writing. This study moves beyond the focus on outcomes to assess the peer-review process. In particular, this study focuses on the timing of the peer review, a highly structured feedback form, and student writers' revisions after engaging in peer review. This study draws…

Designing Peer Review for Pedagogical Success: What Can We Learn from Professional Science?

ERIC Educational Resources Information Center

Trautmann, Nancy M.

2009-01-01

This article compares peer review in professional versus education settings, summarizing key aspects of scientific peer review and reflecting on how these relate to the process as experienced by students. Consideration of professional peer review benefits educators in two ways. First, systems used for student peer review can employ some of the…

34 CFR 350.50 - What is the peer review process for this Program?

Code of Federal Regulations, 2010 CFR

2010-07-01

... 34 Education 2 2010-07-01 2010-07-01 false What is the peer review process for this Program? 350... peer review process for this Program? (a) The Secretary refers each application for a grant governed by those regulations in this part to a peer review panel established by the Secretary. (b) Peer review...

The Power of Peer Reviewing to Enhance Writing in Horticulture: Greenhouse Management

ERIC Educational Resources Information Center

Anderson, Neil O.; Flash, Pamela

2014-01-01

Peer review is not included in undergraduate horticultural curricula. Our research objectives in an 8- year study, which ranged from 2000 to 2007 in two sections (2000-2002 non-peer reviewed and 2003-2007 peer-reviewed) of Greenhouse Management students at the University of Minnesota were to determine whether iterative peer reviews would result in…

28 CFR 34.102 - Peer review procedures.

Code of Federal Regulations, 2011 CFR

2011-07-01

... 28 Judicial Administration 1 2011-07-01 2011-07-01 false Peer review procedures. 34.102 Section 34.102 Judicial Administration DEPARTMENT OF JUSTICE OJJDP COMPETITION AND PEER REVIEW PROCEDURES Peer... substantive and procedural matters related to the peer review process, the “Guideline” addresses such issues...

28 CFR 34.102 - Peer review procedures.

Code of Federal Regulations, 2014 CFR

2014-07-01

... 28 Judicial Administration 1 2014-07-01 2014-07-01 false Peer review procedures. 34.102 Section 34.102 Judicial Administration DEPARTMENT OF JUSTICE OJJDP COMPETITION AND PEER REVIEW PROCEDURES Peer... substantive and procedural matters related to the peer review process, the “Guideline” addresses such issues...

28 CFR 34.102 - Peer review procedures.

Code of Federal Regulations, 2012 CFR

2012-07-01

... 28 Judicial Administration 1 2012-07-01 2012-07-01 false Peer review procedures. 34.102 Section 34.102 Judicial Administration DEPARTMENT OF JUSTICE OJJDP COMPETITION AND PEER REVIEW PROCEDURES Peer... substantive and procedural matters related to the peer review process, the “Guideline” addresses such issues...

28 CFR 34.102 - Peer review procedures.

Code of Federal Regulations, 2013 CFR

2013-07-01

... 28 Judicial Administration 1 2013-07-01 2013-07-01 false Peer review procedures. 34.102 Section 34.102 Judicial Administration DEPARTMENT OF JUSTICE OJJDP COMPETITION AND PEER REVIEW PROCEDURES Peer... substantive and procedural matters related to the peer review process, the “Guideline” addresses such issues...

A survey of radiation treatment planning peer-review activities in a provincial radiation oncology programme: current practice and future directions

PubMed Central

Brundage, Michael; Foxcroft, Sophie; McGowan, Tom; Gutierrez, Eric; Sharpe, Michael; Warde, Padraig

2013-01-01

Objectives To describe current patterns of practice of radiation oncology peer review within a provincial cancer system, identifying barriers and facilitators to its use with the ultimate aim of process improvement. Design A survey of radiation oncology programmes at provincial cancer centres. Setting All cancer centres within the province of Ontario, Canada (n=14). These are community-based outpatient facilities overseen by Cancer Care Ontario, the provincial cancer agency. Participants A delegate from each radiation oncology programme filled out a single survey based on input from their multidisciplinary team. Outcome measures Rated importance of peer review; current utilisation; format of the peer-review process; organisation and timing; case attributes; outcomes of the peer-review process and perceived barriers and facilitators to expanding peer-review processes. Results 14 (100%) centres responded. All rated the importance of peer review as at least 8/10 (10=extremely important). Detection of medical error and improvement of planning processes were the highest rated perceived benefits of peer review (each median 9/10). Six centres (43%) reviewed at least 50% of curative cases; four of these centres (29%) conducted peer review in more than 80% of cases treated with curative intent. Fewer than 20% of cases treated with palliative intent were reviewed in most centres. Five centres (36%) reported usually conducting peer review prior to the initiation of treatment. Five centres (36%) recorded the outcomes of peer review on the medical record. Thirteen centres (93%) planned to expand peer-review activities; a critical mass of radiation oncologists was the most important limiting factor (median 6/10). Conclusions Radiation oncology peer-review practices can vary even within a cancer system with provincial oversight. The application of guidelines and standards for peer-review processes, and monitoring of implementation and outcomes, will require effective knowledge translation activities. PMID:23903814

7 CFR 3400.21 - Scientific peer review for research activities.

Code of Federal Regulations, 2011 CFR

2011-01-01

... 7 Agriculture 15 2011-01-01 2011-01-01 false Scientific peer review for research activities. 3400... § 3400.21 Scientific peer review for research activities. Scientific peer review is an evaluation of a... with the scientific knowledge and technical skills to conduct the proposed research work. Peer...

Peer Review in Scientific Publications: Benefits, Critiques, & A Survival Guide

PubMed Central

Kelly, Jacalyn; Sadeghieh, Tara

2014-01-01

Peer review has been defined as a process of subjecting an author’s scholarly work, research or ideas to the scrutiny of others who are experts in the same field. It functions to encourage authors to meet the accepted high standards of their discipline and to control the dissemination of research data to ensure that unwarranted claims, unacceptable interpretations or personal views are not published without prior expert review. Despite its wide-spread use by most journals, the peer review process has also been widely criticised due to the slowness of the process to publish new findings and due to perceived bias by the editors and/or reviewers. Within the scientific community, peer review has become an essential component of the academic writing process. It helps ensure that papers published in scientific journals answer meaningful research questions and draw accurate conclusions based on professionally executed experimentation. Submission of low quality manuscripts has become increasingly prevalent, and peer review acts as a filter to prevent this work from reaching the scientific community. The major advantage of a peer review process is that peer-reviewed articles provide a trusted form of scientific communication. Since scientific knowledge is cumulative and builds on itself, this trust is particularly important. Despite the positive impacts of peer review, critics argue that the peer review process stifles innovation in experimentation, and acts as a poor screen against plagiarism. Despite its downfalls, there has not yet been a foolproof system developed to take the place of peer review, however, researchers have been looking into electronic means of improving the peer review process. Unfortunately, the recent explosion in online only/electronic journals has led to mass publication of a large number of scientific articles with little or no peer review. This poses significant risk to advances in scientific knowledge and its future potential. The current article summarizes the peer review process, highlights the pros and cons associated with different types of peer review, and describes new methods for improving peer review. PMID:27683470

Random Versus Nonrandom Peer Review: A Case for More Meaningful Peer Review.

PubMed

Itri, Jason N; Donithan, Adam; Patel, Sohil H

2018-05-10

Random peer review programs are not optimized to discover cases with diagnostic error and thus have inherent limitations with respect to educational and quality improvement value. Nonrandom peer review offers an alternative approach in which diagnostic error cases are targeted for collection during routine clinical practice. The objective of this study was to compare error cases identified through random and nonrandom peer review approaches at an academic center. During the 1-year study period, the number of discrepancy cases and score of discrepancy were determined from each approach. The nonrandom peer review process collected 190 cases, of which 60 were scored as 2 (minor discrepancy), 94 as 3 (significant discrepancy), and 36 as 4 (major discrepancy). In the random peer review process, 1,690 cases were reviewed, of which 1,646 were scored as 1 (no discrepancy), 44 were scored as 2 (minor discrepancy), and none were scored as 3 or 4. Several teaching lessons and quality improvement measures were developed as a result of analysis of error cases collected through the nonrandom peer review process. Our experience supports the implementation of nonrandom peer review as a replacement to random peer review, with nonrandom peer review serving as a more effective method for collecting diagnostic error cases with educational and quality improvement value. Copyright © 2018 American College of Radiology. Published by Elsevier Inc. All rights reserved.

Peer Review Practices for Evaluating Biomedical Research Grants: A Scientific Statement From the American Heart Association.

PubMed

Liaw, Lucy; Freedman, Jane E; Becker, Lance B; Mehta, Nehal N; Liscum, Laura

2017-08-04

The biomedical research enterprise depends on the fair and objective peer review of research grants, leading to the distribution of resources through efficient and robust competitive methods. In the United States, federal funding agencies and foundations collectively distribute billions of dollars annually to support biomedical research. For the American Heart Association, a Peer Review Subcommittee is charged with establishing the highest standards for peer review. This scientific statement reviews the current literature on peer review practices, describes the current American Heart Association peer review process and those of other agencies, analyzes the strengths and weaknesses of American Heart Association peer review practices, and recommends best practices for the future. © 2017 American Heart Association, Inc.

The Impact of Peer Review on Writing in a Psychology Course: Lessons Learned

ERIC Educational Resources Information Center

Bhullar, Naureen; Rose, Karen C.; Utell, Janine M.; Healey, Kathryn N.

2014-01-01

The authors assessed the impact of peer review on student writing in four sections of an undergraduate Developmental Psychology course. They hypothesized that peer review would result in better writing in the peer review group compared to the group with no peer review. Writing was rated independently by two instructors who were blind to the…

A systematic review of peer teaching and learning in clinical education.

PubMed

Secomb, Jacinta

2008-03-01

The purpose of this review is to provide a framework for peer teaching and learning in the clinical education of undergraduate health science students in clinical practice settings and make clear the positive and negative aspects of this teaching and learning strategy. The practice of using peers incidentally or purposefully in the clinical education of apprentice or undergraduate health science students is a well-established tradition and commonly practiced, but lacks definition in its implementation. The author conducted a search of health science and educational electronic databases using the terms peer, clinical education and undergraduate. The set limitations were publications after 1980 (2005 inclusive), English language and research papers. Selection of studies occurred: based on participant, intervention, research method and learning outcomes, following a rigorous critical and quality appraisal with a purposefully developed tool. The results have been both tabled and collated in a narrative summary. Twelve articles met the inclusion criteria, representing five countries and four health science disciplines. This review reported mostly positive outcomes on the effectiveness of peer teaching and learning; it can increase student's confidence in clinical practice and improve learning in the psychomotor and cognitive domains. Negative aspects were also identified; these include poor student learning if personalities or learning styles are not compatible and students spending less individualized time with the clinical instructor. Peer teaching and learning is an effective educational intervention for health science students on clinical placements. Preclinical education of students congruent with the academic timetable increases student educational outcomes from peer teaching and learning. Strategies are required prior to clinical placement to accommodate incompatible students or poor student learning. The findings from this systematic review, although not statistically significant, do have pragmatic implications for clinical practice. It can increase clinical placement opportunities for undergraduate health students, assist clinical staff with workload pressures and increase clinician time with clients, while further developing students' knowledge, skills and attitudes.

28 CFR 34.111 - Compensation.

Code of Federal Regulations, 2010 CFR

2010-07-01

... Judicial Administration DEPARTMENT OF JUSTICE OJJDP COMPETITION AND PEER REVIEW PROCEDURES Peer Review § 34.111 Compensation. All peer reviewers will be eligible to be paid according to applicable regulations... provided in the OJJDP “Peer Review Guideline”. ...

Total Risk Integrated Methodology (TRIM) - Peer Review and Publications

EPA Pesticide Factsheets

Peer review: Consistent with Agency peer review policy, and the 1994 Agency Task Force on Environmental Regulatory Modeling, internal and external peer review has been an integral part of the TRIM development plan.

Scholarly publishing depends on peer reviewers.

PubMed

Fernandez-Llimos, Fernando

2018-01-01

The peer-review crisis is posing a risk to the scholarly peer-reviewed journal system. Journals have to ask many potential peer reviewers to obtain a minimum acceptable number of peers accepting reviewing a manuscript. Several solutions have been suggested to overcome this shortage. From reimbursing for the job, to eliminating pre-publication reviews, one cannot predict which is more dangerous for the future of scholarly publishing. And, why not acknowledging their contribution to the final version of the article published? PubMed created two categories of contributors: authors [AU] and collaborators [IR]. Why not a third category for the peer-reviewer?

How long is too long in contemporary peer review? Perspectives from authors publishing in conservation biology journals.

PubMed

Nguyen, Vivian M; Haddaway, Neal R; Gutowsky, Lee F G; Wilson, Alexander D M; Gallagher, Austin J; Donaldson, Michael R; Hammerschlag, Neil; Cooke, Steven J

2015-01-01

Delays in peer reviewed publication may have consequences for both assessment of scientific prowess in academics as well as communication of important information to the knowledge receptor community. We present an analysis on the perspectives of authors publishing in conservation biology journals regarding their opinions on the importance of speed in peer-review as well as how to improve review times. Authors were invited to take part in an online questionnaire, of which the data was subjected to both qualitative (open coding, categorizing) and quantitative analyses (generalized linear models). We received 637 responses to a total of 6,547 e-mail invitations sent. Peer-review speed was generally perceived as slow, with authors experiencing a typical turnaround time of 14 weeks while their perceived optimal review time is six weeks. Male and younger respondents seem to have higher expectations of review speed than females and older respondents. Majority of participants attributed lengthy review times to the 'stress' on the peer-review system (i.e., reviewer and editor fatigue), while editor persistence and journal prestige were believed to speed up the review process. Negative consequences of lengthy review times appear to be greater for early career researchers and can also have impact on author morale (e.g. motivation or frustration). Competition among colleagues were also of concern to respondents. Incentivizing peer review was among the top suggested alterations to the system along with training graduate students in peer review, increased editorial persistence, and changes to the norms of peer-review such as opening the peer-review process to the public. It is clear that authors surveyed in this study view the peer-review system as under stress and we encourage scientists and publishers to push the envelope for new peer review models.

The ethics of peer review in bioethics.

PubMed

Wendler, David; Miller, Franklin

2014-10-01

A good deal has been written on the ethics of peer review, especially in the scientific and medical literatures. In contrast, we are unaware of any articles on the ethics of peer review in bioethics. Recognising this gap, we evaluate the extant proposals regarding ethical standards for peer review in general and consider how they apply to bioethics. We argue that scholars have an obligation to perform peer review based on the extent to which they personally benefit from the peer review process. We also argue, contrary to existing proposals and guidelines, that it can be appropriate for peer reviewers to benefit in their own scholarship from the manuscripts they review. With respect to bioethics in particular, we endorse double-blind review and suggest several ways in which the peer review process might be improved. Published by the BMJ Publishing Group Limited. For permission to use (where not already granted under a licence) please go to http://group.bmj.com/group/rights-licensing/permissions.

Medical journal peer review: process and bias.

PubMed

Manchikanti, Laxmaiah; Kaye, Alan D; Boswell, Mark V; Hirsch, Joshua A

2015-01-01

Scientific peer review is pivotal in health care research in that it facilitates the evaluation of findings for competence, significance, and originality by qualified experts. While the origins of peer review can be traced to the societies of the eighteenth century, it became an institutionalized part of the scholarly process in the latter half of the twentieth century. This was a response to the growth of research and greater subject specialization. With the current increase in the number of specialty journals, the peer review process continues to evolve to meet the needs of patients, clinicians, and policy makers. The peer review process itself faces challenges. Unblinded peer review might suffer from positive or negative bias towards certain authors, specialties, and institutions. Peer review can also suffer when editors and/or reviewers might be unable to understand the contents of the submitted manuscript. This can result in an inability to detect major flaws, or revelations of major flaws after acceptance of publication by the editors. Other concerns include potentially long delays in publication and challenges uncovering plagiarism, duplication, corruption and scientific misconduct. Conversely, a multitude of these challenges have led to claims of scientific misconduct and an erosion of faith. These challenges have invited criticism of the peer review process itself. However, despite its imperfections, the peer review process enjoys widespread support in the scientific community. Peer review bias is one of the major focuses of today's scientific assessment of the literature. Various types of peer review bias include content-based bias, confirmation bias, bias due to conservatism, bias against interdisciplinary research, publication bias, and the bias of conflicts of interest. Consequently, peer review would benefit from various changes and improvements with appropriate training of reviewers to provide quality reviews to maintain the quality and integrity of research without bias. Thus, an appropriate, transparent peer review is not only ideal, but necessary for the future to facilitate scientific progress.

Proposed standards for peer-reviewed publication of computer code

USDA-ARS?s Scientific Manuscript database

Computer simulation models are mathematical abstractions of physical systems. In the area of natural resources and agriculture, these physical systems encompass selected interacting processes in plants, soils, animals, or watersheds. These models are scientific products and have become important i...

Peer Review and the Assessment of Higher Education Quality: An International Perspective. Higher Education Report No. 3.

ERIC Educational Resources Information Center

Brennan, John; And Others

This report examines the practices of 19 peer review agencies in the United States, Britain, Denmark, Germany, France, the Netherlands, and Hong Kong to determine variations in peer review in the field of higher education. The report addresses: (1) the sources of authority for peer review; (2) the types and status of peer reviewers; (3) the…

PRESS Peer Review of Electronic Search Strategies: 2015 Guideline Statement.

PubMed

McGowan, Jessie; Sampson, Margaret; Salzwedel, Douglas M; Cogo, Elise; Foerster, Vicki; Lefebvre, Carol

2016-07-01

To develop an evidence-based guideline for Peer Review of Electronic Search Strategies (PRESS) for systematic reviews (SRs), health technology assessments, and other evidence syntheses. An SR, Web-based survey of experts, and consensus development forum were undertaken to identify checklists that evaluated or validated electronic literature search strategies and to determine which of their elements related to search quality or errors. Systematic review: No new search elements were identified for addition to the existing (2008-2010) PRESS 2015 Evidence-Based Checklist, and there was no evidence refuting any of its elements. Results suggested that structured PRESS could identify search errors and improve the selection of search terms. Web-based survey of experts: Most respondents felt that peer review should be undertaken after the MEDLINE search had been prepared but before it had been translated to other databases. Consensus development forum: Of the seven original PRESS elements, six were retained: translation of the research question; Boolean and proximity operators; subject headings; text word search; spelling, syntax and line numbers; and limits and filters. The seventh (skilled translation of the search strategy to additional databases) was removed, as there was consensus that this should be left to the discretion of searchers. An updated PRESS 2015 Guideline Statement was developed, which includes the following four documents: PRESS 2015 Evidence-Based Checklist, PRESS 2015 Recommendations for Librarian Practice, PRESS 2015 Implementation Strategies, and PRESS 2015 Guideline Assessment Form. The PRESS 2015 Guideline Statement should help to guide and improve the peer review of electronic literature search strategies. Copyright © 2016 The Authors. Published by Elsevier Inc. All rights reserved.

Perceived peer influence and peer selection on adolescent smoking.

PubMed

Hoffman, Beth R; Monge, Peter R; Chou, Chih-Ping; Valente, Thomas W

2007-08-01

Despite advances in tobacco control, adolescent smoking remains a problem. The smoking status of friends is one of the highest correlates with adolescent smoking. This homophily (commonality of friends based on a given attribute) may be due to either peer pressure, where adolescents adopt the smoking behaviors of their friends, or peer selection, where adolescents choose friends based on their smoking status. This study used structural equation modeling to test a model of peer influence and peer selection on ever smoking by adolescents. The primary analysis of the model did not reach significance, but post hoc analyses did result in a model with good fit. Results indicated that both peer influence and peer selection were occurring, and that peer influence was more salient in the population than was peer selection. Implications of these results for tobacco prevention programs are discussed.

Re-Viewing Peer Review

ERIC Educational Resources Information Center

Flynn, Elizabeth A.

2011-01-01

In this article, the author revisits her essay, "Students as Readers of Their Classmates' Writing," by providing a review of the literature on peer review over the past three decades and comments on patterns she sees in waves of peer review research and theorizing. She describes her subsequent experience with peer review in her own classes, and…

Comparison of self-citation by peer reviewers in a journal with single-blind peer review versus a journal with open peer review.

PubMed

Levis, Alexander W; Leentjens, Albert F G; Levenson, James L; Lumley, Mark A; Thombs, Brett D

2015-12-01

Some peer reviewers may inappropriately, or coercively request that authors include references to the reviewers' own work. The objective of this study was to evaluate whether, compared to reviews for a journal with single-blind peer review, reviews for a journal with open peer review included (1) fewer self-citations; (2) a lower proportion of self-citations without a rationale; and (3) a lower ratio of proportions of citations without a rationale in self-citations versus citations to others' work. Peer reviews for published manuscripts submitted in 2012 to a single-blind peer review journal, the Journal of Psychosomatic Research, were previously evaluated (Thombs et al., 2015). These were compared to publically available peer reviews of manuscripts published in 2012 in an open review journal, BMC Psychiatry. Two investigators independently extracted data for both journals. There were no significant differences between journals in the proportion of all reviewer citations that were self-citations (Journal of Psychosomatic Research: 71/225, 32%; BMC Psychiatry: 90/315, 29%; p=.50), or in the proportion of self-citations without a rationale (Journal of Psychosomatic Research: 15/71, 21%; BMC Psychiatry: 12/90, 13%; p=.21). There was no significant difference between journals in the proportion of self-citations versus citations to others' work without a rationale (p=.31). Blind and open peer review methodologies have distinct advantages and disadvantages. The present study found that, in reasonably similar journals that use single-blind and open review, there were no substantive differences in the pattern of peer reviewer self-citations. Copyright © 2015 Elsevier Inc. All rights reserved.

Advancing Kinesiology through Improved Peer Review

ERIC Educational Resources Information Center

Knudson, Duane V.; Morrow, James R., Jr.; Thomas, Jerry R.

2014-01-01

Peer review of scholarship is essential to journal quality, evidence, knowledge advancement, and application of that knowledge in any field. This commentary summarizes recent literature on issues related to peer-review quality and current review practice in kinesiology and provides recommendations to improve peer review in kinesiology journals. We…

Research Funding: the Case for a Modified Lottery.

PubMed

Fang, Ferric C; Casadevall, Arturo

2016-04-12

The time-honored mechanism of allocating funds based on ranking of proposals by scientific peer review is no longer effective, because review panels cannot accurately stratify proposals to identify the most meritorious ones. Bias has a major influence on funding decisions, and the impact of reviewer bias is magnified by low funding paylines. Despite more than a decade of funding crisis, there has been no fundamental reform in the mechanism for funding research. This essay explores the idea of awarding research funds on the basis of a modified lottery in which peer review is used to identify the most meritorious proposals, from which funded applications are selected by lottery. We suggest that a modified lottery for research fund allocation would have many advantages over the current system, including reducing bias and improving grantee diversity with regard to seniority, race, and gender. Copyright © 2016 Fang and Casadevall.

Research Funding: the Case for a Modified Lottery

PubMed Central

Casadevall, Arturo

2016-01-01

ABSTRACT The time-honored mechanism of allocating funds based on ranking of proposals by scientific peer review is no longer effective, because review panels cannot accurately stratify proposals to identify the most meritorious ones. Bias has a major influence on funding decisions, and the impact of reviewer bias is magnified by low funding paylines. Despite more than a decade of funding crisis, there has been no fundamental reform in the mechanism for funding research. This essay explores the idea of awarding research funds on the basis of a modified lottery in which peer review is used to identify the most meritorious proposals, from which funded applications are selected by lottery. We suggest that a modified lottery for research fund allocation would have many advantages over the current system, including reducing bias and improving grantee diversity with regard to seniority, race, and gender. PMID:27073093

Demystifying the peer-review process - workshop

EPA Science Inventory

Scientific writing and peer-review are integral parts of the publishing process. This workshop aims to demystify the peer-review process for early career scientists and provide insightful tips for streamlining the submission and peer review process for all researchers. Providing ...

Academic Primer Series: Key Papers About Peer Review.

PubMed

Yarris, Lalena M; Gottlieb, Michael; Scott, Kevin; Sampson, Christopher; Rose, Emily; Chan, Teresa M; Ilgen, Jonathan

2017-06-01

Peer review, a cornerstone of academia, promotes rigor and relevance in scientific publishing. As educators are encouraged to adopt a more scholarly approach to medical education, peer review is becoming increasingly important. Junior educators both receive the reviews of their peers, and are also asked to participate as reviewers themselves. As such, it is imperative for junior clinician educators to be well-versed in the art of peer reviewing their colleagues' work. In this article, our goal was to identify and summarize key papers that may be helpful for faculty members interested in learning more about the peer-review process and how to improve their reviewing skills. The online discussions of the 2016-17 Academic Life in Emergency Medicine (ALiEM) Faculty Incubator program included a robust discussion about peer review, which highlighted a number of papers on that topic. We sought to augment this list with further suggestions by guest experts and by an open call on Twitter for other important papers. Via this process, we created a list of 24 total papers on the topic of peer review. After gathering these papers, our authorship group engaged in a consensus-building process incorporating Delphi methods to identify the papers that best described peer review, and also highlighted important tips for new reviewers. We found and reviewed 24 papers. In our results section, we present our authorship group's top five most highly rated papers on the topic of peer review. We also summarize these papers with respect to their relevance to junior faculty members and to faculty developers. We present five key papers on peer review that can be used for faculty development for novice writers and reviewers. These papers represent a mix of foundational and explanatory papers that may provide some basis from which junior faculty members might build upon as they both undergo the peer-review process and act as reviewers in turn.

Academic Primer Series: Key Papers About Peer Review

PubMed Central

Yarris, Lalena M.; Gottlieb, Michael; Scott, Kevin; Sampson, Christopher; Rose, Emily; Chan, Teresa M.; Ilgen, Jonathan

2017-01-01

Introduction Peer review, a cornerstone of academia, promotes rigor and relevance in scientific publishing. As educators are encouraged to adopt a more scholarly approach to medical education, peer review is becoming increasingly important. Junior educators both receive the reviews of their peers, and are also asked to participate as reviewers themselves. As such, it is imperative for junior clinician educators to be well-versed in the art of peer reviewing their colleagues’ work. In this article, our goal was to identify and summarize key papers that may be helpful for faculty members interested in learning more about the peer-review process and how to improve their reviewing skills. Methods The online discussions of the 2016–17 Academic Life in Emergency Medicine (ALiEM) Faculty Incubator program included a robust discussion about peer review, which highlighted a number of papers on that topic. We sought to augment this list with further suggestions by guest experts and by an open call on Twitter for other important papers. Via this process, we created a list of 24 total papers on the topic of peer review. After gathering these papers, our authorship group engaged in a consensus-building process incorporating Delphi methods to identify the papers that best described peer review, and also highlighted important tips for new reviewers. Results We found and reviewed 24 papers. In our results section, we present our authorship group’s top five most highly rated papers on the topic of peer review. We also summarize these papers with respect to their relevance to junior faculty members and to faculty developers. Conclusion We present five key papers on peer review that can be used for faculty development for novice writers and reviewers. These papers represent a mix of foundational and explanatory papers that may provide some basis from which junior faculty members might build upon as they both undergo the peer-review process and act as reviewers in turn. PMID:28611894

Paired peer review of university classroom teaching in a school of nursing and midwifery.

PubMed

Bennett, Paul N; Parker, Steve; Smigiel, Heather

2012-08-01

Peer review of university classroom teaching can increase the quality of teaching but is not universally practiced in Australian universities. To report an evaluation of paired peer-review process using both paper and web based teaching evaluation tools. Twenty university teachers in one metropolitan Australian School of Nursing and Midwifery were randomly paired and then randomly assigned to a paper based or web-based peer review tool. Each teacher reviewed each other's classroom teaching as part of a peer review program. The participants then completed an 18 question survey evaluating the peer review tool and paired evaluation process. Responses were analyzed using frequencies and percentages. Regardless of the tool used, participants found this process of peer review positive (75%), collegial (78%), supportive (61%) and non-threatening (71%). Participants reported that the peer review will improve their own classroom delivery (61%), teaching evaluation (61%) and planning (53%). The web-based tool was found to be easier to use and allowed more space than the paper-based tool. Implementation of a web-based paired peer review system can be a positive method of peer review of university classroom teaching. Pairing of teachers to review each other's classroom teaching is a promising strategy and has the potential to improve teaching in teaching universities. Copyright © 2011 Elsevier Ltd. All rights reserved.

"I sleep better at night:" How peer review of radiation treatment plans indirectly improves quality of care across radiation treatment programs.

PubMed

Brundage, Michael D; Hart, Margaret; O'Donnell, Jennifer; Reddeman, Lindsay; Gutierrez, Eric; Foxcroft, Sophie; Warde, Padraig

Peer review of radiation oncology treatment plans is increasingly recognized as an important component of quality assurance in radiation treatment planning and delivery. Peer review of treatment plans can directly improve the quality of those plans and can also have indirect effects on radiation treatment programs. We undertook a systematic, qualitative approach to describing the indirect benefits of peer review, factors that were seen to facilitate or act as barriers to the implementation of peer review, and strategies to address these barriers across a provincial jurisdiction of radiation oncology programs (ROPs). Semistructured qualitative interviews were held with radiation oncology department heads and radiation therapy managers (or delegates) in all 14 ROPs in Ontario, Canada. We used a theoretically guided phenomenological qualitative approach to design and analyze the interview content. Themes were recorded by 2 independent reviewers, and any discordance was resolved by consensus. A total of 28 interviews were completed with 32 interviewees. Twenty-two unique themes addressed perceived benefits of peer review, relating to either peer review structure (n = 3), process (n = 9), or outcome (n = 10). Of these 22 themes, 19 related to indirect benefits to ROPs. In addition, 18 themes related to factors that facilitated peer review activities and 30 themes related to key barriers to implementing peer review were identified. Findings were consistent with, and enhanced the understanding of, previous survey-based assessments of the benefits and challenges of implementing peer review programs. Although challenges and concerns regarding the implementation of peer review were evident, the indirect benefits to radiation programs are numerous, far outweigh the implementation challenges, and strongly complement the direct individual-patient benefits that result from peer review quality assurance of radiation treatment plans. Copyright © 2016. Published by Elsevier Inc.

Peer review versus editorial review and their role in innovative science.

PubMed

Steinhauser, Georg; Adlassnig, Wolfram; Risch, Jesaka Ahau; Anderlini, Serena; Arguriou, Petros; Armendariz, Aaron Zolen; Bains, William; Baker, Clark; Barnes, Martin; Barnett, Jonathan; Baumgartner, Michael; Baumgartner, Thomas; Bendall, Charles A; Bender, Yvonne S; Bichler, Max; Biermann, Teresa; Bini, Ronaldo; Blanco, Eduardo; Bleau, John; Brink, Anthony; Brown, Darin; Burghuber, Christopher; Calne, Roy; Carter, Brian; Castaño, Cesar; Celec, Peter; Celis, Maria Eugenia; Clarke, Nicky; Cockrell, David; Collins, David; Coogan, Brian; Craig, Jennifer; Crilly, Cal; Crowe, David; Csoka, Antonei B; Darwich, Chaza; Del Kebos, Topiciprin; Derinaldi, Michele; Dlamini, Bongani; Drewa, Tomasz; Dwyer, Michael; Eder, Fabienne; de Palma, Raúl Ehrichs; Esmay, Dean; Rött, Catherine Evans; Exley, Christopher; Falkov, Robin; Farber, Celia Ingrid; Fearn, William; Felsmann, Sophie; Flensmark, Jarl; Fletcher, Andrew K; Foster, Michaela; Fountoulakis, Kostas N; Fouratt, Jim; Blanca, Jesus Garcia; Sotelo, Manuel Garrido; Gittler, Florian; Gittler, Georg; Gomez, Juan; Gomez, Juan F; Polar, Maria Grazia Gonzales; Gonzalez, Jossina; Gösselsberger, Christoph; Habermacher, Lynn; Hajek, Michael; Hakala, Faith; Haliburton, Mary-Sue; Hankins, John Robert; Hart, Jason; Hasslberger, Sepp; Hennessey, Donalyn; Herrmann, Andrea; Hersee, Mike; Howard, Connie; Humphries, Suzanne; Isharc, Laeeth; Ivanovski, Petar; Jenuth, Stephen; Jerndal, Jens; Johnson, Christine; Keleta, Yonas; Kenny, Anna; Kidd, Billie; Kohle, Fritz; Kolahi, Jafar; Koller-Peroutka, Marianne; Kostova, Lyubov; Kumar, Arunachalam; Kurosawa, Alejandro; Lance, Tony; Lechermann, Michael; Lendl, Bernhard; Leuchters, Michael; Lewis, Evan; Lieb, Edward; Lloyd, Gloria; Losek, Angelika; Lu, Yao; Maestracci, Saadia; Mangan, Dennis; Mares, Alberto W; Barnett, Juan Mazar; McClain, Valerie; McNair, John Sydney; Michael, Terry; Miller, Lloyd; Monzani, Partizia; Moran, Belen; Morris, Mike; Mößmer, Georg; Mountain, Johny; Phuthe, Onnie Mary Moyo; Muñoz, Marcos; Nakken, Sheri; Wambui, Anne Nduta; Neunteufl, Bettina; Nikolić, Dimitrije; Oberoi, Devesh V; Obmode, Gregory; Ogar, Laura; Ohara, Jo; Rybine, Naion Olej; Owen, Bryan; Owen, Kim Wilson; Parikh, Rakesh; Pearce, Nicholas J G; Pemmer, Bernhard; Piper, Chris; Prince, Ian; Reid, Terence; Rindermann, Heiner; Risch, Stefan; Robbins, Josh; Roberts, Seth; Romero, Ajeandro; Rothe, Michael Thaddäus; Ruiz, Sergio; Sacher, Juliane; Sackl, Wolfgang; Salletmaier, Markus; Sanand, Jairaj; Sauerzopf, Clemens; Schwarzgruber, Thomas; Scott, David; Seegers, Laura; Seppi, David; Shields, Kyle; Siller-Matula, Jolanta; Singh, Beldeu; Sithole, Sibusio; Six, Florian; Skoyles, John R; Slofstra, Jildou; Sole, Daphne Anne; Sommer, Werner F; Sonko, Mels; Starr-Casanova, Chrislie J; Steakley, Marjorie Elizabeth; Steinhauser, Wolfgang; Steinhoff, Konstantin; Sterba, Johannes H; Steppan, Martin; Stindl, Reinhard; Stokely, Joe; Stokely, Karri; St-Pierre, Gilles; Stratford, James; Streli, Christina; Stryg, Carl; Sullivan, Mike; Summhammer, Johann; Tadesse, Amhayes; Tavares, David; Thompson, Laura; Tomlinson, Alison; Tozer, Jack; Trevisanato, Siro I; Trimmel, Michaela; Turner, Nicole; Vahur, Paul; van der Byl, Jennie; van der Maas, Tine; Varela, Leo; Vega, Carlos A; Vermaak, Shiloh; Villasenor, Alex; Vogel, Matt; von Wintzigerode, Georg; Wagner, Christoph; Weinberger, Manuel; Weinberger, Peter; Wilson, Nick; Wolfe, Jennifer Finocchio; Woodley, Michael A; Young, Ian; Zuraw, Glenn; Zwiren, Nicole

2012-10-01

Peer review is a widely accepted instrument for raising the quality of science. Peer review limits the enormous unstructured influx of information and the sheer amount of dubious data, which in its absence would plunge science into chaos. In particular, peer review offers the benefit of eliminating papers that suffer from poor craftsmanship or methodological shortcomings, especially in the experimental sciences. However, we believe that peer review is not always appropriate for the evaluation of controversial hypothetical science. We argue that the process of peer review can be prone to bias towards ideas that affirm the prior convictions of reviewers and against innovation and radical new ideas. Innovative hypotheses are thus highly vulnerable to being "filtered out" or made to accord with conventional wisdom by the peer review process. Consequently, having introduced peer review, the Elsevier journal Medical Hypotheses may be unable to continue its tradition as a radical journal allowing discussion of improbable or unconventional ideas. Hence we conclude by asking the publisher to consider re-introducing the system of editorial review to Medical Hypotheses.

On the evolving open peer review culture for chemical information science.

PubMed

Walters, W Patrick; Bajorath, Jürgen

2015-01-01

Compared to the traditional anonymous peer review process, open post-publication peer review provides additional opportunities -and challenges- for reviewers to judge scientific studies. In this editorial, we comment on the open peer review culture and provide some guidance for reviewers of manuscripts submitted to the Chemical Information Science channel of F1000Research.

A novel approach to quality improvement in a safety-net practice: concurrent peer review visits.

PubMed

Fiscella, Kevin; Volpe, Ellen; Winters, Paul; Brown, Melissa; Idris, Amna; Harren, Tricia

2010-12-01

Concurrent peer review visits are structured office visits conducted by clinician peers of the primary care clinician that are specifically designed to reduce competing demands, clinical inertia, and bias. We assessed whether a single concurrent peer review visit reduced clinical inertia and improved control of hypertension, hyperlipidemia, and diabetes control among underserved patients. We conducted a randomized encouragement trial to evaluate concurrent peer review visits with a community health center. Seven hundred twenty-seven patients with hypertension, hyperlipidemia, and/or diabetes who were not at goal for systolic blood pressure (SBP), low-density lipoprotein cholesterol (LDL-C), and/or glycated hemoglobin (A1c) were randomly assigned to an invitation to participate in a concurrent peer review visit or to usual care. We compared change in these measures using mixed models and rates of therapeutic intensification during concurrent peer review visits with control visits. One hundred seventy-one patients completed a concurrent peer review visit. SBP improved significantly (p < .01) more among those completing concurrent peer review visits than among those who failed to respond to a concurrent peer review invitation or those randomized to usual care. There were no differences seen for changes in LDL-C or A1c. Concurrent peer review visits were associated with statistically significant greater clinician intensification of blood pressure (p < .001), lipid (p < .001), and diabetes (p < .005) treatment than either for control visits for patients in either the nonresponse group or usual care group. Concurrent peer review visits represent a promising strategy for improving blood pressure control and improving therapeutic intensification in community health centers.

48 CFR 215.270 - Peer Reviews.

Code of Federal Regulations, 2010 CFR

2010-10-01

... 48 Federal Acquisition Regulations System 3 2010-10-01 2010-10-01 false Peer Reviews. 215.270 Section 215.270 Federal Acquisition Regulations System DEFENSE ACQUISITION REGULATIONS SYSTEM, DEPARTMENT... of Proposals and Information 215.270 Peer Reviews. Agency officials shall conduct Peer Reviews in...

Optimal strategies to consider when peer reviewing a systematic review and meta-analysis.

PubMed

Moher, David

2015-11-02

Systematic reviews are popular. A recent estimate indicates that 11 new systematic reviews are published daily. Nevertheless, evidence indicates that the quality of reporting of systematic reviews is not optimal. One likely reason is that the authors' reports have received inadequate peer review. There are now many different types of systematic reviews and peer reviewing them can be enhanced by using a reporting guideline to supplement whatever template the journal editors have asked you, as a peer reviewer, to use. Additionally, keeping up with the current literature, whether as a content expert or being aware of advances in systematic review methods is likely be make for a more comprehensive and effective peer review. Providing a brief summary of what the systematic review has reported is an important first step in the peer review process (and not performed frequently enough). At its core, it provides the authors with some sense of what the peer reviewer believes was performed (Methods) and found (Results). Importantly, it also provides clarity regarding any potential problems in the methods, including statistical approaches for meta-analysis, results, and interpretation of the systematic review, for which the peer reviewer can seek explanations from the authors; these clarifications are best presented as questions to the authors.

Lessons from Peer Support Among Individuals with Mental Health Difficulties: A Review of the Literature

PubMed Central

Miyamoto, Yuki; Sono, Tamaki

2012-01-01

We conducted a comprehensive narrative review and used a systematic search strategy to identify studies related to peer support among adults with mental health difficulties. The purposes of this review were to describe the principles, effects and benefits of peer support documented in the published literature, to discuss challenging aspects of peer support and to investigate lessons from peer support. Fifty-one studies, including 8 review articles and 19 qualitative studies, met the inclusion criteria for this review. Most of the challenges for peer support were related to “role” and “relationship” issues; that is, how peer support providers relate to people who receive peer support and how peer support providers are treated in the system. The knowledge gained from peer support relationships, such as mutual responsibility and interdependence, might be a clue toward redefining the helper-helper relationship as well as the concepts of help and support. PMID:22563347

Retrospective analysis of the quality of reports by author-suggested and non-author-suggested reviewers in journals operating on open or single-blind peer review models

PubMed Central

Kowalczuk, Maria K; Dudbridge, Frank; Nanda, Shreeya; Harriman, Stephanie L; Patel, Jigisha; Moylan, Elizabeth C

2015-01-01

Objectives To assess whether reports from reviewers recommended by authors show a bias in quality and recommendation for editorial decision, compared with reviewers suggested by other parties, and whether reviewer reports for journals operating on open or single-blind peer review models differ with regard to report quality and reviewer recommendations. Design Retrospective analysis of the quality of reviewer reports using an established Review Quality Instrument, and analysis of reviewer recommendations and author satisfaction surveys. Setting BioMed Central biology and medical journals. BMC Infectious Diseases and BMC Microbiology are similar in size, rejection rates, impact factors and editorial processes, but the former uses open peer review while the latter uses single-blind peer review. The Journal of Inflammation has operated under both peer review models. Sample Two hundred reviewer reports submitted to BMC Infectious Diseases, 200 reviewer reports submitted to BMC Microbiology and 400 reviewer reports submitted to the Journal of Inflammation. Results For each journal, author-suggested reviewers provided reports of comparable quality to non-author-suggested reviewers, but were significantly more likely to recommend acceptance, irrespective of the peer review model (p<0.0001 for BMC Infectious Diseases, BMC Microbiology and the Journal of Inflammation). For BMC Infectious Diseases, the overall quality of reviewer reports measured by the Review Quality Instrument was 5% higher than for BMC Microbiology (p=0.042). For the Journal of Inflammation, the quality of reports was the same irrespective of the peer review model used. Conclusions Reviewers suggested by authors provide reports of comparable quality to non-author-suggested reviewers, but are significantly more likely to recommend acceptance. Open peer review reports for BMC Infectious Diseases were of higher quality than single-blind reports for BMC Microbiology. There was no difference in quality of peer review in the Journal of Inflammation under open peer review compared with single blind. PMID:26423855

42 CFR 24.5 - Peer review.

Code of Federal Regulations, 2010 CFR

2010-10-01

... 42 Public Health 1 2010-10-01 2010-10-01 false Peer review. 24.5 Section 24.5 Public Health PUBLIC....5 Peer review. An individual may not be considered for appointment into the SBRS unless his/her qualifications have been reviewed by a PHS peer review committee and the committee has recommended appointment to...

Rethinking Feedback Practices in Higher Education: A Peer Review Perspective

ERIC Educational Resources Information Center

Nicol, David; Thomson, Avril; Breslin, Caroline

2014-01-01

Peer review is a reciprocal process whereby students produce feedback reviews on the work of peers and receive feedback reviews from peers on their own work. Prior research has primarily examined the learning benefits that result from the receipt of feedback reviews, with few studies specifically exploring the merits of producing feedback reviews…

What is open peer review? A systematic review.

PubMed

Ross-Hellauer, Tony

2017-01-01

Background : "Open peer review" (OPR), despite being a major pillar of Open Science, has neither a standardized definition nor an agreed schema of its features and implementations. The literature reflects this, with numerous overlapping and contradictory definitions. While for some the term refers to peer review where the identities of both author and reviewer are disclosed to each other, for others it signifies systems where reviewer reports are published alongside articles. For others it signifies both of these conditions, and for yet others it describes systems where not only "invited experts" are able to comment. For still others, it includes a variety of combinations of these and other novel methods. Methods : Recognising the absence of a consensus view on what open peer review is, this article undertakes a systematic review of definitions of "open peer review" or "open review", to create a corpus of 122 definitions. These definitions are systematically analysed to build a coherent typology of the various innovations in peer review signified by the term, and hence provide the precise technical definition currently lacking. Results : This quantifiable data yields rich information on the range and extent of differing definitions over time and by broad subject area. Quantifying definitions in this way allows us to accurately portray exactly how ambiguously the phrase "open peer review" has been used thus far, for the literature offers 22 distinct configurations of seven traits, effectively meaning that there are 22 different definitions of OPR in the literature reviewed. Conclusions : I propose a pragmatic definition of open peer review as an umbrella term for a number of overlapping ways that peer review models can be adapted in line with the aims of Open Science, including making reviewer and author identities open, publishing review reports and enabling greater participation in the peer review process.

Peer Review Quality and Transparency of the Peer-Review Process in Open Access and Subscription Journals.

PubMed

Wicherts, Jelte M

2016-01-01

Recent controversies highlighting substandard peer review in Open Access (OA) and traditional (subscription) journals have increased the need for authors, funders, publishers, and institutions to assure quality of peer-review in academic journals. I propose that transparency of the peer-review process may be seen as an indicator of the quality of peer-review, and develop and validate a tool enabling different stakeholders to assess transparency of the peer-review process. Based on editorial guidelines and best practices, I developed a 14-item tool to rate transparency of the peer-review process on the basis of journals' websites. In Study 1, a random sample of 231 authors of papers in 92 subscription journals in different fields rated transparency of the journals that published their work. Authors' ratings of the transparency were positively associated with quality of the peer-review process but unrelated to journal's impact factors. In Study 2, 20 experts on OA publishing assessed the transparency of established (non-OA) journals, OA journals categorized as being published by potential predatory publishers, and journals from the Directory of Open Access Journals (DOAJ). Results show high reliability across items (α = .91) and sufficient reliability across raters. Ratings differentiated the three types of journals well. In Study 3, academic librarians rated a random sample of 140 DOAJ journals and another 54 journals that had received a hoax paper written by Bohannon to test peer-review quality. Journals with higher transparency ratings were less likely to accept the flawed paper and showed higher impact as measured by the h5 index from Google Scholar. The tool to assess transparency of the peer-review process at academic journals shows promising reliability and validity. The transparency of the peer-review process can be seen as an indicator of peer-review quality allowing the tool to be used to predict academic quality in new journals.

Peer Review Quality and Transparency of the Peer-Review Process in Open Access and Subscription Journals

PubMed Central

Wicherts, Jelte M.

2016-01-01

Background Recent controversies highlighting substandard peer review in Open Access (OA) and traditional (subscription) journals have increased the need for authors, funders, publishers, and institutions to assure quality of peer-review in academic journals. I propose that transparency of the peer-review process may be seen as an indicator of the quality of peer-review, and develop and validate a tool enabling different stakeholders to assess transparency of the peer-review process. Methods and Findings Based on editorial guidelines and best practices, I developed a 14-item tool to rate transparency of the peer-review process on the basis of journals’ websites. In Study 1, a random sample of 231 authors of papers in 92 subscription journals in different fields rated transparency of the journals that published their work. Authors’ ratings of the transparency were positively associated with quality of the peer-review process but unrelated to journal’s impact factors. In Study 2, 20 experts on OA publishing assessed the transparency of established (non-OA) journals, OA journals categorized as being published by potential predatory publishers, and journals from the Directory of Open Access Journals (DOAJ). Results show high reliability across items (α = .91) and sufficient reliability across raters. Ratings differentiated the three types of journals well. In Study 3, academic librarians rated a random sample of 140 DOAJ journals and another 54 journals that had received a hoax paper written by Bohannon to test peer-review quality. Journals with higher transparency ratings were less likely to accept the flawed paper and showed higher impact as measured by the h5 index from Google Scholar. Conclusions The tool to assess transparency of the peer-review process at academic journals shows promising reliability and validity. The transparency of the peer-review process can be seen as an indicator of peer-review quality allowing the tool to be used to predict academic quality in new journals. PMID:26824759

Detailed prospective peer review in a community radiation oncology clinic.

PubMed

Mitchell, James D; Chesnut, Thomas J; Eastham, David V; Demandante, Carlo N; Hoopes, David J

In 2012, we instituted detailed prospective peer review of new cases. We present the outcomes of peer review on patient management and time required for peer review. Peer review rounds were held 3 to 4 days weekly and required 2 physicians to review pertinent information from the electronic medical record and treatment planning system. Eight aspects were reviewed for each case: 1) workup and staging; 2) treatment intent and prescription; 3) position, immobilization, and simulation; 4) motion assessment and management; 5) target contours; 6) normal tissue contours; 7) target dosimetry; and 8) normal tissue dosimetry. Cases were marked as, "Meets standard of care," "Variation," or "Major deviation." Changes in treatment plan were noted. As our process evolved, we recorded the time spent reviewing each case. From 2012 to 2014, we collected peer review data on 442 of 465 (95%) radiation therapy patients treated in our hospital-based clinic. Overall, 91 (20.6%) of the cases were marked as having a variation, and 3 (0.7%) as major deviation. Forty-two (9.5%) of the cases were altered after peer review. An overall peer review score of "Variation" or "Major deviation" was highly associated with a change in treatment plan (P < .01). Changes in target contours were recommended in 10% of cases. Gastrointestinal cases were significantly associated with a change in treatment plan after peer review. Indicators on position, immobilization, simulation, target contours, target dosimetry, motion management, normal tissue contours, and normal tissue dosimetry were significantly associated with a change in treatment plan. The mean time spent on each case was 7 minutes. Prospective peer review is feasible in a community radiation oncology practice. Our process led to changes in 9.5% of cases. Peer review should focus on technical factors such as target contours and dosimetry. Peer review required 7 minutes per case. Published by Elsevier Inc.

How Long Is Too Long in Contemporary Peer Review? Perspectives from Authors Publishing in Conservation Biology Journals

PubMed Central

Nguyen, Vivian M.; Haddaway, Neal R.; Gutowsky, Lee F. G.; Wilson, Alexander D. M.; Gallagher, Austin J.; Donaldson, Michael R.; Hammerschlag, Neil; Cooke, Steven J.

2015-01-01

Delays in peer reviewed publication may have consequences for both assessment of scientific prowess in academia as well as communication of important information to the knowledge receptor community. We present an analysis on the perspectives of authors publishing in conservation biology journals regarding their opinions on the importance of speed in peer-review as well as how to improve review times. Authors were invited to take part in an online questionnaire, of which the data was subjected to both qualitative (open coding, categorizing) and quantitative analyses (generalized linear models). We received 637 responses to 6,547 e-mail invitations sent. Peer-review speed was generally perceived as slow, with authors experiencing a typical turnaround time of 14 weeks while their perceived optimal review time was six weeks. Male and younger respondents seem to have higher expectations of review speed than females and older respondents. The majority of participants attributed lengthy review times to reviewer and editor fatigue, while editor persistence and journal prestige were believed to speed up the review process. Negative consequences of lengthy review times were perceived to be greater for early career researchers and to have impact on author morale (e.g. motivation or frustration). Competition among colleagues was also of concern to respondents. Incentivizing peer-review was among the top suggested alterations to the system along with training graduate students in peer-review, increased editorial persistence, and changes to the norms of peer-review such as opening the peer-review process to the public. It is clear that authors surveyed in this study viewed the peer-review system as under stress and we encourage scientists and publishers to push the envelope for new peer-review models. PMID:26267491

Peer-supported review of teaching: making the grade in midwifery and nursing education.

PubMed

Murphy Tighe, Sylvia; Bradshaw, Carmel

2013-11-01

This paper outlines the value of peer-supported review of teaching for nurse and midwifery educators in an academic environment. Reflection and continuing professional development are important tenets of an educators' practice and can be addressed via peer observation. Definitions and models of peer observation are presented. The strengths and challenges associated with peer-supported review of teaching are discussed. The reasons why peer observation is underutilised are explored with some suggestions on how to overcome these challenges. Recent developments in relation to peer observation and peer-supported review are outlined. The need for tangible evidence of development and enhancement of existing teaching expertise is very pronounced in the current economic climate, it is concluded that peer-supported review of teaching can provide such evidence. Copyright © 2012 Elsevier Ltd. All rights reserved.

Peer review in hematopoietic cell transplantation: are we doing our fair share?

PubMed

Giralt, S; Korngold, R; Lazarus, H M

2016-09-01

Peer review is believed to be important in maintaining the quality and integrity of research in academic endeavors. Recently, the value of the current peer review process, which is more than 100 years old has come into question. In the field of hematopoietic cell transplantation (HCT), peer review was unable to prevent the publication of the largest and most notorious scientific fraud in our field. In order to assess how the HCT community views and how engaged it is with the peer review process, the American Society of Blood and Marrow Transplantation conducted a survey of all of its members in 2014. The survey was sent to all active members through multiple email communications in August and September 2014. Of a total of 1183 members, 149 responded. Almost all of the respondents had participated in the peer review process, with few respondents declining ever to review manuscripts. The most common cause for declining review requests was lack of time. Most respondents (68%) thought that the current peer review process was relatively fair and unbiased, whereas only 9% of the respondents stated that they did not believe in the peer review process. In conclusion, among the respondents of this survey most felt the peer review process to be valuable and fair, however, the lack of response suggests that further study into improving the peer review process in the field of HCT is warranted in the era of electronic publishing and communication.

The Potential of Peer Review

ERIC Educational Resources Information Center

Johnson, Susan Moore; Fiarman, Sarah E.

2012-01-01

Peer review of teachers is controversial for several reasons. Some say peer reviewers encroach on the rightful domain of the principal as instructional leader. Others argue that, because peer evaluators are fellow teachers, they may be biased or unwilling to make hard decisions. Many teachers find the prospect of peer evaluation unsettling because…

How are we assessing near-peer teaching in undergraduate health professional education? A systematic review.

PubMed

Irvine, Susan; Williams, Brett; McKenna, Lisa

2017-03-01

Near Peer teaching (NPT) is reported as an effective pedagogical approach to student learning and performance. Studies in medicine, nursing and health sciences have relied mainly on self-reports to describe its benefits, focusing on psychomotor and cognitive aspects of learning. Despite increasing research reports on peer teaching internationally, little is known about the various domains of learning used in assessment of performance and objective learning outcomes of NPT. To determine the domains of learning and assessment outcomes used in NPT in undergraduate health professional education. Quantitative systematic review was conducted in accord with the PRISMA protocol and the Joanna Briggs Institute processes. A wide literature search was conducted for the period 1990-November 2015 of fourteen databases. Grey literature was undertaken from all key research articles. Studies meeting the inclusion criteria were eligible for consideration, including measured learning outcomes of near-peer teaching in undergraduate education in nursing, medicine and health sciences. Set limitations included publications after 1990 (2015 inclusive), English language and objective learning outcomes. A quality appraisal process involving two independent reviewers was used to analyse the data. Of 212 selected articles, 26 were included in the review. Terminology was confusing and found to be a barrier to the review process. Although some studies demonstrated effective learning outcomes resulting from near-peer teaching, others were inconclusive. Studies focused on cognitive and psychomotor abilities of learners with none assessing metacognition, affective behaviours or learning outcomes from quality of understanding. The studies reviewed focused on cognitive and psychomotor abilities of learners. Even though evidence clearly indicates that metacognition and affective behaviours have direct influence on learning and performance, indicating more research around this topic is warranted. Methodological quality of the studies and lack of theoretical frameworks underpinned by educational psychology may have contributed to inconsistencies in learning outcomes reported. Crown Copyright © 2016. Published by Elsevier Ltd. All rights reserved.

28 CFR 34.105 - Peer review methods.

Code of Federal Regulations, 2010 CFR

2010-07-01

... 28 Judicial Administration 1 2010-07-01 2010-07-01 false Peer review methods. 34.105 Section 34... Review § 34.105 Peer review methods. (a) For both competitive and noncompetitive applications, peer... announcement or otherwise established by the Administrator, together with the assignment of numerical values...

7 CFR 3400.21 - Scientific peer review for research activities.

Code of Federal Regulations, 2010 CFR

2010-01-01

... 7 Agriculture 15 2010-01-01 2010-01-01 false Scientific peer review for research activities. 3400... STATE RESEARCH, EDUCATION, AND EXTENSION SERVICE, DEPARTMENT OF AGRICULTURE SPECIAL RESEARCH GRANTS PROGRAM Peer and Merit Review Arranged by Grantees § 3400.21 Scientific peer review for research...

Peer Review of Teaching: Sharing Best Practices

ERIC Educational Resources Information Center

Golparian, Shaya; Chan, Judy; Cassidy, Alice

2015-01-01

In this paper, we share examples of best peer review of teaching practices, drawing on our involvement in the design and implementation of the Peer Review of Teaching program at the Centre for Teaching, Learning and Technology. We review the history of the Peer Review of Teaching Initiative at the University of British Columbia and explain key…

Nanoscale Measurements of Magnetism & Spin Coherence in Semiconductors

DTIC Science & Technology

2015-12-17

superconductor created by magnetic defects. These energy-resolved studies are distinct from typical spin-selective measurements performed previously using...MacDonald, B. A. Bernevig, A. Yazdani. Observation of Majorana fermions in ferromagnetic atomic chains on a superconductor , Science, (10 2014): 602... superconductor , Physical Review B, (07 2013): 0. doi: 10.1103/PhysRevB.88.020407 TOTAL: 4 Number of Papers published in peer-reviewed journals

Adolescent peer group identification and characteristics: A review of the literature

PubMed Central

Sussman, Steve; Pokhrel, Pallav; Ashmore, Richard D.; Brown, B. Bradford

2011-01-01

This study provides an exhaustive review of 44 peer-reviewed quantitative or qualitative data-based peer-reviewed studies completed on adolescent peer group identification. Adolescent peer group identification is one’s self-perceived or other-perceived membership in discrete teenage peer groups. The studies reviewed suggest that adolescent peer groups consist of five general categories differentiable by lifestyle characteristics: Elites, Athletes, Academics, Deviants, and Others. We found that the Deviant adolescent group category reported relatively greater participation in drug use and other problem behaviors across studies, whereas Academics and Athletes exhibited the least participation in these problem behaviors. Additional research is needed in this arena to better understand the operation of adolescent group labels. PMID:17188815

28 CFR 34.104 - Use of peer review.

Code of Federal Regulations, 2010 CFR

2010-07-01

... 28 Judicial Administration 1 2010-07-01 2010-07-01 false Use of peer review. 34.104 Section 34.104 Judicial Administration DEPARTMENT OF JUSTICE OJJDP COMPETITION AND PEER REVIEW PROCEDURES Peer Review § 34... programs for which a large number of applications is expected, preapplications (concept papers) may be...

The Potential of Dual-Language Cross-Cultural Peer Review

ERIC Educational Resources Information Center

Ruecker, Todd

2011-01-01

This article explores the potential of dual-language cross-cultural peer review and how it improves on traditional monolingual and monocultural peer review. Drawing on scholarship related to international exchange programmes, peer review, and two-way immersion programmes in the United States as well as data collected while facilitating the…

7 CFR 550.17 - Peer review.

Code of Federal Regulations, 2010 CFR

2010-01-01

... 7 Agriculture 6 2010-01-01 2010-01-01 false Peer review. 550.17 Section 550.17 Agriculture... § 550.17 Peer review. Upon request of the REE Agency, cooperators may be requested to provide documentation in support of peer review activities and cooperator personnel may be requested to participate in...

7 CFR 3411.10 - Establishment and operation of peer review groups.

Code of Federal Regulations, 2011 CFR

2011-01-01

... INSTITUTE OF FOOD AND AGRICULTURE NATIONAL RESEARCH INITIATIVE COMPETITIVE GRANTS PROGRAM Scientific Peer Review of Research Grant Applications § 3411.10 Establishment and operation of peer review groups. Subject to § 3411.5, the Administrator shall adopt procedures for the conduct of peer reviews and the...

Toward the Integration of Peer Reviewing and Computational Linguistics Approaches

ERIC Educational Resources Information Center

Park, Juhwa; Cho, Kwangsu

2017-01-01

Previous research has shown the effectiveness of peer reviewing on the improvement of writing quality. However, the fact that students themselves, arguably novices, judged the improvement leads to concerns about the validity of peer reviewing. We measured writing quality before and after peer reviewing using Coh-Metrix, which computationally…

Can parental monitoring and peer management reduce the selection or influence of delinquent peers? Testing the question using a dynamic social network approach.

PubMed

Tilton-Weaver, Lauree C; Burk, William J; Kerr, Margaret; Stattin, Håkan

2013-11-01

We tested whether parents can reduce affiliation with delinquent peers through 3 forms of peer management: soliciting information, monitoring rules, and communicating disapproval of peers. We examined whether peer management interrupted 2 peer processes: selection and influence of delinquent peers. Adolescents' feelings of being overcontrolled by parents were examined as an additional moderator of delinquent selection and influence. Using network data from a community sample (N = 1,730), we tested whether selection and influence processes varied across early, middle, and late adolescent cohorts. Selection and influence of delinquent peers were evident in all 3 cohorts and did not differ in strength. Parental monitoring rules reduced the selection of delinquent peers in the oldest cohort. A similar effect was found in the early adolescent cohort, but only for adolescents who did not feel overcontrolled by parents. Monitoring rules increased the likelihood of selecting a delinquent friend among those who felt overcontrolled. The effectiveness of communicating disapproval was also mixed: in the middle adolescent network, communicating disapproval increased the likelihood of an adolescent selecting a delinquent friend. Among late adolescents, high levels of communicating disapproval were effective, reducing the influence of delinquent peers for adolescents reporting higher rates of delinquency. For those who reported lower levels of delinquency, high levels of communicating disapproval increased the influence of delinquent peers. The results of this study suggest that the effectiveness of monitoring and peer management depend on the type of behavior, the timing of its use, and whether adolescents feel overcontrolled by parents.

Facilitation of school re-entry and peer acceptance of children with cancer: a review and meta-analysis of intervention studies.

PubMed

Helms, A S; Schmiegelow, K; Brok, J; Johansen, C; Thorsteinsson, T; Simovska, V; Larsen, H B

2016-01-01

Increased survival rates from childhood cancer call for efforts to reintegrate children with cancer back into their academic and social environments. The aims of this study were to: (1) review and analyse the existing literature on school re-entry interventions for children with cancer; and (2) discuss the importance of peer involvement in the treatment. Relevant databases were searched using equivalent search algorithms and six studies were selected that target children with cancer and/or their classmates. Two authors independently reviewed the literature for data extraction. The articles were reviewed using the PRISMA model for reporting reviews. Statistical calculations for the meta-analyses were done using Review Manager 5.2. The meta-analyses showed significant effects of school re-entry programmes in terms of enhancing academic achievement in children with cancer (P = 0.008) and lowering their levels of depression (P = 0.05). Increased knowledge among classmates was associated with less fear and a more positive attitude towards the child with cancer. Due to limited numbers of patients, lack of control groups, and the diversity of intervention strategies used in previous studies, there is a need for intervention programmes exploring the optimal path for the reintegration of children with cancer into the education system and into their peer groups. © 2014 John Wiley & Sons Ltd.

Developmental Issues in the Treatment of Diabetic Women.

ERIC Educational Resources Information Center

Hartman-Stein, Paula; Reuter, Jeanette M.

1988-01-01

Reviews selected articles from medical and psychological literature that focus on special issues for diabetic woman during preadolescence, adolescence, and adulthood. Makes recommendations for behavioral interventions with diabetic women in regard to sick role adjustment, peer conformity pressures, eating disorders, sexuality, and pregnancy.…

SEMINAR PUBLICATION: NATIONAL CONFERENCE ON SANITARY SEWER OVERFLOWS (SSOS)

EPA Science Inventory

This seminar publication presents selected peer-reviewed papers from the conference. Thousands of municipalities across the nation are serviced by separate sanitary sewer systems. A chronic problem that faces many of these systems is the occurrence of SSOs, caused mainly by the i...

Collaborative Learning through Formative Peer Review: Pedagogy, Programs and Potential

ERIC Educational Resources Information Center

Sondergaard, Harald; Mulder, Raoul A.

2012-01-01

We examine student peer review, with an emphasis on formative practice and collaborative learning, rather than peer grading. Opportunities to engage students in such formative peer assessment are growing, as a range of online tools become available to manage and simplify the process of administering student peer review. We consider whether…

Writing to Learn: An Evaluation of the Calibrated Peer Review™ Program in Two Neuroscience Courses

PubMed Central

Prichard, J. Roxanne

2005-01-01

Although the majority of scientific information is communicated in written form, and peer review is the primary process by which it is validated, undergraduate students may receive little direct training in science writing or peer review. Here, I describe the use of Calibrated Peer Review™ (CPR), a free, web-based writing and peer review program designed to alleviate instructor workload, in two undergraduate neuroscience courses: an upper- level sensation and perception course (41 students, three assignments) and an introductory neuroscience course (50 students; two assignments). Using CPR online, students reviewed primary research articles on assigned ‘hot’ topics, wrote short essays in response to specific guiding questions, reviewed standard ‘calibration’ essays, and provided anonymous quantitative and qualitative peer reviews. An automated grading system calculated the final scores based on a student’s essay quality (as determined by the average of three peer reviews) and his or her accuracy in evaluating 1) three standard calibration essays, 2) three anonymous peer reviews, and 3) his or her self review. Thus, students were assessed not only on their skill at constructing logical, evidence-based arguments, but also on their ability to accurately evaluate their peers’ writing. According to both student self-reports and instructor observation, students’ writing and peer review skills improved over the course of the semester. Student evaluation of the CPR program was mixed; while some students felt like the peer review process enhanced their understanding of the material and improved their writing, others felt as though the process was biased and required too much time. Despite student critiques of the program, I still recommend the CPR program as an excellent and free resource for incorporating more writing, peer review, and critical thinking into an undergraduate neuroscience curriculum. PMID:23493247

Social Media, Peer Review, and Responsible Conduct of Research (RCR) in Chemistry: Trends, Pitfalls, and Promises

PubMed Central

Jogalekar, Ashutosh S.

2015-01-01

Over the last two decades, various themes inherent in the responsible conduct of research (RCR) in chemistry have been brought to light through prominent cases of research misconduct. This article will describe a few of these cases especially through the lens of social media such as blogs and Twitter. A case will be made that these wholly novel modalities of online discussion are now complementing, and in some cases even circumventing some of the limitations of traditional peer review in chemistry. We present in detail our evaluation of three recent cases of RCR along with several other social media illustrations. These cases have been selected to be representative and showcase several of the most prominent issues at the intersection of traditional and social-media based peer review. In each case, basic details are presented along with a brief discussion of the underlying issues—readers interested in deeper analysis of each subject are referred to a collection of relevant articles and websites. This perspective focuses on the most important RCR issues that have arisen in the past decade, a time which we believe coincides with the serious participation of the scientific community in general, and the chemistry community in particular, in social media-based, citizen-enabled peer-review. A discussion of important trends in RCR in the age of social media, outstanding developments in this area, and questions of enduring interest for the near future concludes the article. PMID:26155733

Social Media, Peer Review, and Responsible Conduct of Research (RCR) in Chemistry: Trends, Pitfalls, and Promises.

PubMed

Jogalekar, Ashutosh S

2015-01-01

Over the last two decades, various themes inherent in the responsible conduct of research (RCR) in chemistry have been brought to light through prominent cases of research misconduct. This article will describe a few of these cases especially through the lens of social media such as blogs and Twitter. A case will be made that these wholly novel modalities of online discussion are now complementing, and in some cases even circumventing some of the limitations of traditional peer review in chemistry. We present in detail our evaluation of three recent cases of RCR along with several other social media illustrations. These cases have been selected to be representative and showcase several of the most prominent issues at the intersection of traditional and social-media based peer review. In each case, basic details are presented along with a brief discussion of the underlying issues-readers interested in deeper analysis of each subject are referred to a collection of relevant articles and websites. This perspective focuses on the most important RCR issues that have arisen in the past decade, a time which we believe coincides with the serious participation of the scientific community in general, and the chemistry community in particular, in social media-based, citizen-enabled peer-review. A discussion of important trends in RCR in the age of social media, outstanding developments in this area, and questions of enduring interest for the near future concludes the article.

Evaluating alternative systems of peer review: a large-scale agent-based modelling approach to scientific publication.

PubMed

Kovanis, Michail; Trinquart, Ludovic; Ravaud, Philippe; Porcher, Raphaël

2017-01-01

The debate on whether the peer-review system is in crisis has been heated recently. A variety of alternative systems have been proposed to improve the system and make it sustainable. However, we lack sufficient evidence and data related to these issues. Here we used a previously developed agent-based model of the scientific publication and peer-review system calibrated with empirical data to compare the efficiency of five alternative peer-review systems with the conventional system. We modelled two systems of immediate publication, with and without online reviews (crowdsourcing), a system with only one round of reviews and revisions allowed (re-review opt-out) and two review-sharing systems in which rejected manuscripts are resubmitted along with their past reviews to any other journal (portable) or to only those of the same publisher but of lower impact factor (cascade). The review-sharing systems outperformed or matched the performance of the conventional one in all peer-review efficiency, reviewer effort and scientific dissemination metrics we used. The systems especially showed a large decrease in total time of the peer-review process and total time devoted by reviewers to complete all reports in a year. The two systems with immediate publication released more scientific information than the conventional one but provided almost no other benefit. Re-review opt-out decreased the time reviewers devoted to peer review but had lower performance on screening papers that should not be published and relative increase in intrinsic quality of papers due to peer review than the conventional system. Sensitivity analyses showed consistent findings to those from our main simulations. We recommend prioritizing a system of review-sharing to create a sustainable scientific publication and peer-review system.

Implementing Head and Neck Contouring Peer Review without Pathway Delay: The On-demand Approach.

PubMed

Fong, C; Sanghera, P; Good, J; Nightingale, P; Hartley, A

2017-12-01

Peer review of contour volume is a priority in the radiotherapy treatment quality assurance process for head and neck cancer. It is essential that incorporation of peer review activity does not introduce additional delays. An on-demand peer review process was piloted to assess the feasibility and efficiency of this approach, as compared with a historic scheduled weekly approach. Between November 2016 and April 2017 four head and neck clinicians in one centre took part in an on-demand peer review process. Cases were of radical or adjuvant intent of any histology and submitted on a voluntary basis. The outcome of contour peer review would be one of unchanged (UC), unchanged with variation or discretion noted (UV), minor change (M) or significant change (S). The time difference between the completion of the on-demand peer review was compared with the time difference to a hypothetical next Monday or Tuesday weekly peer review meeting. The time taken to review each case was also documented in the latter period of the pilot project. In total, 62 cases underwent peer review. Peer review on-demand provided dosimetrists with an average of an extra two working days available per case to meet treatment start dates. The proportion of cases with outcomes UC, UV, M and S were 45%, 16%, 26% and 13%, respectively. The mean peer review time spent per case was 17 min (12 cases). The main reason for S was discrepancy in imaging interpretation (4/8 cases). A lower proportion of oropharyngeal cases were submitted and had S outcomes. A higher proportion of complex cases, e.g. sinonasal/nasopharynx location or previous downstaging chemotherapy had S outcomes. The distribution of S outcomes appears to be similar regardless of clinician experience. The level of peer review activity among individuals differed by workload and job timetable. On-demand peer review of the head and neck contour volume is feasible, reduces delay to the start of dosimetry planning and bypasses the logistical barriers of weekly meetings. An audit of participation will be required to ensure successful implementation. Copyright © 2017 The Royal College of Radiologists. Published by Elsevier Ltd. All rights reserved.

Ancient texts to PubMed: a brief history of the peer-review process.

PubMed

Farrell, P R; Magida Farrell, L; Farrell, M K

2017-01-01

The formal evaluation of scientific literature by invited referees (peer reviewers) is a relatively recent phenomenon and now is considered a cornerstone of modern science. However, its roots can be traced back to antiquity. As the speed and complexity of scientific information and publishing increases in the digital age, peer review must continue to evolve. To understand the future direction of peer review, we must understand its past. Here, we briefly explore the history of scientific peer review. This may help us predict and design appropriate peer review for the new era. This work was originally presented at the Pediatric Academic Societies Annual Meeting in Baltimore, Maryland in the Spring of 2016.

Narrative synthesis of equine-assisted psychotherapy literature: Current knowledge and future research directions.

PubMed

Lee, Ping-Tzu; Dakin, Emily; McLure, Merinda

2016-05-01

Equine-assisted psychotherapy (EAP) is an innovative emerging approach to mental health treatment. This narrative synthesis explores the current state of knowledge and areas for future research in EAP. Specifically reviewed are qualitative and quantitative empirical studies, including both articles published in peer-reviewed journals and research presented in theses and dissertations. We selected 24 studies for final inclusion in this study, dating between 2005 and 2013, and including the first EAP empirical research completed in 2005. Four of these studies are peer-reviewed journal articles, while 20 are master's theses or doctoral dissertations. The reviewed qualitative research provides initial evidence for the value of EAP for enhancing adolescents' communication and relationship skills. The reviewed experimental and quasi-experimental research provides initial evidence for the value of EAP for enhancing children's and adolescents' emotional, social and behavioural functioning. Yet, conclusions about the effectiveness of EAP must still be considered preliminary due to various methodological limitations in the reviewed research. The narrative review describes these methodological limitations and concludes with recommendations for future research. © 2015 John Wiley & Sons Ltd.

Peer review in forensic science.

PubMed

Ballantyne, Kaye N; Edmond, Gary; Found, Bryan

2017-08-01

Peer review features prominently in the forensic sciences. Drawing on recent research and studies, this article examines different types of peer review, specifically: editorial peer review; peer review by the scientific community; technical and administrative review; and verification (and replication). The article reviews the different meanings of these quite disparate activities and their utility in relation to enhancing performance and reducing error. It explains how forensic practitioners should approach and use peer review, as well as how it should be described in expert reports and oral testimony. While peer review has considerable potential, and is a key component of modern quality management systems, its actual value in most forensic science settings has yet to be determined. In consequence, forensic practitioners should reflect on why they use specific review procedures and endeavour to make their actual practices and their potential value transparent to consumers; whether investigators, lawyers, jurors or judges. Claims that review increases the validity of a scientific technique or accuracy of opinions within a particular case should be avoided until empirical evidence is available to support such assertions. Copyright © 2017 Elsevier B.V. All rights reserved.

Final Report from the External Peer Review of the IRIS ...

EPA Pesticide Factsheets

This document is the final report for the 2004 external peer review for the EPA IRIS Reassessment of the Inhalation Carcinogenicity of Naphthalene, prepared by the Office of Research and Development's National Center for Environmental Assessment (NCEA), for the Integrated Risk Information System (IRIS) Database. A panel of external peer reviewers met to discuss the IRIS report and their responses to the charge questions on July 30, 2004. This document contains the final written comments of the external peer reviewers. This document is the final report for the 2004 external peer review for the IRIS Reassessment of the Inhalation Carcinogenicity of Naphthalene, prepared by the U.S. Environmental Protection Agency (EPA), National Center for Environmental Assessment (NCEA), for the Integrated Risk Information System (IRIS). A panel of external peer reviewers met to discuss their responses to the charge questions on July 30, 2004. This document contains the final written comments of the external peer reviewers.

Environment, Safety and Health Self-Assessment Report Fiscal Year 2010

DOE Office of Scientific and Technical Information (OSTI.GOV)

Robinson, Scott

2011-03-23

The Lawrence Berkeley National Laboratory (LBNL) Environment, Safety, and Health (ES&H) Self-Assessment Program was established to ensure that Integrated Safety Management (ISM) is implemented institutionally and by all divisions. The ES&H Self-Assessment Program, managed by the Office of Contractor Assurance (OCA), provides for an internal evaluation of all ES&H programs and systems at LBNL. The primary objective of the program is to ensure that work is conducted safely and with minimal negative impact to workers, the public, and the environment. Self-assessment follows the five core functions and guiding principles of ISM. Self-assessment is the mechanism used to promote the continuousmore » improvement of the Laboratory's ES&H programs. The process is described in the Environment, Safety, and Health Assurance Plan (PUB-5344) and is composed of three types of self-assessments: Division ES&H Self-Assessment, ES&H Technical Assurance Program Assessment, and Division ES&H Peer Review. The Division ES&H Self-Assessment Manual (PUB-3105) provides the framework by which divisions conduct formal ES&H self-assessments to systematically identify program deficiencies. Issue-specific assessments are designed and implemented by the divisions and focus on areas of interest to division management. They may be conducted by teams and involve advance planning to ensure that appropriate resources are available. The ES&H Technical Assurance Program Manual (PUB-913E) provides the framework for systematic reviews of ES&H programs and processes. The ES&H Technical Assurance Program Assessment is designed to evaluate whether ES&H programs and processes are compliant with guiding regulations, are effective, and are properly implemented by LBNL divisions. The Division ES&H Peer Review Manual provides the framework by which division ISM systems are evaluated and improved. Peer Reviews are conducted by teams under the direction of senior division management and focus on higher-level management issues. Peer Review teams are selected on the basis of members knowledge and experience in the issues of interest to the division director. LBNL periodically requests in-depth independent assessments of selected ES&H programs. Such assessments augment LBNL's established assessment processes and provide an objective view of ES&H program effectiveness. Institutional Findings, Observations, and Noteworthy Practices identified during independent assessments are specifically intended to help LBNL identify opportunities for program improvement. This report includes the results of the Division ES&H Self-Assessment, ES&H Technical Assurance Program Assessment, and Division ES&H Peer Review, respectively.« less

Technology-Enhanced Peer Review: Benefits and Implications of Providing Multiple Reviews

ERIC Educational Resources Information Center

Papadopoulos, Pantelis M.; Lagkas, Thomas D.; Demetriadis, Stavros N.

2017-01-01

This study analyses the impact of self and peer feedback in technology-enhanced peer review settings. The impact of receiving peer comments ("receiver" perspective) is compared to that of reaching own insights by reviewing others' work ("giver" perspective). In this study, 38 sophomore students were randomly assigned in two…

Undergraduate Essay Writing: Online and Face-to-Face Peer Reviews

ERIC Educational Resources Information Center

Chong, Mike R.; Goff, Lori; Dej, Kimberly

2012-01-01

We implemented two different approaches of using peer review to support undergraduate essay assignments for students taking large second-year courses in life sciences and biology: a web-based online peer review (OPR) approach and a more traditional face-to-face peer review (FPR) approach that was conducted in tutorial settings. The essays…

7 CFR 3401.12 - Establishment and operation of peer review groups.

Code of Federal Regulations, 2010 CFR

2010-01-01

... 7 Agriculture 15 2010-01-01 2010-01-01 false Establishment and operation of peer review groups... GRANTS PROGRAM Scientific Peer Review of Research Applications for Funding § 3401.12 Establishment and operation of peer review groups. Subject to § 3401.7, the Administrator will adopt procedures for the...

The Importance of Peer Review: Thoughts on Knudson, Morrow, and Thomas (2014)

ERIC Educational Resources Information Center

Fischman, Mark G.

2014-01-01

Knudson, Morrow, and Thomas (2014) recently summarized a number of important issues related to the quality of peer review and current peer-review practice in kinesiology. This writer endorses their six recommendations for improving peer review in kinesiology journals. The purpose of this commentary is to further highlight the importance of…

Focusing on Content: Discourse in L2 Peer Review Groups

ERIC Educational Resources Information Center

Vorobel, Oksana; Kim, Deoksoon

2014-01-01

Recent studies on peer review groups in second language classes have focused on various topics, including collaboration (Carr, 2008) and the effect of peer review versus teacher feedback on students' writing (Zhang, 1995). One area that has received little attention is the content of students' speech during peer review. This longitudinal case…

Peer Reviewers Learn from Giving Comments

ERIC Educational Resources Information Center

Cho, Young Hoan; Cho, Kwangsu

2011-01-01

Research on peer reviewing has revealed that comments received from peer reviewers are helpful when it comes to making revisions in an individual's writing, but the role of providing comments to peer writers has been little explored despite the potential value of such research. In this study, we explored how student reviewers learn by reviewing…

Analysis of Peer Review Comments: QM Recommendations and Feedback Intervention Theory

ERIC Educational Resources Information Center

Schwegler, Andria F.; Altman, Barbara W.

2015-01-01

Because feedback is a critical component of the continuous improvement cycle of the Quality Matters (QM) peer review process, the present research analyzed the feedback that peer reviewers provided to course developers after a voluntary, nonofficial QM peer review of online courses. Previous research reveals that the effects of feedback on…

Pre-University Chemistry Students in a Mimicked Scholarly Peer Review

ERIC Educational Resources Information Center

van Rens, Lisette; Hermarij, Philip; Pilot, Albert; Beishuizen, Jos; Hofman, Herman; Wal, Marjolein

2014-01-01

Peer review is a significant component in scientific research. Introducing peer review into inquiry processes may be regarded as an aim to develop student understanding regarding quality in inquiries. This study examines student understanding in inquiry peer reviews among pre-university chemistry students, aged 16-17, when they enact a design of a…

Assessing RN-to-RN peer review on clinical units.

PubMed

Pfeiffer, Judith A; Wickline, Mary A; Deetz, Jill; Berry, Elise S

2012-04-01

The primary purpose of this study was to measure informal registered nurse (RN)-to-RN peer review (defined as collegial communication about the quality of nursing care) at the work-unit level. Survey design with cluster sampling of 28 hospital or ambulatory care units (n = 541 respondents). Results were compared with existing patient safety and satisfaction data. A chi-squared test was used to compare responses against nurse characteristics. Nurses agreed that RN-to-RN peer review takes place on their units, but no correlation with patient safety and satisfaction data was found. Misunderstandings about the meaning of peer review were evident. Open-ended comments revealed barriers to peer review: fear of retribution, language barriers and lack of professionalism. Nurses need clarification of peer review. Issues with common language in a professional environment need to be addressed and nurses can learn collaboration from each other's cultures. Managers should support RN-to-RN peer review on clinical units. Methods used here may be useful to assess current departmental nurse peer review. © 2011 Blackwell Publishing Ltd.

Peer Review in Radiology: A Resident and Fellow Perspective.

PubMed

Grenville, Jeffrey; Doucette-Preville, David; Vlachou, Paraskevi A; Mnatzakanian, Gevork N; Raikhlin, Antony; Colak, Errol

2016-02-01

The purpose of this study was to explore Canadian radiology residents' and fellows' understanding, attitudes, opinions, and preferences toward peer review. An Internet-based anonymous questionnaire designed to understand one's familiarity, attitudes, opinions, and preferences toward peer review was distributed to radiology residents and fellows across Canada. Data were analyzed using descriptive statistics, and answers were stratified by level of training. A total of 136 trainees responded to the survey with 92 completed survey responses available for descriptive statistics. Approximately half of respondents are familiar with peer review (49%), and 39% of trainees are involved in peer review. Most respondents (92%) expressed an interest in learning more about peer review; believe that it should be incorporated into the residency training curriculum (86%), be mandatory (72%), and that current participation will increase odds of future participation (91%). Most trainees (80%) are comfortable advising one another about errors, but less comfortable advising staff (21%). Residents and fellows welcome the opportunity to learn more about peer review and believe it should be incorporated into the residency training curriculum. Understanding the attitudes and perceptions held by trainees regarding peer review is important, as a means to optimize education and maximize current and future participation in peer review. Copyright © 2016 American College of Radiology. Published by Elsevier Inc. All rights reserved.

A Liberation Health Approach to Examining Challenges and Facilitators of Peer-to-Peer Human Milk Sharing.

PubMed

McCloskey, Rebecca J; Karandikar, Sharvari

2018-04-01

Human milk sharing between peers is a common and growing practice. Although human milk has been unequivocally established as the ideal food source for infants, much stigma surrounds the practice of human milk sharing. Furthermore, there is little research examining peer-to-peer human milk sharing. Research Aim: We used the liberation health social work model to examine the experiences of mothers who have received donated human milk from a peer. Research questions were as follows: (a) What challenges do recipient mothers experience in peer-to-peer human milk sharing? (b) What supports do recipient mothers identify in peer-to-peer human milk sharing? Researchers conducted in-depth interviews with mothers ( N = 20) in the United States and Canada who were recipients of peer-to-peer human milk sharing. Researchers independently reviewed transcripts and completed open, axial, and selective coding. The authors discussed conflicts in theme identification until agreement was reached. Challenges to peer-to-peer human milk sharing were (a) substantial effort required to secure human milk; (b) institutional barriers; (c) milk bank specific barriers; and (d) lack of societal awareness and acceptance of human milk sharing. Facilitators included (a) informed decision making and transparency and (b) support from healthcare professionals. Despite risks and barriers, participants continued to pursue peer-to-peer human milk sharing. Informed by a liberation health framework, healthcare professionals-rather than universally discouraging human milk sharing between peers-should facilitate open dialogue with parents about the pros and cons of this practice and about screening recommendations to promote safety and mitigate risk.

Retrospective analysis of the quality of reports by author-suggested and non-author-suggested reviewers in journals operating on open or single-blind peer review models.

PubMed

Kowalczuk, Maria K; Dudbridge, Frank; Nanda, Shreeya; Harriman, Stephanie L; Patel, Jigisha; Moylan, Elizabeth C

2015-09-29

To assess whether reports from reviewers recommended by authors show a bias in quality and recommendation for editorial decision, compared with reviewers suggested by other parties, and whether reviewer reports for journals operating on open or single-blind peer review models differ with regard to report quality and reviewer recommendations. Retrospective analysis of the quality of reviewer reports using an established Review Quality Instrument, and analysis of reviewer recommendations and author satisfaction surveys. BioMed Central biology and medical journals. BMC Infectious Diseases and BMC Microbiology are similar in size, rejection rates, impact factors and editorial processes, but the former uses open peer review while the latter uses single-blind peer review. The Journal of Inflammation has operated under both peer review models. Two hundred reviewer reports submitted to BMC Infectious Diseases, 200 reviewer reports submitted to BMC Microbiology and 400 reviewer reports submitted to the Journal of Inflammation. For each journal, author-suggested reviewers provided reports of comparable quality to non-author-suggested reviewers, but were significantly more likely to recommend acceptance, irrespective of the peer review model (p<0.0001 for BMC Infectious Diseases, BMC Microbiology and the Journal of Inflammation). For BMC Infectious Diseases, the overall quality of reviewer reports measured by the Review Quality Instrument was 5% higher than for BMC Microbiology (p=0.042). For the Journal of Inflammation, the quality of reports was the same irrespective of the peer review model used. Reviewers suggested by authors provide reports of comparable quality to non-author-suggested reviewers, but are significantly more likely to recommend acceptance. Open peer review reports for BMC Infectious Diseases were of higher quality than single-blind reports for BMC Microbiology. There was no difference in quality of peer review in the Journal of Inflammation under open peer review compared with single blind. Published by the BMJ Publishing Group Limited. For permission to use (where not already granted under a licence) please go to http://group.bmj.com/group/rights-licensing/permissions.

Can Parental Monitoring and Peer Management Reduce the Selection or Influence of Delinquent Peers? Testing the Question Using a Dynamic Social Network Approach

ERIC Educational Resources Information Center

Tilton-Weaver, Lauree C.; Burk, William J.; Kerr, Margaret; Stattin, Håkan

2013-01-01

We tested whether parents can reduce affiliation with delinquent peers through 3 forms of peer management: soliciting information, monitoring rules, and communicating disapproval of peers. We examined whether peer management interrupted 2 peer processes: selection and influence of delinquent peers. Adolescents' feelings of being overcontrolled by…

Peer Portal: Quality Enhancement in Thesis Writing Using Self-Managed Peer Review on a Mass Scale

ERIC Educational Resources Information Center

Aghaee, Naghmeh; Hansson, Henrik

2013-01-01

This paper describes a specially developed online peer-review system, the Peer Portal, and the first results of its use for quality enhancement of bachelor's and master's thesis manuscripts. The peer-review system is completely student driven and therefore saves time for supervisors and creates a direct interaction between students without…

75 FR 4062 - Peer Review Best Practices Workshop

Federal Register 2010, 2011, 2012, 2013, 2014

2010-01-26

...:15 a.m. Panel 2: Applied Research, Technology Development--NIST, ARPA-E, ONR, MIT 12:30 p.m. Lunch 1... Energy Efficiency and Renewable Energy (EERE) funds a diverse portfolio of research, development...-federal organizations have chosen to select research and development projects, and on ``best practices...

48 CFR 1835.016-71 - NASA Research Announcements.

Code of Federal Regulations, 2011 CFR

2011-10-01

... 48 Federal Acquisition Regulations System 6 2011-10-01 2011-10-01 false NASA Research... NASA Research Announcements. (a) Scope. An NRA is used to announce research interests in support of NASA's programs, and, after peer or scientific review using factors in the NRA, select proposals for...

48 CFR 1835.016-71 - NASA Research Announcements.

Code of Federal Regulations, 2013 CFR

2013-10-01

... 48 Federal Acquisition Regulations System 6 2013-10-01 2013-10-01 false NASA Research... NASA Research Announcements. (a) Scope. An NRA is used to announce research interests in support of NASA's programs, and, after peer or scientific review using factors in the NRA, select proposals for...

48 CFR 1835.016-71 - NASA Research Announcements.

Code of Federal Regulations, 2012 CFR

2012-10-01

... 48 Federal Acquisition Regulations System 6 2012-10-01 2012-10-01 false NASA Research... NASA Research Announcements. (a) Scope. An NRA is used to announce research interests in support of NASA's programs, and, after peer or scientific review using factors in the NRA, select proposals for...

48 CFR 1835.016-71 - NASA Research Announcements.

Code of Federal Regulations, 2014 CFR

2014-10-01

... 48 Federal Acquisition Regulations System 6 2014-10-01 2014-10-01 false NASA Research... NASA Research Announcements. (a) Scope. An NRA is used to announce research interests in support of NASA's programs, and, after peer or scientific review using factors in the NRA, select proposals for...

Mapping the Diversity among Runaways: A Descriptive Multivariate Analysis of Selected Social Psychological Background Conditions.

ERIC Educational Resources Information Center

Brennan, Tim

1980-01-01

A review of prior classification systems of runaways is followed by a descriptive taxonomy of runaways developed using cluster-analytic methods. The empirical types illustrate patterns of weakness in bonds between runaways and families, schools, or peer relationships. (Author)

Gender bias in scholarly peer review.

PubMed

Helmer, Markus; Schottdorf, Manuel; Neef, Andreas; Battaglia, Demian

2017-03-21

Peer review is the cornerstone of scholarly publishing and it is essential that peer reviewers are appointed on the basis of their expertise alone. However, it is difficult to check for any bias in the peer-review process because the identity of peer reviewers generally remains confidential. Here, using public information about the identities of 9000 editors and 43000 reviewers from the Frontiers series of journals, we show that women are underrepresented in the peer-review process, that editors of both genders operate with substantial same-gender preference (homophily), and that the mechanisms of this homophily are gender-dependent. We also show that homophily will persist even if numerical parity between genders is reached, highlighting the need for increased efforts to combat subtler forms of gender bias in scholarly publishing.

Meaningful Peer Review in Radiology: A Review of Current Practices and Potential Future Directions.

PubMed

Moriarity, Andrew K; Hawkins, C Matthew; Geis, J Raymond; Dreyer, Keith J; Kamer, Aaron P; Khandheria, Paras; Morey, Jose; Whitfill, James; Wiggins, Richard H; Itri, Jason N

2016-12-01

The current practice of peer review within radiology is well developed and widely implemented compared with other medical specialties. However, there are many factors that limit current peer review practices from reducing diagnostic errors and improving patient care. The development of "meaningful peer review" requires a transition away from compliance toward quality improvement, whereby the information and insights gained facilitate education and drive systematic improvements that reduce the frequency and impact of diagnostic error. The next generation of peer review requires significant improvements in IT functionality and integration, enabling features such as anonymization, adjudication by multiple specialists, categorization and analysis of errors, tracking, feedback, and easy export into teaching files and other media that require strong partnerships with vendors. In this article, the authors assess various peer review practices, with focused discussion on current limitations and future needs for meaningful peer review in radiology. Copyright © 2016 American College of Radiology. Published by Elsevier Inc. All rights reserved.

Redefining the Practice of Peer Review Through Intelligent Automation-Part 3: Automated Report Analysis and Data Reconciliation.

PubMed

Reiner, Bruce I

2018-02-01

One method for addressing existing peer review limitations is the assignment of peer review cases on a completely blinded basis, in which the peer reviewer would create an independent report which can then be cross-referenced with the primary reader report of record. By leveraging existing computerized data mining techniques, one could in theory automate and objectify the process of report data extraction, classification, and analysis, while reducing time and resource requirements intrinsic to manual peer review report analysis. Once inter-report analysis has been performed, resulting inter-report discrepancies can be presented to the radiologist of record for review, along with the option to directly communicate with the peer reviewer through an electronic data reconciliation tool aimed at collaboratively resolving inter-report discrepancies and improving report accuracy. All associated report and reconciled data could in turn be recorded in a referenceable peer review database, which provides opportunity for context and user-specific education and decision support.

Research Integrity and Peer Review-past highlights and future directions.

PubMed

Boughton, Stephanie L; Kowalczuk, Maria K; Meerpohl, Joerg J; Wager, Elizabeth; Moylan, Elizabeth C

2018-01-01

In May 2016, we launched Research Integrity and Peer Review , an international, open access journal with fully open peer review (reviewers are identified on their reports and named reports are published alongside the article) to provide a home for research on research and publication ethics, research reporting, and research on peer review. As the journal enters its third year, we reflect on recent events and highlights for the journal and explore how the journal is faring in terms of gender and diversity in peer review. We also share the particular interests of our Editors-in-Chief regarding models of peer review, reporting quality, common research integrity issues that arise during the publishing process, and how people interact with the published literature. We continue to encourage further research into peer review, research and publication ethics and research reporting, as we believe that all new initiatives should be evidence-based. We also remain open to constructive discussions of the developments in the field that offer new solutions.

On the Nature and Role of Peer Review in Mathematics.

PubMed

Andersen, Line Edslev

2017-01-01

For the past three decades, peer review practices have received much attention in the literature. But although this literature covers many research fields, only one previous systematic study has been devoted to the practice of peer review in mathematics, namely a study by Geist, Löwe, and Van Kerkhove from 2010. This lack of attention may be due to a view that peer review in mathematics is more reliable, and therefore less interesting as an object of study, than peer review in other fields. In fact, Geist, Löwe, and Van Kerkhove argue that peer review in mathematics is relatively reliable. At the same time, peer review in mathematics differs from peer review in most, if not all, other fields in that papers submitted to mathematical journals are usually only reviewed by a single referee. Furthermore, recent empirical studies indicate that the referees do not check the papers line by line. I argue that, in spite of this, mathematical practice in general and refereeing practices in particular are such that the common practice of mathematical journals of using just one referee is justified from the point of view of proof validity assessment. The argument is based on interviews I conducted with seven mathematicians.

Experiences of undergraduate nursing students in peer assisted learning in clinical practice: a qualitative systematic review.

PubMed

Carey, Matthew C; Kent, Bridie; Latour, Jos M

2018-05-01

The objective of this qualitative systematic review was to identify and synthesize the best available evidence on experiences of peer assisted learning (PAL) among student nurses in clinical practice so as to understand the value of PAL for this population. Peer-assisted learning considers the benefits of peers working in collaboration and supporting each other in professional roles. This approach to facilitate learning is effective within universities, but there is limited exploration within the clinical practice environment. Within the UK, 50% of student nurses' learning is undertaken within clinical practice, providing a large portion of student allocation within these areas, but is unexplored in relation to PAL. Therefore, existing evidence examining PAL in clinical practice needs further exploration for a better understanding of its value to student nurses' learning. The systematic review considered studies that included male and female nursing students aged 18-50 years that explored undergraduate nursing students' experiences of PAL within the clinical practice environment. Studies that utilized designs such as phenomenology, grounded theory, ethnography, action research and feminist research were considered. Other text such as opinion papers and reports were to be considered if no qualitative studies could be located. The review excluded quantitative studies, as well as those addressing PAL outside the nursing profession and students within the nursing profession but not including undergraduate student nurses. This review considered studies that included aspects related to experiences of PAL in the clinical practice setting, as seen by undergraduate nursing students and the researcher. A three-step search strategy was undertaken to find both published and unpublished studies in English from 2003 to 2017 in various databases, and included searching of reference lists within articles selected for appraisal. Each of the included studies were assessed for methodological quality independently by two reviewers, using the Joanna Briggs Institute Critical Appraisal Form for Interpretive and Critical Research. Qualitative data was extracted using the standardized JBI qualitative data extraction tool. Qualitative research findings were synthesized using JBI methodology. From the eight included studies, 37 findings were extracted. These findings were further aggregated into seven categories, and then into three synthesized findings. These three synthesized findings are: 1) Challenges of clinical practice are mitigated by peer support; 2) Peers are role models for enhancing clinical knowledge; and 3) Support and feedback develop competence and confidence, and reduce stress and anxiety. Peer-assisted learning exists in clinical practice in both formal and informal circumstances. Friendship and community are often expressed as occurring when peers work together. Support and feedback help students develop in their clinical role and enhance clinical knowledge. Outcomes include enhancing the competency and confidence of peers, and reducing stress and anxiety. Challenges of clinical practice are mitigated through PAL.

Cooperation between referees and authors increases peer review accuracy.

PubMed

Leek, Jeffrey T; Taub, Margaret A; Pineda, Fernando J

2011-01-01

Peer review is fundamentally a cooperative process between scientists in a community who agree to review each other's work in an unbiased fashion. Peer review is the foundation for decisions concerning publication in journals, awarding of grants, and academic promotion. Here we perform a laboratory study of open and closed peer review based on an online game. We show that when reviewer behavior was made public under open review, reviewers were rewarded for refereeing and formed significantly more cooperative interactions (13% increase in cooperation, P = 0.018). We also show that referees and authors who participated in cooperative interactions had an 11% higher reviewing accuracy rate (P = 0.016). Our results suggest that increasing cooperation in the peer review process can lead to a decreased risk of reviewing errors.

How Does Student Peer Review Influence Perceptions, Engagement and Academic Outcomes? A Case Study

ERIC Educational Resources Information Center

Mulder, Raoul; Baik, Chi; Naylor, Ryan; Pearce, Jon

2014-01-01

Involving students in peer review has many pedagogical benefits, but few studies have explicitly investigated relationships between the content of peer reviews, student perceptions and assessment outcomes. We conducted a case study of peer review within a third-year undergraduate subject at a research-intensive Australian university, in which we…

Do Peer Reviews Help Improve Student Writing Abilities in an EFL High School Classroom?

ERIC Educational Resources Information Center

Kurihara, Noriko

2017-01-01

Several studies have reported the benefits of peer reviews in English as a second language (ESL) and English as a foreign language (EFL) writing classrooms. However, there has been little empirical research on whether such peer reviews improve students' writing abilities. The current study investigated the effects of peer review on the development…

Predicting Academics' Willingness to Participate in Peer Review of Teaching: A Quantitative Investigation

ERIC Educational Resources Information Center

White, Kiri; Boehm, Emilia; Chester, Andrea

2014-01-01

Peer review of teaching is a collegial process designed to help academics reflect on and improve their teaching practice. Considerable research supports the value of peer review of teaching. However, uptake of voluntary programs is typically low. Few studies have examined the predictors of engagement in voluntary peer review. This study surveyed…

LeaD-In: A Cultural Change Model for Peer Review of Teaching in Higher Education

ERIC Educational Resources Information Center

Barnard, A.; Nash, R.; McEvoy, K.; Shannon, S.; Waters, C.; Rochester, S.; Bolt, S.

2015-01-01

Peer review of teaching is recognized increasingly as one strategy for academic development even though historically peer review of teaching is often unsupported by policy, action and culture in many Australian universities. Higher education leaders report that academics generally do not engage with peer review of teaching in a systematic or…

Building Scholarly Writers: Student Perspectives on Peer Review in a Doctoral Writing Seminar

ERIC Educational Resources Information Center

Adamek, Margaret Ellen

2015-01-01

Peer review was used as a primary pedagogical tool in a scholarly writing course for social work doctoral students. To gauge student response to peer review and learning as a result of peer review, the instructor used narrative analysis to organize student comments into themes. Themes identified included initial trepidation, "no pain, no…

34 CFR 359.30 - How is peer review conducted under this program?

Code of Federal Regulations, 2010 CFR

2010-07-01

... 34 Education 2 2010-07-01 2010-07-01 false How is peer review conducted under this program? 359.30 Section 359.30 Education Regulations of the Offices of the Department of Education (Continued) OFFICE OF...? § 359.30 How is peer review conducted under this program? Peer review is conducted under this program in...

Don't Tell It Like It Is: Preserving Collegiality in the Summative Peer Review of Teaching

ERIC Educational Resources Information Center

Iqbal, Isabeau A.

2014-01-01

While much literature has considered feedback and professional growth in formative peer reviews of teaching, there has been little empirical research conducted on these issues in the context of summative peer reviews. This article explores faculty members' perceptions of feedback practices in the summative peer review of teaching and reports on…

75 FR 24568 - Notice of Intent To Seek OMB Approval To Collect Information: Revision of a Form Pertaining to...

Federal Register 2010, 2011, 2012, 2013, 2014

2010-05-05

... Peer Review of ARS Research Projects AGENCY: Agricultural Research Service (ARS), USDA. ACTION: Notice... scientific peer reviews of all research activities conducted by the USDA. The Office manages the ARS peer review system by centrally planning peer panel reviews for ARS research projects on a five-year cycle...

Students' Collaborative Peer Reviewing in an Online Writing Environment

ERIC Educational Resources Information Center

Bradley, Linda; Thouësny, Sylvie

2017-01-01

Peer review is applied as a powerful tool to enhance student collaboration online writing. The purpose of this paper is to analyse learners' mechanisms of peer reviewing in the nature of student interventions and interactions in written online peer reviewing and how categorization of student comments can be used as a means for analysing student…

Adapting Peer Review to an Online Course: An Exploratory Case Study

ERIC Educational Resources Information Center

Knight, Linda V.; Steinbach, Theresa A.

2011-01-01

With demonstrated benefits to higher level learning, peer review in the classroom has been well researched and popular since at least the 1990s. However, little or no prior studies exist into the peer review process for online courses. Further, we found no prior research specifically addressing the operational aspects of online peer review. This…

Evaluation of the Inhalation Carcinogenicity of Ethylene Oxide ...

EPA Pesticide Factsheets

EPA is seeking peer review of the scientific basis supporting the human health hazard and dose-response assessment of ethylene oxide (cancer) that will appear in the Integrated Risk Information System (IRIS) database. EPA seeks external peer review on how the Agency responded to the SAB panel recommendations, the exposure-response modeling of epidemiologic data, including new analyses since the 2007 external peer review, and on the adequacy, transparency, and clarity of the revised draft. The peer review will include an opportunity for the public to address the peer reviewers.

External Peer Review Report on the Defense Contract Management Agency Office of Independent Assessment Internal Review Team

DTIC Science & Technology

2015-11-02

External Peer Review Report on the Defense Contract Management Agency Office of Independent Assessment Internal Review Team N O V E M B E R 2 , 2 0 1 5... MANAGEMENT AGENCY SUBJECT: External Peer Review Report on the Defense Contract Management Agency Office of Independent Assessment Internal Review Team...Report No. DODIG-2016-007) Attached is the External Peer Review Report on the Defense Contract Management Agency Office of Independent Assessment

AQUATOX Peer Review Documents

EPA Pesticide Factsheets

AQUATOX Release 2 underwent an external peer review in early 2003, and Release 3 underwent an external peer review in late 2008. Reviewers stated model enhancements have made AQUATOX one of the most exciting tools in aquatic ecosystem management.

Peer Feedback in Anonymous Peer Review in an EFL Writing Class in Spain

ERIC Educational Resources Information Center

Coté, Robert A.

2014-01-01

The present study reports the results of a process of peer feedback through anonymous peer review in an EFL writing class. Numerous studies have reported on the benefits of peer review (PR) in the ESL/EFL writing classroom. However, the literature also identifies social issues that can negatively affect the outcome of face-to-face PR. In this…

Expanding Group Peer Review: A Proposal for Medical Education Scholarship.

PubMed

Dumenco, Luba; Engle, Deborah L; Goodell, Kristen; Nagler, Alisa; Ovitsh, Robin K; Whicker, Shari A

2017-02-01

After participating in a group peer-review exercise at a workshop presented by Academic Medicine and MedEdPORTAL editors at the 2015 Association of American Medical Colleges Medical Education Meeting, the authors realized that the way their work group reviewed a manuscript was very different from the way by which they each would have reviewed the paper as an individual. Further, the group peer-review process yielded more robust feedback for the manuscript's authors than did the traditional individual peer-review process. This realization motivated the authors to reconvene and collaborate to write this Commentary to share their experience and propose the expanded use of group peer review in medical education scholarship.The authors consider the benefits of a peer-review process for reviewers, including learning how to improve their own manuscripts. They suggest that the benefits of a team review model may be similar to those of teamwork and team-based learning in medicine and medical education. They call for research to investigate this, to provide evidence to support group review, and to determine whether specific paper types would benefit most from team review (e.g., particularly complex manuscripts, those receiving widely disparate initial individual reviews). In addition, the authors propose ways in which a team-based approach to peer review could be expanded by journals and institutions. They believe that exploring the use of group peer review potentially could create a new methodology for skill development in research and scholarly writing and could enhance the quality of medical education scholarship.

Online Radiology Reporting with Peer Review as a Learning and Feedback Tool in Radiology; Implementation, Validity, and Student Impressions.

PubMed

McEvoy, Fintan J; Shen, Nicholas W; Nielsen, Dorte H; Buelund, Lene E; Holm, Peter

2017-02-01

Communicating radiological reports to peers has pedagogical value. Students may be uneasy with the process due to a lack of communication and peer review skills or to their failure to see value in the process. We describe a communication exercise with peer review in an undergraduate veterinary radiology course. The computer code used to manage the course and deliver images online is reported, and we provide links to the executable files. We tested to see if undergraduate peer review of radiological reports has validity and describe student impressions of the learning process. Peer review scores for student-generated radiological reports were compared to scores obtained in the summative multiple choice (MCQ) examination for the course. Student satisfaction was measured using a bespoke questionnaire. There was a weak positive correlation (Pearson correlation coefficient = 0.32, p < 0.01) between peer review scores students received and the student scores obtained in the MCQ examination. The difference in peer review scores received by students grouped according to their level of course performance (high vs. low) was statistically significant (p < 0.05). No correlation was found between peer review scores awarded by the students and the scores they obtained in the MCQ examination (Pearson correlation coefficient = 0.17, p = 0.14). In conclusion, we have created a realistic radiology imaging exercise with readily available software. The peer review scores are valid in that to a limited degree they reflect student future performance in an examination. Students valued the process of learning to communicate radiological findings but do not fully appreciated the value of peer review.

Evaluating the Pros and Cons of Different Peer Review Policies via Simulation.

PubMed

Zhu, Jia; Fung, Gabriel; Wong, Wai Hung; Li, Zhixu; Xu, Chuanhua

2016-08-01

In the academic world, peer review is one of the major processes in evaluating a scholars contribution. In this study, we are interested in quantifying the merits of different policies in a peer review process, such as single-blind review, double-blind review, and obtaining authors feedback. Currently, insufficient work has been undertaken to evaluate the benefits of different peer review policies. One of the major reasons for this situation is the inability to conduct any empirical study because data are presently unavailable. In this case, a computer simulation is one of the best ways to conduct a study. We perform a series of simulations to study the effects of different policies on a peer review process. In this study, we focus on the peer review process of a typical computer science conference. Our results point to the crucial role of program chairs in determining the quality and diversity of the articles to be accepted for publication. We demonstrate the importance of discussion among reviewers, suggest circumstances in which the double-blind review policy should be adopted, and question the credibility of the authors feedback mechanism. Finally, we stress that randomness plays an important role in the peer review process, and this role cannot be eliminated. Although our model may not capture every component of a peer review process, it covers some of the most essential elements. Thus, even the simulation results clearly cannot be taken as literal descriptions of an actual peer review process. However, we can at least still use them to identify alternative directions for future study.

7 CFR 3400.14 - Proposal review.

Code of Federal Regulations, 2010 CFR

2010-01-01

... SERVICE, DEPARTMENT OF AGRICULTURE SPECIAL RESEARCH GRANTS PROGRAM Scientific Peer Review of Research... employees of the Department, the respective peer review group, and ad hoc reviewers, as required. Written...-depth discussions will be provided by peer review group members prior to recommending applications for...

How peer-review constrains cognition: on the frontline in the knowledge sector.

PubMed

Cowley, Stephen J

2015-01-01

Peer-review is neither reliable, fair, nor a valid basis for predicting 'impact': as quality control, peer-review is not fit for purpose. Endorsing the consensus, I offer a reframing: while a normative social process, peer-review also shapes the writing of a scientific paper. In so far as 'cognition' describes enabling conditions for flexible behavior, the practices of peer-review thus constrain knowledge-making. To pursue cognitive functions of peer-review, however, manuscripts must be seen as 'symbolizations', replicable patterns that use technologically enabled activity. On this bio-cognitive view, peer-review constrains knowledge-making by writers, editors, reviewers. Authors are prompted to recursively re-aggregate symbolizations to present what are deemed acceptable knowledge claims. How, then, can recursive re-embodiment be explored? In illustration, I sketch how the paper's own content came to be re-aggregated: agonistic review drove reformatting of argument structure, changes in rhetorical ploys and careful choice of wordings. For this reason, the paper's knowledge-claims can be traced to human activity that occurs in distributed cognitive systems. Peer-review is on the frontline in the knowledge sector in that it delimits what can count as knowing. Its systemic nature is therefore crucial to not only discipline-centered 'real' science but also its 'post-academic' counterparts.

Real-Time Peer Review: An Innovative Feature to an Evidence-Based Practice Conference

PubMed Central

Eldredge, Jonathan D.; Phillips, Holly E.; Kroth, Philip J.

2013-01-01

Many health sciences librarians as well as other professionals attend conferences on a regular basis. This study sought to link an innovative peer review process of presented research papers to long-term conference outcomes in the peer-reviewed professional journal literature. An evidence-based conference included a proof-of-concept study to gauge the long-term outcomes from research papers presented during the program. Real-time peer review recommendations from the conference were linked to final versions of articles published in the peer-reviewed literature. The real-time peer review feedback served as the basis for further mentoring to guide prospective authors toward publishing their research results. These efforts resulted in the publication of two of the four research papers in the peer-viewed literature. A third presented paper appeared in a blog because the authors wanted to disseminate their findings more quickly than through the journal literature. The presenters of the fourth paper never published their study. Real-time peer review from this study can be adapted to other professional conferences that include presented research papers. PMID:24180649

Peer Review for EPA's Biologically Based Dose-Response ...

EPA Pesticide Factsheets

EPA is developing a regulation for perchlorate in drinking water. As part the regulatory process EPA must develop a Maximum Contaminant Level Goal (MCLG). FDA and EPA scientists developed a biologically based dose-response (BBDR) model to assist in deriving the MCLG. This model is designed to determine under what conditions of iodine nutrition and exposure to perchlorate across sensitive lifestages would result in low serum free and total thyroxine (hypothyroxinemia). EPA is undertaking a peer review to provide a focused, objective independent peer evaluation of the draft model and its model results report. EPA is undertaking a peer review to provide a focused, objective independent peer evaluation of the draft model and its model results report. Peer review is an important component of the scientific process. The criticism, suggestions, and new ideas provided by the peer reviewers stimulate creative thought, strengthen the interpretation of the reviewed material, and confer credibility on the product. The peer review objective is to provide advice to EPA on steps that will yield a highly credible scientific product that is supported by the scientific community and a defensible perchlorate MCLG.

The role of sex of peers and gender-typed activities in young children's peer affiliative networks: a longitudinal analysis of selection and influence.

PubMed

Martin, Carol Lynn; Kornienko, Olga; Schaefer, David R; Hanish, Laura D; Fabes, Richard A; Goble, Priscilla

2013-01-01

A stochastic actor-based model was used to investigate the origins of sex segregation by examining how similarity in sex of peers and time spent in gender-typed activities affected affiliation network selection and how peers influenced children's (N = 292; Mage = 4.3 years) activity involvement. Gender had powerful effects on interactions through direct and indirect pathways. Children selected playmates of the same sex and with similar levels of gender-typed activities. Selection based on gender-typed activities partially mediated selection based on sex of peers. Children influenced one another's engagement in gender-typed activities. When mechanisms producing sex segregation were compared, the largest contributor was selection based on sex of peers; less was due to activity-based selection and peer influence. Implications for sex segregation and gender development are discussed. © 2012 The Authors. Child Development © 2012 Society for Research in Child Development, Inc.

Navigating manuscript assessment: The new practitioner's guide to primary literature peer review.

PubMed

Smith, Devlin V; Stokes, Laura B; Marx, Kayleigh; Aitken, Samuel L

2018-01-01

For pharmacists, the first years after graduation are spent developing their knowledge base, advancing as a practitioner, and honing their abilities as healthcare providers and drug information experts. New practitioners encounter many challenges during this time, which for many include publishing original research or reviewing manuscripts for colleagues and medical journals. Inexperience navigating the publication process, from submission to receipt of (and response to) peer review commentary, is often cited as a major barrier to timely publication of resident and new practitioner research. Serving as a peer reviewer in turn provides the new practitioner with insight on this process and can be an enlightening experience used to garner confidence in subsequently submitting their own formal manuscripts. A number of publications describing steps for peer review are available, however, many of these articles address more experienced reviewers or critique the peer review process itself. No definitive resource exists for new pharmacy practitioners interested in developing their peer review skills. The information presented in this summative guide should be used in conjunction with practice opportunities to help new practitioners develop proficiency at peer review.

Selection and Socialization Effects in Early Adolescent Alcohol Use: A Propensity Score Analysis

PubMed Central

Scalco, Matthew D.; Trucco, Elisa M.; Coffman, Donna L.; Colder, Craig R.

2015-01-01

The robust correlation between peer and adolescent alcohol use (AU) has been taken as evidence for both socialization and selection processes in the etiology of adolescent AU. Accumulating evidence from studies using a diverse range of methodological and statistical approaches suggests that both processes are involved. A major challenge in testing whether peer AU predicts an adolescent's drinking (socialization) or whether an adolescent's drinking predicts peer AU (selection) is the myriad of potentially confounding factors that might lead to an overestimation of socialization and selection effects. After creating AU transition groups based on peer and adolescent AU across two waves (N = 765; age = 10-15; 53% female), we test whether transitions into AU by adolescents and peers predict later peer and adolescent AU respectively, using (1) propensity score analysis to balance transition groups on 26 potential confounds, (2) a longitudinal design with three waves to establish temporal precedence, and (3) both adolescent (target) and peer self-report of peer AU to disentangle effects attributable to shared reporter bias. Both selection and socialization were supported using both peer self-report of AU and adolescent-report of peer AU. Although cross-sectional analyses suggested peer self-reported models were associated with smaller effects than perceived peer AU, longitudinal analyses suggest a similar sized effect across reporter of peer AU for both selection and socialization. The implications of these findings for the etiology and treatment of adolescent AU are discussed. PMID:25601099

The effect of peer review on mortality rates.

PubMed

Krahwinkel, W; Schuler, E; Liebetrau, M; Meier-Hellmann, A; Zacher, J; Kuhlen, R

2016-10-01

Lowering of mortality rates in hospitals with mortality rates higher than accepted reference values for acute myocardial infarction (AMI), congestive heart failure (CHF), pneumonia, stroke, mechanical ventilation (MV) and colorectal surgery by using an external peer review process that identifies areas requiring rectification and implements protocols directed at improving these areas. Retrospective, observational, quality management study using administrative data to compare in-hospital mortality rates (pre and post an external peer review process that included adoption of improvement protocols) with reference values. German general hospitals of a large, private group. Hospitals with mortality rates higher than reference values. Peer review of medical records by experienced, outside physicians triggered by in-hospital mortality rates higher than expected. Inadequacies were identified, improvement protocols enforced and mortality rates subsequently re-examined. Mortality rates 1 year before and 1 year after peer review and protocol use. For AMI, CHF, pneumonia, stroke, MV and colorectal surgery, the mortality rates 1 year post-peer review were significantly decreased as compared to pre-peer review mortality rates. The standardized mortality ratio for all of the above diagnoses was 1.45, 1 year before peer review, and 0.97, 1 year after peer review. The absolute risk reduction of 7.3% translates into 710 deaths in this population which could have been prevented. Peer review triggered and conducted in the manner described here is associated with a significant lowering of in-hospital mortality rates in hospitals that previously had higher than expected mortality rates. © The Author 2016. Published by Oxford University Press in association with the International Society for Quality in Health Care.

77 FR 19126 - Defense Federal Acquisition Regulation Supplement: New Threshold for Peer Reviews of...

Federal Register 2010, 2011, 2012, 2013, 2014

2012-03-30

... Federal Acquisition Regulation Supplement: New Threshold for Peer Reviews of Noncompetitive Contracts... Regulation Supplement (DFARS) to modify the threshold for noncompetitive contract peer reviews. DATES...-6088. SUPPLEMENTARY INFORMATION: I. Background This final rule reduces the threshold for DoD peer...

The Global Burden of Journal Peer Review in the Biomedical Literature: Strong Imbalance in the Collective Enterprise.

PubMed

Kovanis, Michail; Porcher, Raphaël; Ravaud, Philippe; Trinquart, Ludovic

2016-01-01

The growth in scientific production may threaten the capacity for the scientific community to handle the ever-increasing demand for peer review of scientific publications. There is little evidence regarding the sustainability of the peer-review system and how the scientific community copes with the burden it poses. We used mathematical modeling to estimate the overall quantitative annual demand for peer review and the supply in biomedical research. The modeling was informed by empirical data from various sources in the biomedical domain, including all articles indexed at MEDLINE. We found that for 2015, across a range of scenarios, the supply exceeded by 15% to 249% the demand for reviewers and reviews. However, 20% of the researchers performed 69% to 94% of the reviews. Among researchers actually contributing to peer review, 70% dedicated 1% or less of their research work-time to peer review while 5% dedicated 13% or more of it. An estimated 63.4 million hours were devoted to peer review in 2015, among which 18.9 million hours were provided by the top 5% contributing reviewers. Our results support that the system is sustainable in terms of volume but emphasizes a considerable imbalance in the distribution of the peer-review effort across the scientific community. Finally, various individual interactions between authors, editors and reviewers may reduce to some extent the number of reviewers who are available to editors at any point.

The Global Burden of Journal Peer Review in the Biomedical Literature: Strong Imbalance in the Collective Enterprise

PubMed Central

Porcher, Raphaël; Ravaud, Philippe; Trinquart, Ludovic

2016-01-01

The growth in scientific production may threaten the capacity for the scientific community to handle the ever-increasing demand for peer review of scientific publications. There is little evidence regarding the sustainability of the peer-review system and how the scientific community copes with the burden it poses. We used mathematical modeling to estimate the overall quantitative annual demand for peer review and the supply in biomedical research. The modeling was informed by empirical data from various sources in the biomedical domain, including all articles indexed at MEDLINE. We found that for 2015, across a range of scenarios, the supply exceeded by 15% to 249% the demand for reviewers and reviews. However, 20% of the researchers performed 69% to 94% of the reviews. Among researchers actually contributing to peer review, 70% dedicated 1% or less of their research work-time to peer review while 5% dedicated 13% or more of it. An estimated 63.4 million hours were devoted to peer review in 2015, among which 18.9 million hours were provided by the top 5% contributing reviewers. Our results support that the system is sustainable in terms of volume but emphasizes a considerable imbalance in the distribution of the peer-review effort across the scientific community. Finally, various individual interactions between authors, editors and reviewers may reduce to some extent the number of reviewers who are available to editors at any point. PMID:27832157

Gender bias in scholarly peer review

PubMed Central

Helmer, Markus; Schottdorf, Manuel; Neef, Andreas; Battaglia, Demian

2017-01-01

Peer review is the cornerstone of scholarly publishing and it is essential that peer reviewers are appointed on the basis of their expertise alone. However, it is difficult to check for any bias in the peer-review process because the identity of peer reviewers generally remains confidential. Here, using public information about the identities of 9000 editors and 43000 reviewers from the Frontiers series of journals, we show that women are underrepresented in the peer-review process, that editors of both genders operate with substantial same-gender preference (homophily), and that the mechanisms of this homophily are gender-dependent. We also show that homophily will persist even if numerical parity between genders is reached, highlighting the need for increased efforts to combat subtler forms of gender bias in scholarly publishing. DOI: http://dx.doi.org/10.7554/eLife.21718.001 PMID:28322725

Quality assurance in radiology: peer review and peer feedback.

PubMed

Strickland, N H

2015-11-01

Peer review in radiology means an assessment of the accuracy of a report issued by another radiologist. Inevitably, this involves a judgement opinion from the reviewing radiologist. Peer feedback is the means by which any form of peer review is communicated back to the original author of the report. This article defines terms, discusses the current status, identifies problems, and provides some recommendations as to the way forward, concentrating upon the software requirements for efficient peer review and peer feedback of reported imaging studies. Radiologists undertake routine peer review in their everyday clinical practice, particularly when reporting and preparing for multidisciplinary team meetings. More formal peer review of reported imaging studies has been advocated as a quality assurance measure to promote good clinical practice. It is also a way of assessing the competency of reporting radiologists referred for investigation to bodies such as the General Medical Council (GMC). The literature shows, firstly, that there is a very wide reported range of discrepancy rates in many studies, which have used a variety of non-comparable methodologies; and secondly, that applying scoring systems in formal peer review is often meaningless, unhelpful, and can even be detrimental. There is currently a lack of electronic peer feedback system software on the market to inform radiologists of any review of their work that has occurred or to provide them with clinical outcome information on cases they have previously reported. Learning opportunities are therefore missed. Radiologists should actively engage with the medical informatics industry to design optimal peer review and feedback software with features to meet their needs. Such a system should be easy to use, be fully integrated with the radiological information and picture archiving systems used clinically, and contain a free-text comment box, without a numerical scoring system. It should form a temporary record that cannot be permanently archived. It must provide automated feedback to the original author. Peer feedback, as part of everyday reporting, should enhance daily learning for radiologists. Software requirements for everyday peer feedback differ from those needed for a formal peer review process, which might only be necessary in the setting of a formal GMC enquiry into a particular radiologist's reporting competence, for example. Copyright © 2015 The Royal College of Radiologists. Published by Elsevier Ltd. All rights reserved.

Doing Peer Review: Reflections from an International Group of Postdoctoral Fellows

ERIC Educational Resources Information Center

Merry, Lisa; Jarvis, Kimberly; Kupoluyi, Joseph; Lual, Jomama One Jomama

2017-01-01

There is very little written regarding developing the skills of doing peer reviews. In this piece we use our own experience as postdoctoral fellows to offer our reflections on how to get the most out of doing peer reviews as a trainee researcher. We touch upon the variety and complexity of peer reviews, the debates concerning the nature and…

A proposal for an 'equal peer-review' statement.

PubMed

Moustafa, Khaled

2015-08-01

To make the peer-review process as objective as possible, I suggest the introduction of an 'equal peer-review' statement that preserves author anonymity across the board, thus removing any potential bias related to nominal or institutional 'prestige'; this would guarantee an equal peer-review process for all authors and grant applicants. Copyright © 2015 Elsevier Ltd. All rights reserved.

Peer Review in Class: Metrics and Variations in a Senior Course

ERIC Educational Resources Information Center

Yankulov, Krassimir; Couto, Richard

2012-01-01

Peer reviews are the generally accepted mode of quality assessment in scholarly communities; however, they are rarely used for evaluation at college levels. Over a period of 5 years, we have performed a peer review simulation at a senior level course in molecular genetics at the University of Guelph and have accumulated 393 student peer reviews.…

Love Canal Emergency Declaration Area habitability study. Volume 5. Peer review summary: TRC (Technical Review Committee) responses. Final report

DOE Office of Scientific and Technical Information (OSTI.GOV)

Not Available

Environmental studies were conducted to provide data that could be used by the Commissioner of Health for the State of New York in determining whether the Emergency Declaration Area surrounding the Love Canal hazardous-waste site is habitable. These volumes (II through IV) were reviewed by a peer-review panel of expert scientists. The scientists concluded that each of the three environmental studies was well planned and well executed. Volume V summarizes the peer review and gives additional information or clarifications as requested during the peer review. Volume V also provides additional supplemental statistical analyses requested by the peer reviewer panel.

48 CFR 970.5217-1 - Work for Others Program.

Code of Federal Regulations, 2011 CFR

2011-10-01

... another Federal agency or non-Federal organization that involves direct comparative competition, either as... selection is based on merit or peer review, the work involves basic or applied research to further advance scientific knowledge or understanding, and a response does not result in direct, comparative competition; (3...

48 CFR 970.5217-1 - Work for Others Program.

Code of Federal Regulations, 2012 CFR

2012-10-01

... another Federal agency or non-Federal organization that involves direct comparative competition, either as... selection is based on merit or peer review, the work involves basic or applied research to further advance scientific knowledge or understanding, and a response does not result in direct, comparative competition; (3...

48 CFR 970.5217-1 - Work for Others Program.

Code of Federal Regulations, 2014 CFR

2014-10-01

... another Federal agency or non-Federal organization that involves direct comparative competition, either as... selection is based on merit or peer review, the work involves basic or applied research to further advance scientific knowledge or understanding, and a response does not result in direct, comparative competition; (3...

48 CFR 970.5217-1 - Work for Others Program.

Code of Federal Regulations, 2013 CFR

2013-10-01

... another Federal agency or non-Federal organization that involves direct comparative competition, either as... selection is based on merit or peer review, the work involves basic or applied research to further advance scientific knowledge or understanding, and a response does not result in direct, comparative competition; (3...

75 FR 43172 - Maternal, Infant, and Early Childhood Home Visiting Program

Federal Register 2010, 2011, 2012, 2013, 2014

2010-07-23

... the evaluation results have been published in a peer-reviewed journal; or (bb) quasi-experimental... design (i.e. randomized controlled trial [RCT] or quasi-experimental design [QED]), level of attrition... a quasi-experimental design as a study design in which sample members are selected for the program...

48 CFR 970.5217-1 - Work for Others Program.

Code of Federal Regulations, 2010 CFR

2010-10-01

... selection is based on merit or peer review, the work involves basic or applied research to further advance... all Work for Others projects in accordance with the standards, policies, and procedures that apply to..., safeguards and classification procedures, and human and animal research regulations; (8) May subcontract...

Innovative Language Teaching and Learning at University: Enhancing Employability

ERIC Educational Resources Information Center

Álvarez-Mayo, Carmen, Ed.; Gallagher-Brett, Angela, Ed.; Michel, Franck, Ed.

2017-01-01

This second volume in this series of papers dedicated to innovative language teaching and learning at university focuses on enhancing employability. Throughout the book, which includes a selection of 14 peer-reviewed and edited short papers, authors share good practices drawing on research; reflect on their experience to promote student…

Trends and Dangers of Increased Bureaucracy in Higher Education: A View from Below.

ERIC Educational Resources Information Center

Daalder, Hans

1985-01-01

Several trends in European university administration intended to improve higher education are cited as causes for concern: trends away from academic and toward corporate style administration, toward separate research institutions, away from competitive selection for academics, toward peer review, and toward increased diversity among institutions.…

Teaching Business Ethics in the Global South: Control, Resistance, and Phronesis

ERIC Educational Resources Information Center

Karam, Charlotte M.; Sidani, Yusuf M.; Showail, Sammy

2015-01-01

We explore academic literature on business ethics education and critically compare the themes emerging from different contexts. Outlining guidelines for analysis based on Southern Theory, we conduct a content analysis on a selection of English, peer-reviewed articles and then critically compare emergent themes from across the…

A randomised trial of peer review: the UK National Chronic Obstructive Pulmonary Disease Resources and Outcomes Project.

PubMed

Roberts, C M; Stone, R A; Buckingham, R J; Pursey, N A; Harrison, B D W; Lowe, D; Potter, J M

2010-06-01

Peer review has been widely employed within the NHS to facilitate health quality improvement but has not been rigorously evaluated. This article reports the largest randomised trial of peer review ever conducted in the UK. The peer review intervention was a reciprocal supportive exercise that included clinicians, hospital management, commissioners and patients which focused on the quality of the provision of four specific evidence-based aspects of chronic obstructive pulmonary disease care. Follow up at 12 months demonstrated few quantitative differences in the number or quality of services offered in the two groups. Qualitative data in contrast suggested many benefits of peer review in most but not all intervention units and some control teams. Findings suggest peer review in this format is a positive experience for most participants but is ineffective in some situations. Its longer term benefits and cost effectiveness require further study. The generic findings of this study have potential implications for the application of peer review throughout the NHS.

Adding value to the learning process by online peer review activities: towards the elaboration of a methodology to promote critical thinking in future engineers

NASA Astrophysics Data System (ADS)

Dominguez, Caroline; Nascimento, Maria M.; Payan-Carreira, Rita; Cruz, Gonçalo; Silva, Helena; Lopes, José; Morais, Maria da Felicidade A.; Morais, Eva

2015-09-01

Considering the results of research on the benefits and difficulties of peer review, this paper describes how teaching faculty, interested in endorsing the acquisition of communication and critical thinking (CT) skills among engineering students, has been implementing a learning methodology throughout online peer review activities. While introducing a new methodology, it is important to weight the advantages found and the conditions that might have restrained the activity outcomes, thereby modulating its overall efficiency. Our results show that several factors are decisive for the success of the methodology: the use of specific and detailed orientation guidelines for CT skills, the students' training on how to deliver a meaningful feedback, the opportunity to counter-argument, the selection of good assignments' examples, and the constant teacher's monitoring of the activity. Results also tackle other aspects of the methodology such as the thinking skills evaluation tools (grades and tests) that most suit our reality. An improved methodology is proposed taking in account the encountered limitations, thus offering the possibility to other interested institutions to use/test and/or improve it.

Mentored peer reviewing for PhD faculty and students.

PubMed

Xu, Jiayun; Kim, Kyounghae; Kurtz, Melissa; Nolan, Marie T

2016-02-01

There is a need for scholars to be prepared as peer reviewers in order to ensure the continual publication of quality science. However, developing the skills to craft a constructive critique can be difficult. In this commentary, we discuss the use of a group peer review mentoring model for PhD students to gain experience in peer review from a faculty member who is experienced in peer review. Central to this model, was the opportunity for each student and faculty mentor to openly discuss their critique of the manuscript. Through this enriching experience, novice researchers were able to learn the elements of a good peer review, better determine a manuscript's substantive contribution to science, and advance the quality of their own manuscript writing. Copyright © 2015 Elsevier Ltd. All rights reserved.

The interaction between the DRD4 VNTR polymorphism and perceived peer drinking norms in adolescent alcohol use and misuse

PubMed Central

Park, Aesoon; Kim, Jueun; Zaso, Michelle J.; Glatt, Stephen J.; Sher, Kenneth J.; Scott-Sheldon, Lori A. J.; Eckert, Tanya L.; Vanable, Peter A.; Carey, Kate B.; Ewart, Craig K.; Carey, Michael P.

2015-01-01

Peer drinking norms are arguably one of the strongest correlates of adolescent drinking. Prospective studies indicate that adolescents tend to select peers based on drinking (peer-selection) and their peers’ drinking is associated with changes in adolescent drinking over time (peer socialization). The present study investigated whether the peer selection and socialization processes in adolescent drinking differed as a function of the DRD4 VNTR genotype in two independent prospective datasets. The first sample was 174 high school students drawn from a 2-wave 6-month prospective study. The second sample was 237 college students drawn from a 3-wave annual prospective study. Multigroup cross-lagged panel analyses of the high school student sample indicated stronger socialization via peer drinking norms among carriers, whereas analyses of the college student sample indicated stronger drinking-based peer selection in the junior year among carriers, compared to non-carriers. Although replication and meta-analytic synthesis are needed, these findings suggest in part genetically determined peer-selection (carriers of the DRD4 7-repeat allele tend to associate with peers who have more favorable attitudes toward drinking and greater alcohol use) and peer socialization (carriers’ subsequent drinking behaviors are more strongly associated with their peer drinking norms) may differ across adolescent developmental stages. PMID:26902782

Improving the peer review skills of young rheumatologists and researchers in rheumatology: the EMEUNET Peer Review Mentoring Program.

PubMed

Rodríguez-Carrio, Javier; Putrik, Polina; Sepriano, Alexandre; Moltó, Anna; Nikiphorou, Elena; Gossec, Laure; Kvien, Tore K; Ramiro, Sofia

2018-01-01

Although peer review plays a central role in the maintenance of high standards in scientific research, training of reviewing skills is not included in the common education programmes. The Emerging EULAR (European League Against Rheumatism) Network (EMEUNET) developed a programme to address this unmet need. The EMEUNET Peer Review Mentoring Program for Rheumatology Journals promotes a systematic training of reviewing skills by engaging mentees in a 'real world' peer review experience supervised by experienced mentors with support from rheumatology journals. This viewpoint provides an overview of this initiative and its outcomes, and discusses its potential limitations. Over 4 years, 18 mentors and 86 mentees have participated. Among the 33 participants who have completed the programme, 13 (39.3%) have become independent reviewers for Annals of the Rheumatic Diseases after the training. This programme has been recently evaluated by a survey and qualitative interviews, revealing a high interest in this initiative. The main strengths (involvement of a top journal and learning opportunities) and weaknesses of the programme (limited number of places and insufficient dissemination) were identified. Overall, this programme represents an innovative and successful approach to peer review training. Continuous evaluation and improvement are key to its functioning. The EMEUNET Peer Review Mentoring Program may be used as a reference for peer review training in areas outside rheumatology.

The effects of an editor serving as one of the reviewers during the peer-review process.

PubMed

Giordan, Marco; Csikasz-Nagy, Attila; Collings, Andrew M; Vaggi, Federico

2016-01-01

Background Publishing in scientific journals is one of the most important ways in which scientists disseminate research to their peers and to the wider public. Pre-publication peer review underpins this process, but peer review is subject to various criticisms and is under pressure from growth in the number of scientific publications. Methods Here we examine an element of the editorial process at eLife , in which the Reviewing Editor usually serves as one of the referees, to see what effect this has on decision times, decision type, and the number of citations. We analysed a dataset of 8,905 research submissions to eLife since June 2012, of which 2,747 were sent for peer review. This subset of 2747 papers was then analysed in detail.   Results The Reviewing Editor serving as one of the peer reviewers results in faster decision times on average, with the time to final decision ten days faster for accepted submissions (n=1,405) and five days faster for papers that were rejected after peer review (n=1,099). Moreover, editors acting as reviewers had no effect on whether submissions were accepted or rejected, and a very small (but significant) effect on citation rates. Conclusions An important aspect of eLife 's peer-review process is shown to be effective, given that decision times are faster when the Reviewing Editor serves as a reviewer. Other journals hoping to improve decision times could consider adopting a similar approach.

Significant publications on infectious diseases pharmacotherapy in 2014.

PubMed

Phe, Kady; Cadle, Richard M; Guervil, David J; Guzman, Oscar E; Lockwood, Ashley M; Perez, Katherine K; Vuong, Nancy N; Aitken, Samuel L

2015-08-15

The most important articles on infectious diseases (ID) pharmacotherapy published in the peer-reviewed literature in 2014, as nominated and selected by panels of pharmacists and others with ID expertise, are summarized. Members of the Houston Infectious Diseases Network were asked to nominate articles published in 2014 from prominent peer-reviewed journals that were felt to have a major impact in the field of ID pharmacotherapy. A list of 19 nominated articles on general ID-related topics and 9 articles specifically related to human immunodeficiency virus (HIV) infection or acquired immunodeficiency syndrome (AIDS) was compiled. In a national online survey, members of the Society of Infectious Diseases Pharmacists (SIDP) were asked to select from the list 10 general ID articles believed to have made a significant contribution to the field of ID pharmacotherapy and 1 article contributing to HIV/AIDS pharmacotherapy. Of the 291 SIDP members surveyed, 134 (46%) and 56 (19%) participated in the selection of general ID-related articles and HIV/AIDS-related articles, respectively. The 11 highest-ranked papers (10 general ID-related articles, 1 HIV/AIDS-related article) are summarized here. With the vast number of articles published each year, it is difficult to remain up-to-date on current, significant ID pharmacotherapy publications. This review of significant publications in 2014 may be helpful by lessening this burden. Copyright © 2015 by the American Society of Health-System Pharmacists, Inc. All rights reserved.

Evaluation of the Inhalation Carcinogenicity of Ethylene Oxide ...

EPA Pesticide Factsheets

EPA is initiating a public comment period prior to peer review of the scientific basis supporting the human health hazard and dose-response assessment of ethylene oxide (cancer) that will appear in the Integrated Risk Information System (IRIS) database. EPA seeks external peer review on how the Agency responded to the SAB panel recommendations, the exposure-response modeling of epidemiologic data, including new analyses since the 2007 external peer review, and on the adequacy, transparency, and clarity of the revised draft. The peer review will include an opportunity for the public to address the peer reviewers.

What is open peer review? A systematic review

PubMed Central

Ross-Hellauer, Tony

2017-01-01

Background: “Open peer review” (OPR), despite being a major pillar of Open Science, has neither a standardized definition nor an agreed schema of its features and implementations. The literature reflects this, with numerous overlapping and contradictory definitions. While for some the term refers to peer review where the identities of both author and reviewer are disclosed to each other, for others it signifies systems where reviewer reports are published alongside articles. For others it signifies both of these conditions, and for yet others it describes systems where not only “invited experts” are able to comment. For still others, it includes a variety of combinations of these and other novel methods. Methods: Recognising the absence of a consensus view on what open peer review is, this article undertakes a systematic review of definitions of “open peer review” or “open review”, to create a corpus of 122 definitions. These definitions are systematically analysed to build a coherent typology of the various innovations in peer review signified by the term, and hence provide the precise technical definition currently lacking. Results: This quantifiable data yields rich information on the range and extent of differing definitions over time and by broad subject area. Quantifying definitions in this way allows us to accurately portray exactly how ambiguously the phrase “open peer review” has been used thus far, for the literature offers 22 distinct configurations of seven traits, effectively meaning that there are 22 different definitions of OPR in the literature reviewed. Conclusions: I propose a pragmatic definition of open peer review as an umbrella term for a number of overlapping ways that peer review models can be adapted in line with the aims of Open Science, including making reviewer and author identities open, publishing review reports and enabling greater participation in the peer review process. PMID:28580134

Testing the Effects of Peer Socialization versus Selection on Alcohol and Marijuana Use among Treated Adolescents

PubMed Central

Becker, Sara J.; Curry, John F.

2014-01-01

This study examined the relative influence of peer socialization and selection on alcohol and marijuana use among 106 adolescents who received a brief intervention. Adolescents were recruited between 2003 and 2007 and followed for 12 months as part of a SAMHSA-funded study. Cross-lagged panel models using four assessment points examined the longitudinal relationship between adolescent substance use and peer substance involvement separately for alcohol and marijuana. Consistent with community studies, there was evidence of both peer socialization and peer selection for alcohol use, and only evidence of peer selection for marijuana use. Implications for research and intervention are discussed. PMID:23965039

45 CFR 1388.9 - Peer review.

Code of Federal Regulations, 2014 CFR

2014-10-01

... PROGRAM THE UNIVERSITY AFFILIATED PROGRAMS § 1388.9 Peer review. (a) The purpose of the peer review..., including on-site visits or inspections as necessary. (b) Applications for funding opportunities under part...

45 CFR 1388.9 - Peer review.

Code of Federal Regulations, 2013 CFR

2013-10-01

... PROGRAM THE UNIVERSITY AFFILIATED PROGRAMS § 1388.9 Peer review. (a) The purpose of the peer review..., including on-site visits or inspections as necessary. (b) Applications for funding opportunities under part...

45 CFR 1388.9 - Peer review.

Code of Federal Regulations, 2011 CFR

2011-10-01

... PROGRAM THE UNIVERSITY AFFILIATED PROGRAMS § 1388.9 Peer review. (a) The purpose of the peer review..., including on-site visits or inspections as necessary. (b) Applications for funding opportunities under part...

45 CFR 1388.9 - Peer review.

Code of Federal Regulations, 2012 CFR

2012-10-01

... PROGRAM THE UNIVERSITY AFFILIATED PROGRAMS § 1388.9 Peer review. (a) The purpose of the peer review..., including on-site visits or inspections as necessary. (b) Applications for funding opportunities under part...

How peer-review constrains cognition: on the frontline in the knowledge sector

PubMed Central

Cowley, Stephen J.

2015-01-01

Peer-review is neither reliable, fair, nor a valid basis for predicting ‘impact’: as quality control, peer-review is not fit for purpose. Endorsing the consensus, I offer a reframing: while a normative social process, peer-review also shapes the writing of a scientific paper. In so far as ‘cognition’ describes enabling conditions for flexible behavior, the practices of peer-review thus constrain knowledge-making. To pursue cognitive functions of peer-review, however, manuscripts must be seen as ‘symbolizations’, replicable patterns that use technologically enabled activity. On this bio-cognitive view, peer-review constrains knowledge-making by writers, editors, reviewers. Authors are prompted to recursively re-aggregate symbolizations to present what are deemed acceptable knowledge claims. How, then, can recursive re-embodiment be explored? In illustration, I sketch how the paper’s own content came to be re-aggregated: agonistic review drove reformatting of argument structure, changes in rhetorical ploys and careful choice of wordings. For this reason, the paper’s knowledge-claims can be traced to human activity that occurs in distributed cognitive systems. Peer-review is on the frontline in the knowledge sector in that it delimits what can count as knowing. Its systemic nature is therefore crucial to not only discipline-centered ‘real’ science but also its ‘post-academic’ counterparts. PMID:26579064

Development of a peer-review framework for cancer multidisciplinary meetings.

PubMed

Johnson, Claire E; Slavova-Azmanova, Neli; Saunders, Christobel

2017-05-01

There is no mechanism in place for monitoring or quality improvement of cancer multidisciplinary meetings (MDM) in Australia. To develop a peer-review process for quality improvement of MDM. This project involved three phases: (i) development of a draft peer-review framework, supporting documents and peer-review process; (ii) consultation with key stakeholders; (iii) refinement of the framework, documents and processes following a pilot study with three MDM. Feedback indicated that specific standards included in the framework needed to allow the peer reviewers to be flexible relative to the circumstances of the individual MDM. Conversely, feedback identified the need for clear, evidence-based clinical practice guidelines for the conduct of MDM, with accepted standards and objective measures of performance. MDM members were divided about the need to employ peer reviewers from the tumour stream of the MDM under review but agreed that closer involvement of the team under review to support the implementation of recommendations is warranted. We developed an adaptable peer-review framework and process using the current available evidence and guidance. While further research is needed to establish what constitutes best practice in MDM and which processes contribute to improved patient outcomes, the structured peer-review process we describe, when modified using the disease-relevant evidence, could be utilised more broadly as a quality improvement tool. © 2017 Royal Australasian College of Physicians.

Journal peer review: a bar or bridge? An analysis of a paper's revision history and turnaround time, and the effect on citation.

PubMed

Rigby, J; Cox, D; Julian, K

2018-01-01

Journal peer review lies at the heart of academic quality control. This article explores the journal peer review process and seeks to examine how the reviewing process might itself contribute to papers, leading them to be more highly cited and to achieve greater recognition. Our work builds on previous observations and views expressed in the literature about (a) the role of actors involved in the research and publication process that suggest that peer review is inherent in the research process and (b) on the contribution reviewers themselves might make to the content and increased citation of papers. Using data from the journal peer review process of a single journal in the Social Sciences field (Business, Management and Accounting), we examine the effects of peer review on papers submitted to that journal including the effect upon citation, a novel step in the study of the outcome of peer review. Our detailed analysis suggests, contrary to initial assumptions, that it is not the time taken to revise papers but the actual number of revisions that leads to greater recognition for papers in terms of citation impact. Our study provides evidence, albeit limited to the case of a single journal, that the peer review process may constitute a form of knowledge production and is not the simple correction of errors contained in submitted papers.

A multi-disciplinary perspective on emergent and future innovations in peer review

PubMed Central

Tennant, Jonathan P.; Dugan, Jonathan M.; Graziotin, Daniel; Jacques, Damien C.; Waldner, François; Mietchen, Daniel; Elkhatib, Yehia; B. Collister, Lauren; Pikas, Christina K.; Crick, Tom; Masuzzo, Paola; Caravaggi, Anthony; Berg, Devin R.; Niemeyer, Kyle E.; Ross-Hellauer, Tony; Mannheimer, Sara; Rigling, Lillian; Katz, Daniel S.; Greshake Tzovaras, Bastian; Pacheco-Mendoza, Josmel; Fatima, Nazeefa; Poblet, Marta; Isaakidis, Marios; Irawan, Dasapta Erwin; Renaut, Sébastien; Madan, Christopher R.; Matthias, Lisa; Nørgaard Kjær, Jesper; O'Donnell, Daniel Paul; Neylon, Cameron; Kearns, Sarah; Selvaraju, Manojkumar; Colomb, Julien

2017-01-01

Peer review of research articles is a core part of our scholarly communication system. In spite of its importance, the status and purpose of peer review is often contested. What is its role in our modern digital research and communications infrastructure? Does it perform to the high standards with which it is generally regarded? Studies of peer review have shown that it is prone to bias and abuse in numerous dimensions, frequently unreliable, and can fail to detect even fraudulent research. With the advent of web technologies, we are now witnessing a phase of innovation and experimentation in our approaches to peer review. These developments prompted us to examine emerging models of peer review from a range of disciplines and venues, and to ask how they might address some of the issues with our current systems of peer review. We examine the functionality of a range of social Web platforms, and compare these with the traits underlying a viable peer review system: quality control, quantified performance metrics as engagement incentives, and certification and reputation. Ideally, any new systems will demonstrate that they out-perform and reduce the biases of existing models as much as possible. We conclude that there is considerable scope for new peer review initiatives to be developed, each with their own potential issues and advantages. We also propose a novel hybrid platform model that could, at least partially, resolve many of the socio-technical issues associated with peer review, and potentially disrupt the entire scholarly communication system. Success for any such development relies on reaching a critical threshold of research community engagement with both the process and the platform, and therefore cannot be achieved without a significant change of incentives in research environments. PMID:29188015

A multi-disciplinary perspective on emergent and future innovations in peer review.

PubMed

Tennant, Jonathan P; Dugan, Jonathan M; Graziotin, Daniel; Jacques, Damien C; Waldner, François; Mietchen, Daniel; Elkhatib, Yehia; B Collister, Lauren; Pikas, Christina K; Crick, Tom; Masuzzo, Paola; Caravaggi, Anthony; Berg, Devin R; Niemeyer, Kyle E; Ross-Hellauer, Tony; Mannheimer, Sara; Rigling, Lillian; Katz, Daniel S; Greshake Tzovaras, Bastian; Pacheco-Mendoza, Josmel; Fatima, Nazeefa; Poblet, Marta; Isaakidis, Marios; Irawan, Dasapta Erwin; Renaut, Sébastien; Madan, Christopher R; Matthias, Lisa; Nørgaard Kjær, Jesper; O'Donnell, Daniel Paul; Neylon, Cameron; Kearns, Sarah; Selvaraju, Manojkumar; Colomb, Julien

2017-01-01

Peer review of research articles is a core part of our scholarly communication system. In spite of its importance, the status and purpose of peer review is often contested. What is its role in our modern digital research and communications infrastructure? Does it perform to the high standards with which it is generally regarded? Studies of peer review have shown that it is prone to bias and abuse in numerous dimensions, frequently unreliable, and can fail to detect even fraudulent research. With the advent of web technologies, we are now witnessing a phase of innovation and experimentation in our approaches to peer review. These developments prompted us to examine emerging models of peer review from a range of disciplines and venues, and to ask how they might address some of the issues with our current systems of peer review. We examine the functionality of a range of social Web platforms, and compare these with the traits underlying a viable peer review system: quality control, quantified performance metrics as engagement incentives, and certification and reputation. Ideally, any new systems will demonstrate that they out-perform and reduce the biases of existing models as much as possible. We conclude that there is considerable scope for new peer review initiatives to be developed, each with their own potential issues and advantages. We also propose a novel hybrid platform model that could, at least partially, resolve many of the socio-technical issues associated with peer review, and potentially disrupt the entire scholarly communication system. Success for any such development relies on reaching a critical threshold of research community engagement with both the process and the platform, and therefore cannot be achieved without a significant change of incentives in research environments.

Peer Review: Promoting Efficient School District Operations

ERIC Educational Resources Information Center

Hale, Jason S.

2010-01-01

Many professions recognize the benefits of peer reviews to assess processes and operations because peers can more easily identify one another's inefficiencies and provide some kind of intervention. Generally, the goal of the peer review process is to verify whether the work satisfies the standards set by the industry. A number of states have begun…

Using Calibrated Peer Review to Teach Basic Research Skills

ERIC Educational Resources Information Center

Bracke, Marianne S.; Graveel, John G.

2014-01-01

Calibrated Peer Review (CPR) is an online tool being used in the class Introduction to Agriculture and Purdue University (AGR 10100) to integrate a writing and research component (http://cpr.molsci.ucla.edu/Home.aspx). Calibrated Peer Review combines the ability to create writing intensive assignments with an introduction to the peer-review…

Acknowledging Students' Collaborations through Peer Review: A Footnoting Practice

ERIC Educational Resources Information Center

Poe, Shelli M.; Gravett, Emily O.

2016-01-01

Student-to-student peer review or peer feedback is commonly used in student-centered or active-learning classrooms. In this article, we describe a footnoting exercise that we implemented in two of our undergraduate courses as one way to encourage students to acknowledge collaborations and contributions made during peer-review processes. This…

A Method for Improving the Integrity of Peer Review.

PubMed

Dadkhah, Mehdi; Kahani, Mohsen; Borchardt, Glenn

2017-08-15

Peer review is the most important aspect of reputable journals. Without it, we would be unsure about whether the material published was as valid and reliable as is possible. However, with the advent of the Internet, scientific literature has now become subject to a relatively new phenomenon: fake peer reviews. Some dishonest researchers have been manipulating the peer review process to publish what are often inferior papers. There are even papers that explain how to do it. This paper discusses one of those methods and how editors can defeat it by using a special review ID. This method is easy to understand and can be added to current peer review systems easily.

Building the informatics infrastructure for comparative effectiveness research (CER): a review of the literature.

PubMed

Lopez, Marianne Hamilton; Holve, Erin; Sarkar, Indra Neil; Segal, Courtney

2012-07-01

Technological advances in clinical informatics have made large amounts of data accessible and potentially useful for research. As a result, a burgeoning literature addresses efforts to bridge the fields of health services research and biomedical informatics. The Electronic Data Methods Forum review examines peer-reviewed literature at the intersection of comparative effectiveness research and clinical informatics. The authors are specifically interested in characterizing this literature and identifying cross-cutting themes and gaps in the literature. A 3-step systematic literature search was conducted, including a structured search of PubMed, manual reviews of articles from selected publication lists, and manual reviews of research activities based on prospective electronic clinical data. Two thousand four hundred thirty-five citations were identified as potentially relevant. Ultimately, a full-text review was performed for 147 peer-reviewed papers. One hundred thirty-two articles were selected for inclusion in the review. Of these, 88 articles are the focus of the discussion in this paper. Three types of articles were identified, including papers that: (1) provide historical context or frameworks for using clinical informatics for research, (2) describe platforms and projects, and (3) discuss issues, challenges, and applications of natural language processing. In addition, 2 cross-cutting themes emerged: the challenges of conducting research in the absence of standardized ontologies and data collection; and unique data governance concerns related to the transfer, storage, deidentification, and access to electronic clinical data. Finally, the authors identified several current gaps on important topics such as the use of clinical informatics for cohort identification, cloud computing, and single point access to research data.

Measuring the effectiveness of scientific gatekeeping.

PubMed

Siler, Kyle; Lee, Kirby; Bero, Lisa

2015-01-13

Peer review is the main institution responsible for the evaluation and gestation of scientific research. Although peer review is widely seen as vital to scientific evaluation, anecdotal evidence abounds of gatekeeping mistakes in leading journals, such as rejecting seminal contributions or accepting mediocre submissions. Systematic evidence regarding the effectiveness--or lack thereof--of scientific gatekeeping is scant, largely because access to rejected manuscripts from journals is rarely available. Using a dataset of 1,008 manuscripts submitted to three elite medical journals, we show differences in citation outcomes for articles that received different appraisals from editors and peer reviewers. Among rejected articles, desk-rejected manuscripts, deemed as unworthy of peer review by editors, received fewer citations than those sent for peer review. Among both rejected and accepted articles, manuscripts with lower scores from peer reviewers received relatively fewer citations when they were eventually published. However, hindsight reveals numerous questionable gatekeeping decisions. Of the 808 eventually published articles in our dataset, our three focal journals rejected many highly cited manuscripts, including the 14 most popular; roughly the top 2 percent. Of those 14 articles, 12 were desk-rejected. This finding raises concerns regarding whether peer review is ill--suited to recognize and gestate the most impactful ideas and research. Despite this finding, results show that in our case studies, on the whole, there was value added in peer review. Editors and peer reviewers generally--but not always-made good decisions regarding the identification and promotion of quality in scientific manuscripts.

International Conference in Computational Cell Biology: From the Past to the Future

DTIC Science & Technology

2016-09-12

24061 -0001 ABSTRACT Number of Papers published in peer -reviewed journals: Number of Papers published in non peer -reviewed journals: Final Report...present their latest research and discussed challenges in computational cell biology research and education. (a) Papers published in peer -reviewed...List the papers, including journal references, in the following categories: (b) Papers published in non- peer -reviewed journals (N/A for none) (c

Pragmatic, consensus-based minimum standards and structured interview to guide the selection and development of cancer support group leaders: a protocol paper.

PubMed

Pomery, Amanda; Schofield, Penelope; Xhilaga, Miranda; Gough, Karla

2017-06-30

Across the globe, peer support groups have emerged as a community-led approach to accessing support and connecting with others with cancer experiences. Little is known about qualities required to lead a peer support group or how to determine suitability for the role. Organisations providing assistance to cancer support groups and their leaders are currently operating independently, without a standard national framework or published guidelines. This protocol describes the methods that will be used to generate pragmatic consensus-based minimum standards and an accessible structured interview with user manual to guide the selection and development of cancer support group leaders. We will: (A) identify and collate peer-reviewed literature that describes qualities of support group leaders through a systematic review; (B) content analyse eligible documents for information relevant to requisite knowledge, skills and attributes of group leaders generally and specifically to cancer support groups; (C) use an online reactive Delphi method with an interdisciplinary panel of experts to produce a clear, suitable, relevant and appropriate structured interview comprising a set of agreed questions with behaviourally anchored rating scales; (D) produce a user manual to facilitate standard delivery of the structured interview; (E) pilot the structured interview to improve clinical utility; and (F) field test the structured interview to develop a rational scoring model and provide a summary of existing group leader qualities. The study is approved by the Department Human Ethics Advisory Group of The University of Melbourne. The study is based on voluntary participation and informed written consent, with participants able to withdraw at any time. The results will be disseminated at research conferences and peer review journals. Presentations and free access to the developed structured interview and user manual will be available to cancer agencies. © Article author(s) (or their employer(s) unless otherwise stated in the text of the article) 2017. All rights reserved. No commercial use is permitted unless otherwise expressly granted.

Pragmatic, consensus-based minimum standards and structured interview to guide the selection and development of cancer support group leaders: a protocol paper

PubMed Central

Schofield, Penelope; Xhilaga, Miranda; Gough, Karla

2017-01-01

Introduction Across the globe, peer support groups have emerged as a community-led approach to accessing support and connecting with others with cancer experiences. Little is known about qualities required to lead a peer support group or how to determine suitability for the role. Organisations providing assistance to cancer support groups and their leaders are currently operating independently, without a standard national framework or published guidelines. This protocol describes the methods that will be used to generate pragmatic consensus-based minimum standards and an accessible structured interview with user manual to guide the selection and development of cancer support group leaders. Methods and analysis We will: (A) identify and collate peer-reviewed literature that describes qualities of support group leaders through a systematic review; (B) content analyse eligible documents for information relevant to requisite knowledge, skills and attributes of group leaders generally and specifically to cancer support groups; (C) use an online reactive Delphi method with an interdisciplinary panel of experts to produce a clear, suitable, relevant and appropriate structured interview comprising a set of agreed questions with behaviourally anchored rating scales; (D) produce a user manual to facilitate standard delivery of the structured interview; (E) pilot the structured interview to improve clinical utility; and (F) field test the structured interview to develop a rational scoring model and provide a summary of existing group leader qualities. Ethics and dissemination The study is approved by the Department Human Ethics Advisory Group of The University of Melbourne. The study is based on voluntary participation and informed written consent, with participants able to withdraw at any time. The results will be disseminated at research conferences and peer review journals. Presentations and free access to the developed structured interview and user manual will be available to cancer agencies. PMID:28667202

Evidence-based Peer Review for Radiation Therapy - Updated Review of the Literature with a Focus on Tumour Subsite and Treatment Modality.

PubMed

Huo, M; Gorayski, P; Poulsen, M; Thompson, K; Pinkham, M B

2017-10-01

Technological advances in radiation therapy permit steep dose gradients from the target to spare normal tissue, but increase the risk of geographic miss. Suboptimal target delineation adversely affects clinical outcomes. Prospective peer review is a method for quality assurance of oncologists' radiotherapy plans. Published surveys suggest it is widely implemented. However, it may not be feasible to review every case before commencement of radiation therapy in all departments. The rate of plan changes following peer review of cases without a specific subsite or modality is typically around 10%. Stereotactic body radiation therapy, head and neck, gynaecological, gastrointestinal, haematological and lung cases are associated with higher rates of change of around 25%. These cases could thus be prioritised for peer review. Other factors may limit peer review efficacy including organisational culture, time constraints and the physical environment in which sessions are held. Recommendations for peer review endorsed by the American Society for Radiation Oncology were made available in 2013, but a number of relevant studies have been published since. Here we review and update the literature, and provide an updated suggestion for the implementation of peer review to serve as an adjunct to published guidelines. This may help practitioners evaluate their current processes and maximise the utility and effectiveness of peer review sessions. Copyright © 2017 The Royal College of Radiologists. Published by Elsevier Ltd. All rights reserved.

Coached Peer Review: Developing the Next Generation of Authors.

PubMed

Sidalak, Daniel; Purdy, Eve; Luckett-Gatopoulos, S; Murray, Heather; Thoma, Brent; Chan, Teresa M

2017-02-01

Publishing in academic journals is challenging for learners. Those who pass the initial stages of internal review by an editor often find the anonymous peer review process harsh. Academic blogs offer alternate avenues for publishing medical education material. Many blogs, however, lack a peer review process, which some consumers argue compromises the quality of materials published. CanadiEM (formerly BoringEM) is an academic educational emergency medicine blog dedicated to publishing high-quality materials produced by learners (i.e., residents and medical students). The editorial team has designed and implemented a collaborative "coached peer review" process that comprises an open exchange among the learner-author, editors, and reviewers. The goal of this process is to facilitate the publication of high-quality academic materials by learner-authors while providing focused feedback to help them develop academic writing skills. The authors of this Innovation Report surveyed (February-June 2015) their blog's learner-authors and external expert "staff" reviewers who had participated in coached peer review for their reactions to the process. The survey results revealed that participants viewed the process positively compared with both traditional journal peer review and academic blog publication processes. Participants found the process friendly, easy, efficient, and transparent. Learner-authors also reported increased confidence in their published material. These outcomes met the goals of coached peer review. CanadiEM aims to inspire continued participation in, exposure to, and high-quality production of academic writing by promoting the adoption of coached peer review for online educational resources produced by learners.

Improving your journal article using feedback from peer review.

PubMed

Price, Bob

2014-09-30

While preparation of a journal article for submission may often include informal review by colleagues, an article is not accepted for publication until it has been formally peer reviewed. Peer review is the process whereby journal editors ask expert reviewers to examine the work submitted and prepare a report on its suitability for publication. Two or more revisions of the article may be required following peer review, with the author reworking the article in the light of feedback received on each occasion. This can be challenging for some authors, but used well, it offers a chance to improve the work to the required standard of the journal, and help the author present a more precise and coherent account of the arguments. The extent to which the author responds to the critical commentary of peer reviewers is important, because this may determine whether or not the article is published. This article explores the aims of peer reviewers and recommends ways in which authors can respond to the feedback provided.

Peer Collaboration: Improving Teaching through Comprehensive Peer Review

ERIC Educational Resources Information Center

Smith, Shelley L.

2014-01-01

This article includes a brief rationale and review of the literature on peer review of teaching (PRT). Based on that literature review, it offers a proposal for an optimal formative review process that results in a teaching portfolio that would reflect a faculty member's efforts and successes in a critically reflective PRT process, and contributes…

42 CFR 52h.9 - What matters must be reviewed for unsolicited contract proposals?

Code of Federal Regulations, 2010 CFR

2010-10-01

... SERVICES GRANTS SCIENTIFIC PEER REVIEW OF RESEARCH GRANT APPLICATIONS AND RESEARCH AND DEVELOPMENT CONTRACT... covered by this part unless the proposal has been reviewed by a peer review group in accordance with the... proposal. (b) Except to the extent otherwise provided by law, peer review group recommendations are...

Peer review.

PubMed

Twaij, H; Oussedik, S; Hoffmeyer, P

2014-04-01

The maintenance of quality and integrity in clinical and basic science research depends upon peer review. This process has stood the test of time and has evolved to meet increasing work loads, and ways of detecting fraud in the scientific community. However, in the 21st century, the emphasis on evidence-based medicine and good science has placed pressure on the ways in which the peer review system is used by most journals. This paper reviews the peer review system and the problems it faces in the digital age, and proposes possible solutions.

Sound therapy for tinnitus management: practicable options.

PubMed

Hoare, Derek J; Searchfield, Grant D; El Refaie, Amr; Henry, James A

2014-01-01

The authors reviewed practicable options of sound therapy for tinnitus, the evidence base for each option, and the implications of each option for the patient and for clinical practice. To provide a general guide to selecting sound therapy options in clinical practice. Practicable sound therapy options. Where available, peer-reviewed empirical studies, conference proceedings, and review studies were examined. Material relevant to the purpose was summarized in a narrative. The number of peer-reviewed publications pertaining to each sound therapy option reviewed varied significantly (from none to over 10). Overall there is currently insufficient evidence to support or refute the routine use of individual sound therapy options. It is likely, however, that sound therapy combined with education and counseling is generally helpful to patients. Clinicians need to be guided by the patient's point of care, patient motivation and expectations of sound therapy, and the acceptability of the intervention both in terms of the sound stimuli they are to use and whether they are willing to use sound extensively or intermittently. Clinicians should also clarify to patients the role sound therapy is expected to play in the management plan. American Academy of Audiology.

7 CFR 3400.10 - Establishment and operation of peer review groups.

Code of Federal Regulations, 2011 CFR

2011-01-01

... INSTITUTE OF FOOD AND AGRICULTURE SPECIAL RESEARCH GRANTS PROGRAM Scientific Peer Review of Research Grant Applications § 3400.10 Establishment and operation of peer review groups. Subject to § 3400.5, the...

28 CFR 34.104 - Use of peer review.

Code of Federal Regulations, 2013 CFR

2013-07-01

... the peer review process. (c) Ratings will be in the form of numerical scores assigned by individual... results of peer review for a noncompetitive new or continuation project will be in the form of numerical...

28 CFR 34.104 - Use of peer review.

Code of Federal Regulations, 2014 CFR

2014-07-01

... the peer review process. (c) Ratings will be in the form of numerical scores assigned by individual... results of peer review for a noncompetitive new or continuation project will be in the form of numerical...

28 CFR 34.104 - Use of peer review.

Code of Federal Regulations, 2011 CFR

2011-07-01

... the peer review process. (c) Ratings will be in the form of numerical scores assigned by individual... results of peer review for a noncompetitive new or continuation project will be in the form of numerical...

28 CFR 34.104 - Use of peer review.

Code of Federal Regulations, 2012 CFR

2012-07-01

... the peer review process. (c) Ratings will be in the form of numerical scores assigned by individual... results of peer review for a noncompetitive new or continuation project will be in the form of numerical...

Eyes wide open: reader and author responsibility in understanding the limits of peer review.

PubMed

Benson, P J

2015-10-01

'Medical science can only flourish in a free society and dies under totalitarian repression.' (1) Peer review post-publication is relatively easy to define: when the world decides the importance of publication. Peer review pre-publication is what the scientific community frequently means when using the term 'peer review'. But what it is it? Few will agree on an exact definition; generally speaking, it refers to an independent, third party scrutiny of a manuscript by scientific experts (called peers) who advise on its suitability for publication. Peer review is expensive; although reviewers are unpaid, the cost in time is enormous and it is slow. There is often little agreement among reviewers about whether an article should be published and peer review can be a lottery. Often referred to as a quality assurance process, there are many examples of when peer review failed. Many will be aware of Woo-Suk Hwang's shocking stem cell research misconduct at Seoul National University. (2) Science famously published two breakthrough articles that were found subsequently to be completely fabricated and this happened in spite of peer review. Science is not unique in making this error. However, love it or hate it, peer review, for the present time at least, is here to stay. In this article, Philippa Benson, Managing Editor of Science Advances (the first open access journal of the American Association for the Advancement of Science), discusses the merits of peer review. Dr Benson has extensive experience in the publishing world and was Executive Director of PJB Consulting, a not-for-profit organisation supporting clients on issues related to converting to full electronic publishing workflows as well as challenges working with international authors and publishers. Her clients included the Public Library of Science journals, the American Society for Nutrition and the de Beaumont Foundation. She recently co-authored a book, What Editors Want: An Author's Guide to Scientific Journal Publishing (University of Chicago Press), which helps readers understand and navigate the publishing process in high impact science and technical journals. Her master's and doctorate degrees are from Carnegie Mellon University. JYOTI SHAH Commissioning Editor References 1. Eaton KK . Editorial: when is a peer review journal not a peer review journal? J Nutr Environ Med 1997 ; 7 : 139 - 144 . 2. van der Heyden MA , van de Ven T , Opthof T . Fraud and misconduct in science: the stem cell seduction . Neth Heart J 2009 ; 17 : 25 - 29 .

Pre-university Chemistry Students in a Mimicked Scholarly Peer Review

NASA Astrophysics Data System (ADS)

van Rens, Lisette; Hermarij, Philip; Pilot, Albert; Beishuizen, Jos; Hofman, Herman; Wal, Marjolein

2014-10-01

Peer review is a significant component in scientific research. Introducing peer review into inquiry processes may be regarded as an aim to develop student understanding regarding quality in inquiries. This study examines student understanding in inquiry peer reviews among pre-university chemistry students, aged 16-17, when they enact a design of a mimicked scholarly peer review. This design is based on a model of a human activity system. Twenty-five different schools in Brazil, Germany, Poland and The Netherlands participated. The students (n = 880) conducted in small groups (n = 428) open inquiries on fermentation. All groups prepared an inquiry report for peer review. These reports were published on a website. Groups were randomly paired in an internet symposium, where they posted review comments to their peers. These responses were qualitatively analyzed on small groups' level of understanding regarding seven categories: inquiry question, hypothesis, management of control variables, accurate measurement, presenting results, reliability of results, discussion and conclusion. The mimicked scholarly review prompted a collective practice. Student understanding was significantly well on presenting results, discussion and conclusion, and significantly less on inquiry question and reliability of results. An enacted design, based on a model of a human activity system, created student understanding of quality in inquiries as well as an insight in a peer-reviewing practice. To what extent this model can be applied in a broader context of design research in science education needs further study.

Peer review of health research funding proposals: A systematic map and systematic review of innovations for effectiveness and efficiency.

PubMed

Shepherd, Jonathan; Frampton, Geoff K; Pickett, Karen; Wyatt, Jeremy C

2018-01-01

To investigate methods and processes for timely, efficient and good quality peer review of research funding proposals in health. A two-stage evidence synthesis: (1) a systematic map to describe the key characteristics of the evidence base, followed by (2) a systematic review of the studies stakeholders prioritised as relevant from the map on the effectiveness and efficiency of peer review 'innovations'. Standard processes included literature searching, duplicate inclusion criteria screening, study keyword coding, data extraction, critical appraisal and study synthesis. A total of 83 studies from 15 countries were included in the systematic map. The evidence base is diverse, investigating many aspects of the systems for, and processes of, peer review. The systematic review included eight studies from Australia, Canada, and the USA, evaluating a broad range of peer review innovations. These studies showed that simplifying the process by shortening proposal forms, using smaller reviewer panels, or expediting processes can speed up the review process and reduce costs, but this might come at the expense of peer review quality, a key aspect that has not been assessed. Virtual peer review using videoconferencing or teleconferencing appears promising for reducing costs by avoiding the need for reviewers to travel, but again any consequences for quality have not been adequately assessed. There is increasing international research activity into the peer review of health research funding. The studies reviewed had methodological limitations and variable generalisability to research funders. Given these limitations it is not currently possible to recommend immediate implementation of these innovations. However, many appear promising based on existing evidence, and could be adapted as necessary by funders and evaluated. Where feasible, experimental evaluation, including randomised controlled trials, should be conducted, evaluating impact on effectiveness, efficiency and quality.

The Effectiveness of Peer Review of Teaching When Performed between Early-Career Academics

ERIC Educational Resources Information Center

Woodman, Richard J.; Parappilly, Maria B.

2015-01-01

The success of peer review of teaching (PRT) in shaping teaching practice during an academic's formative years may depend on the peers' teaching experience and the frequency of evaluation. Two Australian early-career University lecturers with no previous experience of peer review performed a single PRT on one another following a one week academic…

Multi-Stage Open Peer Review: Scientific Evaluation Integrating the Strengths of Traditional Peer Review with the Virtues of Transparency and Self-Regulation

PubMed Central

Pöschl, Ulrich

2012-01-01

The traditional forms of scientific publishing and peer review do not live up to all demands of efficient communication and quality assurance in today’s highly diverse and rapidly evolving world of science. They need to be advanced and complemented by interactive and transparent forms of review, publication, and discussion that are open to the scientific community and to the public. The advantages of open access, public peer review, and interactive discussion can be efficiently and flexibly combined with the strengths of traditional scientific peer review. Since 2001 the benefits and viability of this approach are clearly demonstrated by the highly successful interactive open access journal Atmospheric Chemistry and Physics (ACP, www.atmos-chem-phys.net) and a growing number of sister journals launched and operated by the European Geosciences Union (EGU, www.egu.eu) and the open access publisher Copernicus (www.copernicus.org). The interactive open access journals are practicing an integrative multi-stage process of publication and peer review combined with interactive public discussion, which effectively resolves the dilemma between rapid scientific exchange and thorough quality assurance. Key features and achievements of this approach are: top quality and impact, efficient self-regulation and low rejection rates, high attractivity and rapid growth, low costs, and financial sustainability. In fact, ACP and the EGU interactive open access sister journals are by most if not all standards more successful than comparable scientific journals with traditional or alternative forms of peer review (editorial statistics, publication statistics, citation statistics, economic costs, and sustainability). The high efficiency and predictive validity of multi-stage open peer review have been confirmed in a series of dedicated studies by evaluation experts from the social sciences, and the same or similar concepts have recently also been adopted in other disciplines, including the life sciences and economics. Multi-stage open peer review can be flexibly adjusted to the needs and peculiarities of different scientific communities. Due to the flexibility and compatibility with traditional structures of scientific publishing and peer review, the multi-stage open peer review concept enables efficient evolution in scientific communication and quality assurance. It has the potential for swift replacement of hidden peer review as the standard of scientific quality assurance, and it provides a basis for open evaluation in science. PMID:22783183

How Effective Are Clinical Pathways With and Without Online Peer-Review? An Analysis of Bone Metastases Pathway in a Large, Integrated National Cancer Institute-Designated Comprehensive Cancer Center Network

DOE Office of Scientific and Technical Information (OSTI.GOV)

Beriwal, Sushil, E-mail: beriwals@upmc.edu; Rajagopalan, Malolan S.; Flickinger, John C.

2012-07-15

Purpose: Clinical pathways are an important tool used to manage the quality in health care by standardizing processes. This study evaluated the impact of the implementation of a peer-reviewed clinical pathway in a large, integrated National Cancer Institute-Designated Comprehensive Cancer Center Network. Methods: In 2003, we implemented a clinical pathway for the management of bone metastases with palliative radiation therapy. In 2009, we required the entry of management decisions into an online tool that records pathway choices. The pathway specified 1 or 5 fractions for symptomatic bone metastases with the option of 10-14 fractions for certain clinical situations. The datamore » were obtained from 13 integrated sites (3 central academic, 10 community locations) from 2003 through 2010. Results: In this study, 7905 sites were treated with 64% of courses delivered in community practice and 36% in academic locations. Academic practices were more likely than community practices to treat with 1-5 fractions (63% vs. 23%; p < 0.0001). The number of delivered fractions decreased gradually from 2003 to 2010 for both academic and community practices (p < 0.0001); however, greater numbers of fractions were selected more often in community practices (p < 0.0001). Using multivariate logistic regression, we found that a significantly greater selection of 1-5 fractions developed after implementation online pathway monitoring (2009) with an odds ratio of 1.2 (confidence interval, 1.1-1.4) for community and 1.3 (confidence interval, 1.1-1.6) for academic practices. The mean number of fractions also decreased after online peer review from 6.3 to 6.0 for academic (p = 0.07) and 9.4 to 9.0 for community practices (p < 0.0001). Conclusion: This is one of the first studies to examine the efficacy of a clinical pathway for radiation oncology in an integrated cancer network. Clinical pathway implementation appears to be effective in changing patterns of care, particularly with online clinical peer review as a valuable aid to encourage adherence to evidence-based practice.« less

Content and communication: How can peer review provide helpful feedback about the writing?

PubMed Central

Shashok, Karen

2008-01-01

Background Peer review is assumed to improve the quality of research reports as tools for scientific communication, yet strong evidence that this outcome is obtained consistently has been elusive. Failure to distinguish between aspects of discipline-specific content and aspects of the writing or use of language may account for some deficiencies in current peer review processes. Discussion The process and outcomes of peer review may be analyzed along two dimensions: 1) identifying scientific or technical content that is useful to other researchers (i.e., its "screening" function), and 2) improving research articles as tools for communication (i.e., its "improving" function). However, editors and reviewers do not always distinguish clearly between content criteria and writing criteria. When peer reviewers confuse content and writing, their feedback can be misunderstood by authors, who may modify texts in ways that do not make the readers' job easier. When researchers in peer review confuse the two dimensions, this can lead to content validity problems that foil attempts to define informative variables and outcome measures, and thus prevent clear trends from emerging. Research on writing, revising and editing suggests some reasons why peer review is not always as effective as it might be in improving what is written. Summary Peer review could be improved if stakeholders were more aware of variations in gatekeepers' (reviewers' and editors') ability to provide feedback about the content or the writing. Gatekeepers, academic literacy researchers, and wordface professionals (author's editors, medical writers and translators) could work together to discover the types of feedback authors find most useful. I offer suggestions to help editologists design better studies of peer review which could make the process an even stronger tool for manuscript improvement than it is now. PMID:18237378

Content and communication: how can peer review provide helpful feedback about the writing?

PubMed

Shashok, Karen

2008-01-31

Peer review is assumed to improve the quality of research reports as tools for scientific communication, yet strong evidence that this outcome is obtained consistently has been elusive. Failure to distinguish between aspects of discipline-specific content and aspects of the writing or use of language may account for some deficiencies in current peer review processes. The process and outcomes of peer review may be analyzed along two dimensions: 1) identifying scientific or technical content that is useful to other researchers (i.e., its "screening" function), and 2) improving research articles as tools for communication (i.e., its "improving" function). However, editors and reviewers do not always distinguish clearly between content criteria and writing criteria. When peer reviewers confuse content and writing, their feedback can be misunderstood by authors, who may modify texts in ways that do not make the readers' job easier. When researchers in peer review confuse the two dimensions, this can lead to content validity problems that foil attempts to define informative variables and outcome measures, and thus prevent clear trends from emerging. Research on writing, revising and editing suggests some reasons why peer review is not always as effective as it might be in improving what is written. Peer review could be improved if stakeholders were more aware of variations in gatekeepers' (reviewers' and editors') ability to provide feedback about the content or the writing. Gatekeepers, academic literacy researchers, and wordface professionals (author's editors, medical writers and translators) could work together to discover the types of feedback authors find most useful. I offer suggestions to help editologists design better studies of peer review which could make the process an even stronger tool for manuscript improvement than it is now.

Applications of the Schur Basis to Quantum Algorithms

DTIC Science & Technology

2011-01-10

superpolynomial speedups based on quantum circuits. (a) Papers published in peer -reviewed journals (N/A for none) 1. D.A.Bacon, I.L. Chuang, A.W...reporting period. List the papers, including journal references, in the following categories: (b) Papers published in non- peer -reviewed journals or in...MIT, Department of EECS, 2008 7.00Number of Papers published in peer -reviewed journals: Number of Papers published in non peer -reviewed journals: (c

Redefining the Practice of Peer Review Through Intelligent Automation Part 1: Creation of a Standardized Methodology and Referenceable Database.

PubMed

Reiner, Bruce I

2017-10-01

Conventional peer review practice is compromised by a number of well-documented biases, which in turn limit standard of care analysis, which is fundamental to determination of medical malpractice. In addition to these intrinsic biases, other existing deficiencies exist in current peer review including the lack of standardization, objectivity, retrospective practice, and automation. An alternative model to address these deficiencies would be one which is completely blinded to the peer reviewer, requires independent reporting from both parties, utilizes automated data mining techniques for neutral and objective report analysis, and provides data reconciliation for resolution of finding-specific report differences. If properly implemented, this peer review model could result in creation of a standardized referenceable peer review database which could further assist in customizable education, technology refinement, and implementation of real-time context and user-specific decision support.

Structured implicit review: a new method for monitoring nursing care quality.

PubMed

Pearson, M L; Lee, J L; Chang, B L; Elliott, M; Kahn, K L; Rubenstein, L V

2000-11-01

Nurses' independent decisions about assessment, treatment, and nursing interventions for hospitalized patients are important determinants of quality of care. Physician peer implicit review of medical records has been central to Medicare quality management and is considered the gold standard for reviewing physician care, but peer implicit review of nursing processes of care has not received similar attention. The objective of this study was to develop and evaluate nurse structured implicit review (SIR) methods. We developed SIR instruments for rating the quality of inpatient nursing care for congestive heart failure (CHF) and cerebrovascular accident (CVA). Nurse reviewers used the SIR form to rate a nationally representative sample of randomly selected medical records for each disease from 297 acute care hospitals in 5 states (collected by the RAND-HCFA Prospective Payment System study). The study subjects were elderly Medicare inpatients with CHF (n = 291) or CVA (n = 283). We developed and tested scales reflecting domains of nursing process, evaluated interrater and interitem reliability, and assessed the extent to which items and scales predicted overall ratings of the quality of nursing care. Interrater reliability for 14 of 16 scales (CHF) or 10 of 16 scales (CVA) was > or = 0.40. Interitem reliability was > 0.80 for all but 1 scale (both diseases). Functional Assessment, Physical Assessment, and Medication Tracking ratings were the strongest predictors of overall nursing quality ratings (P < 0.001 for each). Nurse peer review with SIR has adequate interrater and excellent scale reliabilities and can be a valuable tool for assessing nurse performance.

Students as Teaching Resources; A Survey of Teaching Models Using Non-Professionals (Peer Tutoring).

ERIC Educational Resources Information Center

Klaus, David J.

This preliminary survey was designed to explore the possible use of students as teaching resources in the developing countries. In carrying out the survey, available literature was reviewed, visits made to selected ongoing projects in the United States, and interviews conducted overseas with indigenous educational researchers in Ghana, Sierra…

Gang Free: Influencing Friendship Choices in Today's World.

ERIC Educational Resources Information Center

Wiener, Valerie

This book presents information as to how teenagers select their friends. Material was garnered through a review of the literature and hundreds of interviews. The book opens with a focus on how teenagers make friends, and includes such issues as the power of self, finding groups, peer impact, the merging process, seeking significance, and putting…

"Homo Virtualis": Virtual Worlds, Learning, and an Ecology of Embodied Interaction

ERIC Educational Resources Information Center

Jarmon, Leslie

2010-01-01

This article previews the emergence of "homo virtualis." Drawing on data from seven research studies, peer-reviewed published research articles, and selected excerpts of 30 months of field notes taken in Second Life [SL], the article examines virtual learning environments and embodiment through the lens of interactions of avatars with…

Gender Consequences of a National Performance-Based Funding Model: New Pieces in an Old Puzzle

ERIC Educational Resources Information Center

Nielsen, Mathias Wullum

2017-01-01

This article investigates the extent to which the Danish "Bibliometric Research Indicator" (BRI) reflects the performance of men and women differently. The model is based on a differentiated counting of peer-reviewed publications, awarding three and eight points for contributions to "well-regarded" and highly selective journals…

EFL Teachers' Background Knowledge Is the Key to Learners' Needs

ERIC Educational Resources Information Center

Al Darwish, Salwa

2012-01-01

This study aimed at examining an unorthodox approach in which teacher trainees observe experienced teachers to benefit from their professional experience instead of the more common practice in which teacher trainees are evaluated through self-reflection and peer review. The target population was 111 teachers randomly selected by 20 teacher…

Meta-Ethnography of Autoethnographies: A Worked Example of the Method Using Educational Studies

ERIC Educational Resources Information Center

Hughes, Sherick; Noblit, George

2017-01-01

Despite questions about autoethnography in the ethnography and education research family, autoethnography is published in selective peer-reviewed journals in education and in the social and health sciences. Even critics of autoethnographic studies note their "rising acceptance in the past 15 years" [Delamont, S. 2009. "The Only…

Teaching Children with Intellectual Disabilities: Analysis of Research-Based Recommendations

ERIC Educational Resources Information Center

Räty, Lauri M. O.; Kontu, Elina K.; Pirttimaa, Raija A.

2016-01-01

The purpose of this qualitative study was to produce an overview of topics and practical recommendations that have been presented for teaching for students with intellectual disabilities in educational research articles published from 2000 to 2013. The sample of peer-reviewed research articles considering this topic was selected using a database…

Radiologist Peer Review by Group Consensus.

PubMed

Harvey, H Benjamin; Alkasab, Tarik K; Prabhakar, Anand M; Halpern, Elkan F; Rosenthal, Daniel I; Pandharipande, Pari V; Gazelle, G Scott

2016-06-01

The objective of this study was to evaluate the feasibility of the consensus-oriented group review (COGR) method of radiologist peer review within a large subspecialty imaging department. This study was institutional review board approved and HIPAA compliant. Radiologist interpretations of CT, MRI, and ultrasound examinations at a large academic radiology department were subject to peer review using the COGR method from October 2011 through September 2013. Discordance rates and sources of discordance were evaluated on the basis of modality and division, with group differences compared using a χ(2) test. Potential associations between peer review outcomes and the time after the initiation of peer review or the number of radiologists participating in peer review were tested by linear regression analysis and the t test, respectively. A total of 11,222 studies reported by 83 radiologists were peer reviewed using COGR during the two-year study period. The average radiologist participated in 112 peer review conferences and had 3.3% of his or her available CT, MRI and ultrasound studies peer reviewed. The rate of discordance was 2.7% (95% confidence interval [CI], 2.4%-3.0%), with significant differences in discordance rates on the basis of division and modality. Discordance rates were highest for MR (3.4%; 95% CI, 2.8%-4.1%), followed by ultrasound (2.7%; 95% CI, 2.0%-3.4%) and CT (2.4%; 95% CI, 2.0%-2.8%). Missed findings were the most common overall cause for discordance (43.8%; 95% CI, 38.2%-49.4%), followed by interpretive errors (23.5%; 95% CI, 18.8%-28.3%), dictation errors (19.0%; 95% CI, 14.6%-23.4%), and recommendation (10.8%; 95% CI, 7.3%-14.3%). Discordant cases, compared with concordant cases, were associated with a significantly greater number of radiologists participating in the peer review process (5.9 vs 4.7 participating radiologists, P < .001) and were significantly more likely to lead to an addendum (62.9% vs 2.7%, P < .0001). COGR permits departments to collect highly contextualized peer review data to better elucidate sources of error in diagnostic imaging reports, while reviewing a sufficient case volume to comply with external standards for ongoing performance review. Copyright © 2016 American College of Radiology. Published by Elsevier Inc. All rights reserved.

The mechanisms underpinning peer support: a literature review.

PubMed

Watson, Emma

2017-12-20

The employment of Peer Support Workers, who themselves have experience of significant emotional distress, can promote recovery at an individual and organisational level. While research examining the benefits of peer support within mental health services continues to grow, an understanding of how, and through what processes, these benefits are reached remains under-developed. To review the published research literature relating to the process of peer support and its underpinning mechanisms to better understand how and why it works. A scoping review of published literature identified studies relating to peer support mechanisms, processes and relationships. Studies were summarised and findings analysed. Five mechanisms were found to underpin peer support relationships (lived experience, love labour, the liminal position of the peer worker, strengths-focussed social and practical support, and the helper role). The identified mechanisms can underpin both the success and difficulties associated with peer support relationships. Further research should review a broader range of literature and clarify how these mechanisms contribute to peer support in different contexts.

Bridging knowledge, policies and practices across the ageing and disability fields: a protocol for a scoping review to inform the development of a taxonomy.

PubMed

Nalder, Emily Joan; Putnam, Michelle; Salvador-Carulla, Luis; Spindel, Andria; Batliwalla, Zinnia; Lenton, Erica

2017-10-25

Bridging is a term used to describe activities, or tasks, used to promote collaboration and knowledge exchange across fields. This paper reports the protocol for a scoping review which aims to identify and characterise peer reviewed evidence describing bridging activities, between the ageing and disability fields. The purpose is to clarify the concepts underpinning bridging to inform the development of a taxonomy, and identify research strengths and gaps. A scoping review will be conducted. We will search Medline, Cumulative Index to Nursing and Allied Health Literature, Embase, PsycInfo, Sociological Abstracts and the Cochrane Library, to identify peer reviewed publications (reviews, experimental, observational, qualitative designs and expert commentaries) describing bridging activities. Grey literature, and articles not published in English will be excluded. Two investigators will independently complete article selection and data abstraction to minimise bias. A data extraction form will be iteratively developed and information from each publication will be extracted: (1) bibliographic, (2) methodological, (3) demographic, and (4) bridging information. Qualitative content analysis will be used to describe key concepts related to bridging. To our knowledge, this will be the first scoping review to describe bridging of ageing and disability knowledge, services and policies. The findings will inform the development of a taxonomy to define models of bridging that can be implemented and further evaluated to enable integrated care and improve systems and services for those ageing with disability. Ethics is not required because this is a scoping review of published literature. Findings will be disseminated through stakeholder meetings, conference presentations and peer reviewed publication. © Article author(s) (or their employer(s) unless otherwise stated in the text of the article) 2017. All rights reserved. No commercial use is permitted unless otherwise expressly granted.

Effectiveness of Guided Peer Review of Student Essays in a Large Undergraduate Biology Course

ERIC Educational Resources Information Center

Kelly, Lauren

2015-01-01

Instructors and researchers often consider peer review an integral part of the writing process, providing myriad benefits for both writers and reviewers. Few empirical studies, however, directly address the relationship between specific methodological changes and peer review effectiveness, especially outside the composition classroom. To…

42 CFR 52h.6 - Availability of information.

Code of Federal Regulations, 2010 CFR

2010-10-01

... a peer review group will be available for public inspection and copying to the extent provided by... regulations (45 CFR parts 5, 5b). (b) Meetings of peer review groups reviewing grant applications or contract... by peer review groups that contain trade secrets or commercial or financial information obtained from...

Methodologies of Peer and Editorial Review: Changing Practices

ERIC Educational Resources Information Center

Selfe, Cynthia; Hawisher, Gail

2012-01-01

The authors--drawing on their varied experiences as authors and publishers of a journal and several book series--provide a historical review and consideration of peer review in publishing. They find that scholarly peer review, from the question of signed reviews to the practices of digital publications, is in the midst of change, but that at the…

42 CFR 52h.7 - What matters must be reviewed for grants?

Code of Federal Regulations, 2010 CFR

2010-10-01

... SCIENTIFIC PEER REVIEW OF RESEARCH GRANT APPLICATIONS AND RESEARCH AND DEVELOPMENT CONTRACT PROJECTS § 52h.7... reviewed by a peer review group in accordance with the provisions of this part and the group has made... appropriate peer review group, in accordance with the provisions of this part, and the group has made...

Comparing Peer Review and Self-Review as Ways to Improve College Students' Writing

ERIC Educational Resources Information Center

Covill, Amy E.

2010-01-01

The effect of three approaches to revision instruction on 61 college students' revision behavior and writing quality was investigated for this article. Students wrote three 5-page papers and received one of three instructional approaches: Formal Peer Review (n = 19), Formal Self-Review (n = 20), or No Formal Review (n = 22). Formal Peer Review…

Biomass Program 2007 Program Peer Review - Full Report

DOE Office of Scientific and Technical Information (OSTI.GOV)

none,

This document summarizes the comments provided by the peer reviewers at the U.S. Department of Energy (DOE) Biomass Program’s Peer Review meeting, held on November 14-15, 2007 in Baltimore, MD and Platform Reviews conducted over the summer of 2007. The Platform Reviews provide evaluations of the Program’s projects in applied research, development, and demonstration.

Online physician ratings fail to predict actual performance on measures of quality, value, and peer review.

PubMed

Daskivich, Timothy J; Houman, Justin; Fuller, Garth; Black, Jeanne T; Kim, Hyung L; Spiegel, Brennan

2018-04-01

Patients use online consumer ratings to identify high-performing physicians, but it is unclear if ratings are valid measures of clinical performance. We sought to determine whether online ratings of specialist physicians from 5 platforms predict quality of care, value of care, and peer-assessed physician performance. We conducted an observational study of 78 physicians representing 8 medical and surgical specialties. We assessed the association of consumer ratings with specialty-specific performance scores (metrics including adherence to Choosing Wisely measures, 30-day readmissions, length of stay, and adjusted cost of care), primary care physician peer-review scores, and administrator peer-review scores. Across ratings platforms, multivariable models showed no significant association between mean consumer ratings and specialty-specific performance scores (β-coefficient range, -0.04, 0.04), primary care physician scores (β-coefficient range, -0.01, 0.3), and administrator scores (β-coefficient range, -0.2, 0.1). There was no association between ratings and score subdomains addressing quality or value-based care. Among physicians in the lowest quartile of specialty-specific performance scores, only 5%-32% had consumer ratings in the lowest quartile across platforms. Ratings were consistent across platforms; a physician's score on one platform significantly predicted his/her score on another in 5 of 10 comparisons. Online ratings of specialist physicians do not predict objective measures of quality of care or peer assessment of clinical performance. Scores are consistent across platforms, suggesting that they jointly measure a latent construct that is unrelated to performance. Online consumer ratings should not be used in isolation to select physicians, given their poor association with clinical performance.

Views on the peer review system of biomedical journals: an online survey of academics from high-ranking universities

PubMed Central

2013-01-01

Background Peer review is the major method used by biomedical journals for making the decision of publishing an article. This cross-sectional survey assesses views concerning the review system of biomedical journals among academics globally. Methods A total of 28,009 biomedical academics from high-ranking universities listed by the 2009 Times Higher Education Quacquarelli Symonds (THE-QS) World University Rankings were contacted by email between March 2010 and August 2010. 1,340 completed an online survey which focused on their academic background, negative experiences and views on biomedical journal peer review and the results were compared among basic scientists, clinicians and clinician scientists. Results Fewer than half of the respondents agreed that the peer review systems of biomedical journals were fair (48.4%), scientific (47.5%), or transparent (25.1%). Nevertheless, 58.2% of the respondents agreed that authors should remain anonymous and 64.4% agreed that reviewers should not be disclosed. Most, (67.7%) agreed to the establishment of an appeal system. The proportion of native English-speaking respondents who agreed that the “peer review system is fair” was significantly higher than for non-native respondents (p = 0.02). Similarly, the proportion of clinicians stating that the “peer review system is fair” was significantly higher than that for basic scientists and clinician-scientists (p = 0.004). For females, (β = −0.1, p = 0.03), the frequency of encountering personal attacks in reviewers’ comments (β = −0.1, p = 0.002) and the frequency of imposition of unnecessary references by reviewers (β = −0.06, p = 0.04) were independently and inversely associated with agreement that “the peer review system is fair”. Conclusion Academics are divided on the issue of whether the biomedical journal peer review system is fair, scientific and transparent. A majority of academics agreed with the double-blind peer review and to the establishment of an appeal system. Female academics, experience of personal attacks and imposition of unnecessary references by reviewers were related to disagreement about fairness of the peer review system of biomedical journals. PMID:23758823

Four peer reviews in support of the Tier 3 rulemaking ...

EPA Pesticide Factsheets

Peer review of ERG's KenCaryl (CO) estimated summer hot-soak distributions report in support of the Tier 3 rulemaking To peer review ERG's KenCaryl (CO) estimated summer hot-soak distributions report (for Tier 3 rulemaking)

Results of the peer assessment program of the College of Physicians and Surgeons of Ontario.

PubMed Central

McAuley, R G; Henderson, H W

1984-01-01

This paper describes the experience of the College of Physicians and Surgeons of Ontario in developing and conducting a program for the peer assessment of physicians' office practices that would allow the standards of medical practice to be reviewed and assessed. Following two pilot projects in 1978 and 1979 that demonstrated the need, the feasibility and the acceptance of a peer assessment program the office practices of 391 randomly selected physicians were reviewed in 1981 and 1982. Included in the sample were 255 general/family practitioners and 136 specialists in seven fields. Serious deficiencies were found in the medical records of or in the care provided by 30 of the general/family practitioners and 3 of the specialists, accounting for 8% of the practices studied. The difference between the two groups of physicians was statistically significant (p less than 0.01). No predictors of significance were demonstrated in the general/family practitioner group. When follow-up assessments were done most of the physicians were found to have made the improvements that had been recommended. PMID:6478338

Influence of peer review on the reporting of primary outcome(s) and statistical analyses of randomised trials.

PubMed

Hopewell, Sally; Witt, Claudia M; Linde, Klaus; Icke, Katja; Adedire, Olubusola; Kirtley, Shona; Altman, Douglas G

2018-01-11

Selective reporting of outcomes in clinical trials is a serious problem. We aimed to investigate the influence of the peer review process within biomedical journals on reporting of primary outcome(s) and statistical analyses within reports of randomised trials. Each month, PubMed (May 2014 to April 2015) was searched to identify primary reports of randomised trials published in six high-impact general and 12 high-impact specialty journals. The corresponding author of each trial was invited to complete an online survey asking authors about changes made to their manuscript as part of the peer review process. Our main outcomes were to assess: (1) the nature and extent of changes as part of the peer review process, in relation to reporting of the primary outcome(s) and/or primary statistical analysis; (2) how often authors followed these requests; and (3) whether this was related to specific journal or trial characteristics. Of 893 corresponding authors who were invited to take part in the online survey 258 (29%) responded. The majority of trials were multicentre (n = 191; 74%); median sample size 325 (IQR 138 to 1010). The primary outcome was clearly defined in 92% (n = 238), of which the direction of treatment effect was statistically significant in 49%. The majority responded (1-10 Likert scale) they were satisfied with the overall handling (mean 8.6, SD 1.5) and quality of peer review (mean 8.5, SD 1.5) of their manuscript. Only 3% (n = 8) said that the editor or peer reviewers had asked them to change or clarify the trial's primary outcome. However, 27% (n = 69) reported they were asked to change or clarify the statistical analysis of the primary outcome; most had fulfilled the request, the main motivation being to improve the statistical methods (n = 38; 55%) or avoid rejection (n = 30; 44%). Overall, there was little association between authors being asked to make this change and the type of journal, intervention, significance of the primary outcome, or funding source. Thirty-six percent (n = 94) of authors had been asked to include additional analyses that had not been included in the original manuscript; in 77% (n = 72) these were not pre-specified in the protocol. Twenty-three percent (n = 60) had been asked to modify their overall conclusion, usually (n = 53; 88%) to provide a more cautious conclusion. Overall, most changes, as a result of the peer review process, resulted in improvements to the published manuscript; there was little evidence of a negative impact in terms of post hoc changes of the primary outcome. However, some suggested changes might be considered inappropriate, such as unplanned additional analyses, and should be discouraged.

Social development of children born very preterm: a systematic review.

PubMed

Ritchie, Kirsten; Bora, Samudragupta; Woodward, Lianne J

2015-10-01

To review systematically studies examining the development of social competence in children born very preterm (VPT) (gestation <33 wks) and identify neonatal and family predictors. Peer-reviewed original articles were extracted from PubMed and PsycINFO following Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) guidelines. Selection criteria included children born VPT and comparison children born at term, sample born after 1990, and children assessed between 0 and 17 years on at least one measure of social competence spanning social adjustment, performance, and/or social skills. Twenty-three studies were included. Seven focused on social competence and another 16 examined social competence within a range of outcomes. Study quality was low. Limitations included reliance on single informant data, cross-sectional measurement, use of brief screening tools, absence of child or peer report, and no conceptual model. In terms of social adjustment, 16 out of 21 studies found children born VPT had more peer problems and social withdrawal. Findings of social performance were mixed, with some studies suggesting differences in prosocial behavior (4/14) and others not. Social skills were assessed in four studies and showed children born VPT had poorer skills than children born at term. Predictors of social competence included gestational age, neonatal brain abnormalities, and family socio-economic status. Children born VPT have poorer social competence. These difficulties emerge early and persist throughout childhood. © 2015 Mac Keith Press.

Why Are Chemists and Other Scientists Afraid of the Peer Review of Teaching?

NASA Astrophysics Data System (ADS)

Atwood, Charles H.; Taylor, James W.; Hutchings, Pat A.

2000-02-01

This paper presents a series of arguments that teaching should be subjected to the similar review standards that chemical research employs. Through peer review, the hope is to elevate the status of teaching in academe. The paper also describes a national effort through the American Association for Higher Education and the Carnegie Foundation for the Advancement of Teaching to establish a peer-review process appropriate for teaching. Finally, an examination of some of the perceived barriers to peer review, including fear, is detailed.

Helping agencies improve their planning analysis techniques.

DOT National Transportation Integrated Search

2011-11-18

This report summarizes the results of a peer review of the AZTDM. The peer review was : supported by the Travel Model Improvement Program (TMIP), which is sponsored by FHWA. : The peer review of a travel model can serve multiple purposes, including i...

Systematic review of peer support for breastfeeding continuation: metaregression analysis of the effect of setting, intensity, and timing.

PubMed

Jolly, Kate; Ingram, Lucy; Khan, Khalid S; Deeks, Jonathan J; Freemantle, Nick; MacArthur, Christine

2012-01-25

To examine the effect of setting, intensity, and timing of peer support on breast feeding. Systematic review and metaregression analysis of randomised controlled trials. Cochrane Library, Medline, CINAHL, the National Research Register, and British Nursing Index were searched from inception or from 1980 to 2011. Review methods Study selection, data abstraction, and quality assessment were carried out independently and in duplicate. Risk ratios and 95% confidence intervals were calculated for individual studies and pooled. Effects were estimated for studies grouped according to setting (high income countries, low or middle income countries, and the United Kingdom), intensity (<5 and ≥5 planned contacts), and timing of peer support (postnatal period with or without antenatal care), and analysed using metaregression for any and exclusive breast feeding at last study follow-up. Peer support interventions had a significantly greater effect on any breast feeding in low or middle income countries (P<0.001), reducing the risk of not breast feeding at all by 30% (relative risk 0.70, 95% confidence interval 0.60 to 0.82) compared with a reduction of 7% (0.93, 0.87 to 1.00) in high income countries. Similarly, the risk of non-exclusive breast feeding decreased significantly more in low or middle income countries than in high income countries: 37% (0.63, 0.52 to 0.78) compared with 10% (0.90, 0.85 to 0.97); P=0.01. No significant effect on breast feeding was observed in UK based studies. Peer support had a greater effect on any breastfeeding rates when given at higher intensity (P=0.02) and only delivered in the postnatal period (P<0.001), although no differences were observed of its effect on exclusive breastfeeding rates by intensity or timing. Although peer support interventions increase breastfeeding continuation in low or middle income countries, especially exclusive breast feeding, this does not seem to apply in high income countries, particularly the United Kingdom, where breastfeeding support is part of routine postnatal healthcare. Peer support of low intensity does not seem to be effective. Policy relating to provision of peer support should be based on more specific evidence on setting and any new peer services in high income countries need to undergo concurrent evaluation.

Peer feedback for examiner quality assurance on MRCGP International South Asia: a mixed methods study.

PubMed

Perera, D P; Andrades, Marie; Wass, Val

2017-12-08

The International Membership Examination (MRCGP[INT]) of the Royal College of General Practitioners UK is a unique collaboration between four South Asian countries with diverse cultures, epidemiology, clinical facilities and resources. In this setting good quality assurance is imperative to achieve acceptable standards of inter rater reliability. This study aims to explore the process of peer feedback for examiner quality assurance with regard to factors affecting the implementation and acceptance of the method. A sequential mixed methods approach was used based on focus group discussions with examiners (n = 12) and clinical examination convenors who acted as peer reviewers (n = 4). A questionnaire based on emerging themes and literature review was then completed by 20 examiners at the subsequent OSCE exam. Qualitative data were analysed using an iterative reflexive process. Quantitative data were integrated by interpretive analysis looking for convergence, complementarity or dissonance. The qualitative data helped understand the issues and informed the process of developing the questionnaire. The quantitative data allowed for further refining of issues, wider sampling of examiners and giving voice to different perspectives. Examiners stated specifically that peer feedback gave an opportunity for discussion, standardisation of judgments and improved discriminatory abilities. Interpersonal dynamics, hierarchy and perception of validity of feedback were major factors influencing acceptance of feedback. Examiners desired increased transparency, accountability and the opportunity for equal partnership within the process. The process was stressful for examiners and reviewers; however acceptance increased with increasing exposure to receiving feedback. The process could be refined to improve acceptability through scrupulous attention to training and selection of those giving feedback to improve the perceived validity of feedback and improved reviewer feedback skills to enable better interpersonal dynamics and a more equitable feedback process. It is important to highlight the role of quality assurance and peer feedback as a tool for continuous improvement and maintenance of standards to examiners during training. Examiner quality assurance using peer feedback was generally a successful and accepted process. The findings highlight areas for improvement and guide the path towards a model of feedback that is responsive to examiner views and cultural sensibilities.

EPA Peer Consultation Workshop Report on the Review of the Draft IRIS Toxicological Review of Dibutyl Phthalate (DBP)

EPA Science Inventory

The U.S. EPA finalized comments gathered from a public peer review of the scientific basis supporting the human health hazard and dose-response assessment of dibutyl phthalate (DBP) that will appear on the Integrated Risk Information System (IRIS) database. The peer review has en...

Giving Feedback: Preparing Students for Peer Review and Self-Evaluation

ERIC Educational Resources Information Center

Philippakos, Zoi A.

2017-01-01

Revision is an important aspect of the writing process but is often challenging for students. Peer review can be helpful, but training is needed for it to work effectively. This article suggests an approach to preparing students for peer review by teaching specific evaluation criteria and leading collaborative practice in reviewing papers written…

Writing Quality Peer Reviews of Research Manuscripts

ERIC Educational Resources Information Center

Ward, Phillip; Graber, Kim C.; van der Mars, Hans

2015-01-01

Peer review is an important mechanism for advancing knowledge in a manner deemed as acceptable by the research community. It can also serve the function of providing guidance to an author(s) to improve the likelihood that manuscripts will be accepted in peer reviewed journals. There is, however, little assistance for new or existing reviewers of…

IRIS Toxicological Review and Summary Documents for 1,4-Dichlorobenzene (External Peer Review)

EPA Science Inventory

The U.S. EPA has conducted a peer review of the scientific basis supporting the human health hazard and dose-response assessment of 1,4-dichlorobenzene that will appear on the Integrated Risk Information System (IRIS) database. Peer review is meant to ensure that science is used ...

Biomass Program 2007 Program Peer Review - Feedstock Platform Summary

DOE Office of Scientific and Technical Information (OSTI.GOV)

none,

This document discloses the comments provided by a review panel at the U.S. Department of Energy Office of the Biomass Program Peer Review held on November 15-16, 2007 in Baltimore, MD and the Feedstock Platform Portfolio Peer Review held on August 21st through 23rd in Washington D.C.

Conflict of Interest and Disclosure Policies in Psychiatry and Medicine: A Comparative Study of Peer-Reviewed Journals

ERIC Educational Resources Information Center

Khurana, Gauri; Henderson, Schuyler; Walter, Garry; Martin, Andres

2012-01-01

Objective: The authors reviewed and characterized conflict of interest (COI) and disclosure policies published in peer-reviewed psychiatric and nonpsychiatric journals. Methods: The authors examined peer-reviewed publications in the psychiatric (N=20) and nonpsychiatric (N=20) literature. Using qualitative and quantitative approaches, they…

The Problem of Humiliation in Peer Review

ERIC Educational Resources Information Center

Comer, Debra R.; Schwartz, Michael

2014-01-01

This paper examines the problem of vituperative feedback from peer reviewers. We argue that such feedback is morally unacceptable, insofar as it humiliates authors and damages their dignity. We draw from social-psychological research to explore those aspects of the peer-review process in general and the anonymity of blind reviewing in particular…

Online Peer Review: Encouraging Student Response and Development

ERIC Educational Resources Information Center

Lansiquot, Reneta; Rosalia, Christine

2015-01-01

This study explored the use of a tailored online peer review program for first-year undergraduate students at an urban college of technology. The program facilitated group peer review in meaningful and technologically elegant ways. Students in a composition class were divided into two groups. One group acted as first reviewers, and the other group…

Thank you to our 2016 peer reviewers

NASA Astrophysics Data System (ADS)

Hauck, Steven A.; Baratoux, David; Stanley, Sabine

2017-02-01

Peer review is one of most fundamental aspects of the modern practice of science. As scientists we hold our own work up to scrutiny by experts among our peers in order to encourage the best practices in scientific conduct and communication. Thorough consideration and review by professional colleagues of scientific papers are critical aspects of ensuring that the manuscripts published by JGR-Planets are accurate, valuable, and clearly communicated. Peer review is an essential element of the process of refining understanding and sharing science, and the effort and expertise shared by each reviewer are crucial to the advancement of planetary science. In 2016, JGR Planets benefited from more than 451 reviews provided by 337 of our peers for papers submitted to the journal. Thank you all for your dedication to advancing planetary science.

Bridging the Otolaryngology Peer Review Knowledge Gap: A Call for a Residency Development Program.

PubMed

Schmalbach, Cecelia E

2016-07-01

Current otolaryngology literature and future scientific direction rely heavily on a rigorous peer review process. Just as manuscripts warrant thoughtful review with constructive feedback to the authors, the same can be said for critiques written by novice peer reviewers. Formal scientific peer review training programs are lacking. Recognizing this knowledge gap, Otolaryngology-Head and Neck Surgery is excited to offer its new Resident Reviewer Development Program. All otolaryngology residents who are postgraduate year 2 and above and in excellent academic standing are eligible to participate in this mentored program, during which they will conduct 6 manuscript reviews under the direction of a seasoned reviewer in his or her subspecialty area of interest. By completing reviews alongside a mentor, participants gain the required skills to master the peer review process-a first step that often leads to journal editorial board and associate editor invitations. © American Academy of Otolaryngology—Head and Neck Surgery Foundation 2016.

Pressure to drink but not to smoke: disentangling selection and socialization in adolescent peer networks and peer groups.

PubMed

Kiuru, Noona; Burk, William J; Laursen, Brett; Salmela-Aro, Katariina; Nurmi, Jari-Erik

2010-12-01

This paper examined the relative influence of selection and socialization on alcohol and tobacco use in adolescent peer networks and peer groups. The sample included 1419 Finnish secondary education students (690 males and 729 females, mean age 16 years at the outset) from nine schools. Participants identified three school friends and described their alcohol and tobacco use on two occasions one year apart. Actor-based models simultaneously examined changes in peer network ties and changes in individual behaviors for all participants within each school. Multi-level analyses examined changes in individual behaviors for adolescents entering new peer groups and adolescents in stable peer groups, both of which were embedded within the school-based peer networks. Similar results emerged from both analytic methods: Selection and socialization contributed to similarity of alcohol use, but only selection was a factor in tobacco use. Copyright © 2010 The Association for Professionals in Services for Adolescents. Published by Elsevier Ltd. All rights reserved.

U.S. EPA. 2000. Science Policy Council Handbook: Peer Review

EPA Pesticide Factsheets

The goal of the Peer Review Policy and this Handbook is to enhance the quality and credibility of Agency decisions by ensuring that the scientific and technical work products underlying these decisions receive appropriate levels of peer review by independe

Letting the daylight in: Reviewing the reviewers and other ways to maximize transparency in science

PubMed Central

Wicherts, Jelte M.; Kievit, Rogier A.; Bakker, Marjan; Borsboom, Denny

2012-01-01

With the emergence of online publishing, opportunities to maximize transparency of scientific research have grown considerably. However, these possibilities are still only marginally used. We argue for the implementation of (1) peer-reviewed peer review, (2) transparent editorial hierarchies, and (3) online data publication. First, peer-reviewed peer review entails a community-wide review system in which reviews are published online and rated by peers. This ensures accountability of reviewers, thereby increasing academic quality of reviews. Second, reviewers who write many highly regarded reviews may move to higher editorial positions. Third, online publication of data ensures the possibility of independent verification of inferential claims in published papers. This counters statistical errors and overly positive reporting of statistical results. We illustrate the benefits of these strategies by discussing an example in which the classical publication system has gone awry, namely controversial IQ research. We argue that this case would have likely been avoided using more transparent publication practices. We argue that the proposed system leads to better reviews, meritocratic editorial hierarchies, and a higher degree of replicability of statistical analyses. PMID:22536180

Bibliographic analysis of scientific research on selected topics in public health nutrition in West Africa: Review of articles published from 1998 to 2008.

PubMed

Aaron, Grant J; Wilson, Shelby E; Brown, Kenneth H

2010-01-01

Few countries in West Africa have the capacity for carrying out advanced training in nutrition and public health. To provide additional information on current regional applied nutrition research capacity and productivity, we analysed peer-reviewed articles on key public health nutrition topics that were published from 1998 to 2008. Using MEDLINE/PubMed, the following terms were searched: 'breast feeding', 'infant nutrition physiology' (comprising complementary feeding and weaning), 'protein energy malnutrition', 'nutrition and infection', 'vitamin A', 'iodine', 'zinc' and 'overweight', each linked with the term 'Western Africa'. In total, 412 unique articles (37±6 articles per year) were identified. Most research focused on infant and young child feeding practices, selected micronutrient deficiencies, and the emerging problem of overweight and obesity. The primary author of nearly half (46%) the publications was located in an institution outside of West Africa. Most articles were published in English (90%), and nearly half of all articles (41%) were cross-sectional studies. Our findings indicate that few peer-reviewed research studies are being published on key public health topics in the West African region, considering the magnitude of nutrition problems in this region. New approaches are needed to encourage and support research capacity and output in West Africa.

Socialization and Selection Effects in the Association between Weight Conscious Peer Groups and Thin-Ideal Internalization: A Co-Twin Control Study

PubMed Central

Burt, S. Alexandra; O’Connor, Shannon; Thompson, J. Kevin; Klump, Kelly L.

2016-01-01

Affiliation with weight conscious peer groups is theorized to increase thin-ideal internalization through socialization processes. However, selection effects could contribute if genetic and/or environmental predispositions lead to affiliation with weight conscious peers. Co-twin control methodology was used to examine socialization and selection effects in 614 female twins (ages 8–15) from the Michigan State University Twin Registry (MSUTR). Thin-ideal internalization and peer group characteristics were assessed via self-report questionnaires. Results suggested the presence of both socialization and selection effects. In terms of socialization, twins who reported increased exposure to weight conscious peers relative to their co-twins had elevated thin-ideal internalization scores, regardless of zygosity. However, associations between weight conscious peers and thin-ideal internationalization within twin pairs were attenuated, suggesting that genetic and shared environmental selection effects also contribute. Findings significantly extend previous work by confirming the presence of socialization processes and highlighting selection processes to be examined in future longitudinal research. PMID:26859605

Expanding capacity and promoting inclusion in introductory computer science: a focus on near-peer mentor preparation and code review

NASA Astrophysics Data System (ADS)

Pon-Barry, Heather; Packard, Becky Wai-Ling; St. John, Audrey

2017-01-01

A dilemma within computer science departments is developing sustainable ways to expand capacity within introductory computer science courses while remaining committed to inclusive practices. Training near-peer mentors for peer code review is one solution. This paper describes the preparation of near-peer mentors for their role, with a focus on regular, consistent feedback via peer code review and inclusive pedagogy. Introductory computer science students provided consistently high ratings of the peer mentors' knowledge, approachability, and flexibility, and credited peer mentor meetings for their strengthened self-efficacy and understanding. Peer mentors noted the value of videotaped simulations with reflection, discussions of inclusion, and the cohort's weekly practicum for improving practice. Adaptations of peer mentoring for different types of institutions are discussed. Computer science educators, with hopes of improving the recruitment and retention of underrepresented groups, can benefit from expanding their peer support infrastructure and improving the quality of peer mentor preparation.

Implementation and Validation of PACS Integrated Peer Review for Discrepancy Recording of Radiology Reporting.

PubMed

Olthof, A W; van Ooijen, P M A

2016-09-01

The purpose of this work is to demonstrate the possibility of implementation of a PACS-integrated peer review system based on RADPEER™ classification providing a step-wise implementation plan utilizing features already present in the standard PACS implementation and without the requirement of additional software development. Furthermore, we show the usage and effects of the system during the first 30 months of usage. To allow fast and easy implementation into the daily workflow the key-word feature of the PACS was used. This feature allows to add a key-word to an imaging examination for easy searching in the PACS database (e.g. by entering keywords for different kinds of pathology). For peer review we implemented a keyword structure including a code for each of the existing RADPEER™ scoring language terms and a keyword with the phrase "second reading" followed by the name of the individual radiologist. The use of the short-keys to enter the codes in relation to the peer review was a simple to use solution. During the study 599 reports were peer reviewed. The active participation in this study of the radiologists varies and ranges from 3 to 327 reviews per radiologist. The number of peer review is highest in CT and CR. There are no significant technical obstacles to implement a PACS-integrated RADPEER™ -system based on key-words allowing easy integration of peer review into the daily routine without the requirement of additional software. Peer review implemented in a non-random setting based on relevant priors could already help in increasing the quality of radiological reporting and serve as continuing education among peers. Decisiveness, tact and trust are needed to promote use of the system and collaborative discussion of the results by radiologist.

What's with all this peer-review stuff anyway?

DOE Office of Scientific and Technical Information (OSTI.GOV)

Warner, J. S.

2010-01-01

The Journal of Physical Security was ostensibly started to deal with a perceived lack of peer-reviewed journals related to the field of physical security. In fact, concerns have been expressed that the field of physical security is scarcely a field at all. A typical, well-developed field might include the following: multiple peer-reviewed journals devoted to the subject, rigor and critical thinking, metrics, fundamental principles, models and theories, effective standards and guidelines, R and D conferences, professional societies, certifications, its own academic department (or at least numerous academic experts), widespread granting of degrees in the field from 4-year research universities, mechanismsmore » for easily spotting 'snake oil' products and services, and the practice of professionals organizing to police themselves, provide quality control, and determine best practices. Physical Security seems to come up short in a number of these areas. Many of these attributes are difficult to quantify. This paper seeks to focus on one area that is quantifiable: the number of peer-reviewed journals dedicated to the field of Physical Security. In addition, I want to examine the number of overall periodicals (peer-reviewed and non-peer-reviewed) dedicated to physical security, as well as the number of papers published each year about physical security. These are potentially useful analyses because one can often infer how healthy or active a given field is by its publishing activity. For example, there are 2,754 periodicals dedicated to the (very healthy and active) field of physics. This paper concentrates on trade journal versus peer-reviewed journals. Trade journals typically focus on practice-related topics. A paper appropriate for a trade journal is usually based more on practical experience than rigorous studies or research. Models, theories, or rigorous experimental research results will usually not be included. A trade journal typically targets a specific market in an industry or trade. Such journals are often considered to be news magazines and may contain industry specific advertisements and/or job ads. A peer-reviewed journal, a.k.a 'referred journal', in contrast, contains peer-reviewed papers. A peer-reviewed paper is one that has been vetted by the peer review process. In this process, the paper is typically sent to independent experts for review and consideration. A peer-reviewed paper might cover experimental results, and/or a rigorous study, analyses, research efforts, theory, models, or one of many other scholarly endeavors.« less

The use of free online educational resources by Canadian emergency medicine residents and program directors.

PubMed

Purdy, Eve; Thoma, Brent; Bednarczyk, Joseph; Migneault, David; Sherbino, Jonathan

2015-03-01

Introduction Online educational resources (OERs) are increasingly available for emergency medicine (EM) education. This study describes and compares the use of free OERs by the Royal College of Physicians and Surgeons of Canada (RCPSC) EM residents and program directors (PDs) and investigates the relationship between the use of OERs and peer-reviewed literature. A bilingual, online survey was distributed to RCPSC-EM residents and PDs using a modified Dillman method. The chi-square test and Fisher's exact test were used to compare the responses of residents and PDs. The survey was completed by 214/350 (61%) residents and 11/14 (79%) PDs. Free OERs were used by residents most frequently for general EM education (99.5%), procedural skills training (96%), and learning to interpret diagnostic tests (92%). OER modalities used most frequently included wikis (95%), file-sharing websites (95%), e-textbooks (94%), and podcasts (91%). Residents used wikis, podcasts, vodcasts, and file-sharing websites significantly more frequently than PDs. Relative to PDs, residents found entertainment value to be more important for choosing OERs (p<0.01). Some residents (23%) did not feel that literature references were important, whereas all PDs did. Both groups reported that OERs increased the amount of peer-reviewed literature (75% and 60%, respectively) that they read. EM residents make extensive use of OERs and differ from their PDs in the importance that they place on their entertainment value and incorporation of peer-reviewed references. OERs may increase the use of peer-reviewed literature in both groups. Given the prevalence of OER use for core educational goals among RCPSC-EM trainees, future efforts to facilitate critical appraisal and appropriate resource selection are warranted.

Systematic review of management strategies to control chronic wasting disease in wild deer populations in North America.

PubMed

Uehlinger, F D; Johnston, A C; Bollinger, T K; Waldner, C L

2016-08-22

Chronic wasting disease (CWD) is a contagious, fatal prion disease affecting cervids in a growing number of regions across North America. Projected deer population declines and concern about potential spread of CWD to other species warrant strategies to manage this disease. Control efforts to date have been largely unsuccessful, resulting in continuing spread and increasing prevalence. This systematic review summarizes peer-reviewed published reports describing field-applicable CWD control strategies in wild deer populations in North America using systematic review methods. Ten databases were searched for peer-reviewed literature. Following deduplication, relevance screening, full-text appraisal, subject matter expert review and qualitative data extraction, nine references were included describing four distinct management strategies. Six of the nine studies used predictive modeling to evaluate control strategies. All six demonstrated one or more interventions to be effective but results were dependant on parameters and assumptions used in the model. Three found preferential removal of CWD infected deer to be effective in reducing CWD prevalence; one model evaluated a test and slaughter strategy, the other selective removal of infected deer by predators and the third evaluated increased harvest of the sex with highest prevalence (males). Three models evaluated non-selective harvest of deer. There were only three reports that examined primary data collected as part of observational studies. Two of these studies supported the effectiveness of intensive non-selective culling; the third study did not find a difference between areas that were subjected to culling and those that were not. Seven of the nine studies were conducted in the United States. This review highlights the paucity of evaluated, field-applicable control strategies for CWD in wild deer populations. Knowledge gaps in the complex epidemiology of CWD and the intricacies inherent to prion diseases currently pose significant challenges to effective control of this disease in wild deer in North America.

Barriers and attitudes influencing non-engagement in a peer feedback model to inform evidence for GP appraisal

PubMed Central

2012-01-01

Background The UK general practitioner (GP) appraisal system is deemed to be an inadequate source of performance evidence to inform a future medical revalidation process. A long-running voluntary model of external peer review in the west of Scotland provides feedback by trained peers on the standard of GP colleagues' core appraisal activities and may 'add value' in strengthening the robustness of the current system in support of revalidation. A significant minority of GPs has participated in the peer feedback model, but a clear majority has yet to engage with it. We aimed to explore the views of non-participants to identify barriers to engagement and attitudes to external peer review as a means to inform the current appraisal system. Methods We conducted semi-structured interviews with a sample of west of Scotland GPs who had yet to participate in the peer review model. A thematic analysis of the interview transcriptions was conducted using a constant comparative approach. Results 13 GPs were interviewed of whom nine were males. Four core themes were identified in relation to the perceived and experienced 'value' placed on the topics discussed and their relevance to routine clinical practice and professional appraisal: 1. Value of the appraisal improvement activity. 2. Value of external peer review. 3. Value of the external peer review model and host organisation and 4. Attitudes to external peer review. Conclusions GPs in this study questioned the 'value' of participation in the external peer review model and the national appraisal system over the standard of internal feedback received from immediate work colleagues. There was a limited understanding of the concept, context and purpose of external peer review and some distrust of the host educational provider. Future engagement with the model by these GPs is likely to be influenced by policy to improve the standard of appraisal and contractual related activities, rather than a self-directed recognition of learning needs. PMID:22443714

Barriers and attitudes influencing non-engagement in a peer feedback model to inform evidence for GP appraisal.

PubMed

Curnock, Esther; Bowie, Paul; Pope, Lindsey; McKay, John

2012-03-23

The UK general practitioner (GP) appraisal system is deemed to be an inadequate source of performance evidence to inform a future medical revalidation process. A long-running voluntary model of external peer review in the west of Scotland provides feedback by trained peers on the standard of GP colleagues' core appraisal activities and may 'add value' in strengthening the robustness of the current system in support of revalidation. A significant minority of GPs has participated in the peer feedback model, but a clear majority has yet to engage with it. We aimed to explore the views of non-participants to identify barriers to engagement and attitudes to external peer review as a means to inform the current appraisal system. We conducted semi-structured interviews with a sample of west of Scotland GPs who had yet to participate in the peer review model. A thematic analysis of the interview transcriptions was conducted using a constant comparative approach. 13 GPs were interviewed of whom nine were males. Four core themes were identified in relation to the perceived and experienced 'value' placed on the topics discussed and their relevance to routine clinical practice and professional appraisal: 1. Value of the appraisal improvement activity. 2. Value of external peer review. 3. Value of the external peer review model and host organisation and 4. Attitudes to external peer review. GPs in this study questioned the 'value' of participation in the external peer review model and the national appraisal system over the standard of internal feedback received from immediate work colleagues. There was a limited understanding of the concept, context and purpose of external peer review and some distrust of the host educational provider. Future engagement with the model by these GPs is likely to be influenced by policy to improve the standard of appraisal and contractual related activities, rather than a self-directed recognition of learning needs.

Update on Molecular Testing for Cytologically Indeterminate Thyroid Nodules.

PubMed

Nishino, Michiya; Nikiforova, Marina

2018-04-01

- Approximately 15% to 30% of thyroid nodules that undergo fine-needle aspiration are classified as cytologically indeterminate, presenting management challenges for patients and clinicians alike. During the past several years, several molecular tests have been developed to reduce the diagnostic uncertainty of indeterminate thyroid fine-needle aspirations. - To review the methodology, clinical validation, and recent peer-reviewed literature for 4 molecular tests that are currently marketed for cytologically indeterminate thyroid fine-needle aspiration specimens: Afirma, ThyroSeq, ThyGenX/ThyraMIR, and RosettaGX Reveal. - Peer-reviewed literature retrieved from PubMed search, data provided by company websites and representatives, and authors' personal experiences. - The 4 commercially available molecular tests for thyroid cytology offer unique approaches to improve the risk stratification of thyroid nodules. Familiarity with data from the validation studies as well as the emerging literature about test performance in the postvalidation setting can help users to select and interpret these tests in a clinically meaningful way.

Online Peer-to-Peer Support for Young People With Mental Health Problems: A Systematic Review.

PubMed

Ali, Kathina; Farrer, Louise; Gulliver, Amelia; Griffiths, Kathleen M

2015-01-01

Adolescence and early adulthood are critical periods for the development of mental disorders. Online peer-to-peer communication is popular among young people and may improve mental health by providing social support. Previous systematic reviews have targeted Internet support groups for adults with mental health problems, including depression. However, there have been no systematic reviews examining the effectiveness of online peer-to-peer support in improving the mental health of adolescents and young adults. The aim of this review was to systematically identify available evidence for the effectiveness of online peer-to peer support for young people with mental health problems. The PubMed, PsycInfo, and Cochrane databases were searched using keywords and Medical Subject Headings (MeSH) terms. Retrieved abstracts (n=3934) were double screened and coded. Studies were included if they (1) investigated an online peer-to-peer interaction, (2) the interaction discussed topics related to mental health, (3) the age range of the sample was between 12 to 25 years, and (4) the study evaluated the effectiveness of the peer-to-peer interaction. Six studies satisfied the inclusion criteria for the current review. The studies targeted a range of mental health problems including depression and anxiety (n=2), general psychological problems (n=1), eating disorders (n=1), and substance use (tobacco) (n=2). The majority of studies investigated Internet support groups (n=4), and the remaining studies focused on virtual reality chat sessions (n=2). In almost all studies (n=5), the peer support intervention was moderated by health professionals, researchers or consumers. Studies employed a range of study designs including randomized controlled trials (n=3), pre-post studies (n=2) and one randomized trial. Overall, two of the randomized controlled trials were associated with a significant positive outcome in comparison to the control group at post-intervention. In the remaining four studies, peer-to-peer support was not found to be effective. This systematic review identified an overall lack of high-quality studies examining online peer-to-peer support for young people. Given that peer support is frequently used as an adjunct to Internet interventions for a variety of mental health conditions, there is an urgent need to determine the effectiveness of peer support alone as an active intervention.

28 CFR 34.101 - Exceptions to applicability.

Code of Federal Regulations, 2010 CFR

2010-07-01

... Section 34.101 Judicial Administration DEPARTMENT OF JUSTICE OJJDP COMPETITION AND PEER REVIEW PROCEDURES Peer Review § 34.101 Exceptions to applicability. The assistance and procurement contract situations... outside the scope of the section 262(d) peer review requirement as set forth in this subpart. ...

The "peer" in "peer review"

USGS Publications Warehouse

Perry, Gad; Bertoluci, Jaime; Bury, R. Bruce; Hansen, Robert W.; Jehle, Robert; Measey, John; Moon, Brad R.; Muths, Erin L.; Zuffi, Marco A.L.

2011-01-01

Peer review is the best available mechanism for assessing and improving the quality of scientific work. As herpetology broadens its disciplinary and geographic boundaries, high-quality external review is ever more essential. We are writing this editorial jointly because the review process has become increasingly difficult. The resulting delays slow publication times, negatively affect performance reviews, tenure, promotions, and grant proposal success. It harms authors, agencies, and institutions (Ware 2011).

Timely deposition of macromolecular structures is necessary for peer review

DOE Office of Scientific and Technical Information (OSTI.GOV)

Joosten, Robbie P.; Soueidan, Hayssam; Wessels, Lodewyk F. A.

2013-12-01

Deposition of crystallographic structures should be concurrent with or prior to manuscript submission for peer review, enabling validation and increasing reliability of the PDB. Most of the macromolecular structures in the Protein Data Bank (PDB), which are used daily by thousands of educators and scientists alike, are determined by X-ray crystallography. It was examined whether the crystallographic models and data were deposited to the PDB at the same time as the publications that describe them were submitted for peer review. This condition is necessary to ensure pre-publication validation and the quality of the PDB public archive. It was found thatmore » a significant proportion of PDB entries were submitted to the PDB after peer review of the corresponding publication started, and many were only submitted after peer review had ended. It is argued that clear description of journal policies and effective policing is important for pre-publication validation, which is key in ensuring the quality of the PDB and of peer-reviewed literature.« less

Peer Review and Surgical Innovation: Robotic Surgery and Its Hurdles.

PubMed

Vyas, Dinesh; Cronin, Sean

2015-12-01

The peer review processes as outlined in the Health Care Quality Improvement Act (HCQIA) is meant ensure quality standard of care through a self-policing mechanism by the medical community. This process grants immunity for people filing a peer review, which is meant to protect whistleblowers. However, it also creates a loophole that can be used maliciously to hinder competition. This is accentuated when surgeons are integrating new technologies, such as robotic surgery, into their practice. With more than 2000 da Vinci robots in use and more than 300 new units being shipped each year, robotic surgery has become a mainstay in the surgical field. The applications for robots continue to expand as surgeons discover their expanding capability. We need a better peer review process. That ensures the peer review is void of competitive bias. Peer reviewers need to be familiar with the procedure and the technology. The current process could stymie innovation in the name of competition.

Quality Control and Peer Review of Data Sets: Mapping Data Archiving Processes to Data Publication Requirements

NASA Astrophysics Data System (ADS)

Mayernik, M. S.; Daniels, M.; Eaker, C.; Strand, G.; Williams, S. F.; Worley, S. J.

2012-12-01

Data sets exist within scientific research and knowledge networks as both technical and non-technical entities. Establishing the quality of data sets is a multi-faceted task that encompasses many automated and manual processes. Data sets have always been essential for science research, but now need to be more visible as first-class scholarly objects at national, international, and local levels. Many initiatives are establishing procedures to publish and curate data sets, as well as to promote professional rewards for researchers that collect, create, manage, and preserve data sets. Traditionally, research quality has been assessed by peer review of textual publications, e.g. journal articles, conference proceedings, and books. Citation indices then provide standard measures of productivity used to reward individuals for their peer-reviewed work. Whether a similar peer review process is appropriate for assessing and ensuring the quality of data sets remains as an open question. How does the traditional process of peer review apply to data sets? This presentation will describe current work being done at the National Center for Atmospheric Research (NCAR) in the context of the Peer REview for Publication & Accreditation of Research Data in the Earth sciences (PREPARDE) project. PREPARDE is assessing practices and processes for data peer review, with the goal of developing recommendations. NCAR data management teams perform various kinds of quality assessment and review of data sets prior to making them publicly available. The poster will investigate how notions of peer review relate to the types of data review already in place at NCAR. We highlight the data set characteristics and management/archiving processes that challenge the traditional peer review processes by using a number of questions as probes, including: Who is qualified to review data sets? What formal and informal documentation is necessary to allow someone outside of a research team to review a data set? What data set review can be done pre-publication, and what must be done post-publication? What components of the data sets review processes can be automated, and what components will always require human expertise and evaluation?

Tardive Dyskinesia

MedlinePlus

... Supplements Peer Review Process Review Committees Application Support Library Clinical Research Next Steps Pre-Funding: After Review Terms of ... Supplements Peer Review Process Review Committees Application Support Library Clinical Research Next Steps Pre-Funding: After Review Terms of ...

Hemicrania Continua

MedlinePlus

... Supplements Peer Review Process Review Committees Application Support Library Clinical Research Next Steps Pre-Funding: After Review Terms of ... Supplements Peer Review Process Review Committees Application Support Library Clinical Research Next Steps Pre-Funding: After Review Terms of ...

Benign Essential Blepharospasm

MedlinePlus

... Supplements Peer Review Process Review Committees Application Support Library Clinical Research Next Steps Pre-Funding: After Review Terms of ... Supplements Peer Review Process Review Committees Application Support Library Clinical Research Next Steps Pre-Funding: After Review Terms of ...

Doing a Good Deed or Confounding the Problem? Peer Review and Sociology Textbooks.

ERIC Educational Resources Information Center

Kendall, Diana

1999-01-01

Examines how the peer review process influences the writing and publication of sociology textbooks and the teaching of sociology. States that the peer review process may influence the final textbook in five ways: (1) degree of innovation; (2) length; (3) reading level; (4) cloning ancillaries and accessories; and (5) using reviewers as marketing…

Applying Peer Reviews in Software Engineering Education: An Experiment and Lessons Learned

ERIC Educational Resources Information Center

Garousi, V.

2010-01-01

Based on the demonstrated value of peer reviews in the engineering industry, numerous industry experts have listed it at the top of the list of desirable development practices. Experience has shown that problems (defects) are eliminated earlier if a development process incorporates peer reviews and that these reviews are as effective as or even…

Who benefits from peer review? An analysis of the outcome of 100 requests for review by Plastic and Reconstructive Surgery.

PubMed

Loonen, Martijn P J; Hage, J Joris; Kon, Moshe

2005-10-01

Little is known of what is done with the comments on submitted manuscripts provided by peer reviewers or to what extent these comments benefit the editor in deciding to accept or reject the manuscript, the author(s) in revising their manuscript, or the readership at large. Furthermore, nothing is known of any possible benefits of the process to the peer reviewer. Finally, the peer-review process may even be maleficent because of its implicit delay of publication and a possible bias against manuscripts originating from non-Anglo-American countries. The authors evaluated the benefits of the peer-review process to authors, editor, readers, and reviewers by a bibliometric analysis of the outcome of 100 requests for review made by the editor of Plastic and Reconstructive Surgery from 1992 through 2003. The publication delay and potential geographical bias were evaluated as potential disadvantages. The authors' reviewer advised acceptance of 56 percent of the manuscripts, and the editor mostly agreed with his advice. This suggests that the editor benefited from the review. The authors addressed 48 to 81 percent of the reviewer's constructive suggestions, and this suggests that they and the readers benefited also. Readers of Plastic and Reconstructive Surgery may further benefit because manuscripts rejected by Plastic and Reconstructive Surgery end up in less prestigious journals. The implicit delay of publication is limited, and the authors found no bias against non-Anglo-American submissions. The cost-effectiveness of the process for the peer reviewer remains unclear. The peer-review system of Plastic and Reconstructive Surgery, in general, is beneficial.

Peer review of health research funding proposals: A systematic map and systematic review of innovations for effectiveness and efficiency

PubMed Central

Frampton, Geoff K.; Pickett, Karen; Wyatt, Jeremy C.

2018-01-01

Objective To investigate methods and processes for timely, efficient and good quality peer review of research funding proposals in health. Methods A two-stage evidence synthesis: (1) a systematic map to describe the key characteristics of the evidence base, followed by (2) a systematic review of the studies stakeholders prioritised as relevant from the map on the effectiveness and efficiency of peer review ‘innovations’. Standard processes included literature searching, duplicate inclusion criteria screening, study keyword coding, data extraction, critical appraisal and study synthesis. Results A total of 83 studies from 15 countries were included in the systematic map. The evidence base is diverse, investigating many aspects of the systems for, and processes of, peer review. The systematic review included eight studies from Australia, Canada, and the USA, evaluating a broad range of peer review innovations. These studies showed that simplifying the process by shortening proposal forms, using smaller reviewer panels, or expediting processes can speed up the review process and reduce costs, but this might come at the expense of peer review quality, a key aspect that has not been assessed. Virtual peer review using videoconferencing or teleconferencing appears promising for reducing costs by avoiding the need for reviewers to travel, but again any consequences for quality have not been adequately assessed. Conclusions There is increasing international research activity into the peer review of health research funding. The studies reviewed had methodological limitations and variable generalisability to research funders. Given these limitations it is not currently possible to recommend immediate implementation of these innovations. However, many appear promising based on existing evidence, and could be adapted as necessary by funders and evaluated. Where feasible, experimental evaluation, including randomised controlled trials, should be conducted, evaluating impact on effectiveness, efficiency and quality. PMID:29750807

Organised Governmental Learning: Vocational Education and Training Practices between Peer Review and Peer Learning

ERIC Educational Resources Information Center

Speer, Sandra

2011-01-01

Peer learning has already existed for a long time, as an informal as well as a formal practice between people from the same professional area. However, peer learning systems on the macro level are relatively newer concepts. Policy learning can be fostered by various types of organised activities, ranging from peer review frameworks, which often…

The characteristics of national health initiatives promoting earlier cancer diagnosis among adult populations: a systematic review protocol

PubMed Central

Calanzani, Natalia; Weller, David; Campbell, Christine

2017-01-01

Introduction The increasing burden of cancer morbidity and mortality has led to the development of national health initiatives to promote earlier cancer diagnosis and improve cancer survival. This protocol describes a systematic review aiming to identify the evidence about such initiatives among the adult population. We will describe their components, stakeholders and target populations, and summarise their outcomes. Methods and analysis We will search databases and websites for peer-reviewed publications and grey literature on national health initiatives in high-income countries as defined by the World Bank. Quantitative, qualitative and mixed-methods studies will be included and assessed for their methodological quality. Study selection, quality assessment and data extraction will be carried out independently by two reviewers. Narrative synthesis will be used to analyse the findings. Ethics and dissemination This systematic review analyses secondary data and ethical approval is not required. Review findings will be helpful to researchers, policy makers, governments and other key stakeholders developing similar initiatives and assessing cancer outcomes. The results will be submitted to a peer-reviewed journal in order to reach a diverse group of healthcare professionals, researchers and policy makers. This systematic review protocol is registered at PROSPERO (CRD42016047233). PMID:28698336

Peering into peer-review at GigaScience.

PubMed

Edmunds, Scott C

2013-01-24

Fostering and promoting more open and transparent science is one of the goals of GigaScience. One of the ways we have been doing this is by throwing light on the peer-review process and carrying out open peer-review as standard. In this editorial, we provide our rationale for undertaking this policy, give examples of our positive experiences to date, and encourage others to open up the normally opaque publication process.

Two decades of external peer review of cancer care in general hospitals; the Dutch experience.

PubMed

Kilsdonk, Melvin J; Siesling, Sabine; Otter, Rene; van Harten, Wim H

2016-03-01

External peer review was introduced in general hospitals in the Netherlands in 1994 to assess and improve the multidisciplinary team approach in cancer care. This paper aims to explore the value, perceived impact, and (future) role of external peer review in cancer care. Semistructured interviews were held with clinicians, oncology nurses, and managers from fifteen general hospitals that participated in three rounds of peer review over a period of 16 years. Interviewees reflected on the goals and expectations, experiences, perceived impact, and future role of external peer review. Transcriptions of the interviews were coded to discover recurrent themes. Improving clinical care and organization were the main motives for participation. Positive impact was perceived on multiple aspects of care such as shared responsibilities, internal prioritization of cancer care, improved communication, and a clear structure and position of cancer care within general hospitals. Establishing a direct relationship between the external peer review and organizational or clinical impact proved to be difficult. Criticism was raised on the content of the program being too theoretical and organization-focussed after three rounds. According to most stakeholders, external peer review can improve multidisciplinary team work in cancer care; however, the acceptance is threatened by a perceived disbalance between effort and visible clinical impact. Leaner and more clinically focused programs are needed to keep repeated peer reviews challenging and worthwhile. © 2015 The Authors. Cancer Medicine published by John Wiley & Sons Ltd.

Information Quality in Regulatory Decision Making: Peer Review versus Good Laboratory Practice.

PubMed

McCarty, Lynn S; Borgert, Christopher J; Mihaich, Ellen M

2012-07-01

There is an ongoing discussion on the provenance of toxicity testing data regarding how best to ensure its validity and credibility. A central argument is whether journal peer-review procedures are superior to Good Laboratory Practice (GLP) standards employed for compliance with regulatory mandates. We sought to evaluate the rationale for regulatory decision making based on peer-review procedures versus GLP standards. We examined pertinent published literature regarding how scientific data quality and validity are evaluated for peer review, GLP compliance, and development of regulations. Some contend that peer review is a coherent, consistent evaluative procedure providing quality control for experimental data generation, analysis, and reporting sufficient to reliably establish relative merit, whereas GLP is seen as merely a tracking process designed to thwart investigator corruption. This view is not supported by published analyses pointing to subjectivity and variability in peer-review processes. Although GLP is not designed to establish relative merit, it is an internationally accepted quality assurance, quality control method for documenting experimental conduct and data. Neither process is completely sufficient for establishing relative scientific soundness. However, changes occurring both in peer-review processes and in regulatory guidance resulting in clearer, more transparent communication of scientific information point to an emerging convergence in ensuring information quality. The solution to determining relative merit lies in developing a well-documented, generally accepted weight-of-evidence scheme to evaluate both peer-reviewed and GLP information used in regulatory decision making where both merit and specific relevance inform the process.

Environmental Inquiry by College Students: Original Research and Peer Review Using Web-Based Collaborative Tools. Preliminary Quantitative Data Analysis.

ERIC Educational Resources Information Center

Cakir, Mustafa; Carlsen, William S.

The Environmental Inquiry (EI) program (Cornell University and Pennsylvania State University) supports inquiry based, student-centered science teaching on selected topics in the environmental sciences. Texts to support high school student research are published by the National Science Teachers Association (NSTA) in the domains of environmental…

Non-financial conflicts of interest in academic grant evaluation: a qualitative study of multiple stakeholders in France.

PubMed

Abdoul, Hendy; Perrey, Christophe; Tubach, Florence; Amiel, Philippe; Durand-Zaleski, Isabelle; Alberti, Corinne

2012-01-01

Peer review is the most widely used method for evaluating grant applications in clinical research. Criticisms of peer review include lack of equity, suspicion of biases, and conflicts of interest (CoI). CoIs raise questions of fairness, transparency, and trust in grant allocation. Few observational studies have assessed these issues. We report the results of a qualitative study on reviewers' and applicants' perceptions and experiences of CoIs in reviews of French academic grant applications. We designed a qualitative study using semi-structured interviews and direct observation. We asked members of assessment panels, external reviewers, and applicants to participate in semi-structured interviews. Two independent researchers conducted in-depth reviews and line-by-line coding of all transcribed interviews, which were also subjected to Tropes® software text analysis, to detect and qualify themes associated with CoIs. Most participants (73/98) spontaneously reported that non-financial CoIs predominated over financial CoIs. Non-financial CoIs mainly involved rivalry among disciplines, cronyism, and geographic and academic biases. However, none of the participants challenged the validity of peer review. Reviewers who felt they might be affected by CoIs said they reacted in a variety of ways: routine refusal to review, routine attempt to conduct an impartial review, or decision on a case-by-case basis. Multiple means of managing non-financial CoIs were suggested, including increased transparency throughout the review process, with public disclosure of non-financial CoIs, and careful selection of independent reviewers, including foreign experts and methodologists. Our study underscores the importance of considering non-financial CoIs when reviewing research grant applications, in addition to financial CoIs. Specific measures are needed to prevent a negative impact of non-financial CoIs on the fairness of resource allocation. Whether and how public disclosure of non-financial CoIs should be accomplished remains debatable.

The Validity of Peer Review in a General Medicine Journal

PubMed Central

Jackson, Jeffrey L.; Srinivasan, Malathi; Rea, Joanna; Fletcher, Kathlyn E.; Kravitz, Richard L.

2011-01-01

All the opinions in this article are those of the authors and should not be construed to reflect, in any way, those of the Department of Veterans Affairs. Background Our study purpose was to assess the predictive validity of reviewer quality ratings and editorial decisions in a general medicine journal. Methods Submissions to the Journal of General Internal Medicine (JGIM) between July 2004 and June 2005 were included. We abstracted JGIM peer review quality ratings, verified the publication status of all articles and calculated an impact factor for published articles (Rw) by dividing the 3-year citation rate by the average for this group of papers; an Rw>1 indicates a greater than average impact. Results Of 507 submissions, 128 (25%) were published in JGIM, 331 rejected (128 with review) and 48 were either not resubmitted after revision was requested or were withdrawn by the author. Of 331 rejections, 243 were published elsewhere. Articles published in JGIM had a higher citation rate than those published elsewhere (Rw: 1.6 vs. 1.1, p = 0.002). Reviewer quality ratings of article quality had good internal consistency and reviewer recommendations markedly influenced publication decisions. There was no quality rating cutpoint that accurately distinguished high from low impact articles. There was a stepwise increase in Rw for articles rejected without review, rejected after review or accepted by JGIM (Rw 0.60 vs. 0.87 vs. 1.56, p<0.0005). However, there was low agreement between reviewers for quality ratings and publication recommendations. The editorial publication decision accurately discriminated high and low impact articles in 68% of submissions. We found evidence of better accuracy with a greater number of reviewers. Conclusions The peer review process largely succeeds in selecting high impact articles and dispatching lower impact ones, but the process is far from perfect. While the inter-rater reliability between individual reviewers is low, the accuracy of sorting is improved with a greater number of reviewers. PMID:21799867

Appendix G: Peer review nondisclosure agreement

DOE Office of Scientific and Technical Information (OSTI.GOV)

None, None

This peer review nondisclosure agreement should be signed by each reviewer prior to the program sending review materials if sensitive or proprietary information will be provided reviewers or discussed during the review, and to everyone attending a review.

A Review of Peer Social Development in Early Childhood.

ERIC Educational Resources Information Center

Goin, Robin P.

1998-01-01

Reviews the literature on young children's peer social development. Addresses implications of social learning theory and empirical research. Discusses recurring themes, including child/peer versus child/adult interactions, incorporation of toys and games, influence of mothers, and gender peer preferences. Considers areas lacking empirical support…

Do peers matter? A review of peer and/or friends' influence on physical activity among American adolescents.

PubMed

Fitzgerald, Amanda; Fitzgerald, Noelle; Aherne, Cian

2012-08-01

This systematic review investigated the relationship between peer and/or friend variables and physical activity among adolescents by synthesising cross-sectional, longitudinal, and experimental research conducted in the US. Seven electronic databases were searched to identify related articles published within the last 10 years and the articles reviewed included adolescents between 10 and 18 years. Studies reporting a measure of physical activity for adolescents and at least one potential peer and/or friend variable were included. Research demonstrated that peers and friends have an important role to play in the physical activity behavior of adolescents. Six processes were identified through which peers and/or friends may have an influence on physical activity including: peer and/or friend support, presence of peers and friends, peer norms, friendship quality and acceptance, peer crowds, and peer victimization. The theoretical significance of these results is assessed and the development of peer-related physical activity programs for adolescents is discussed. Copyright © 2012 The Foundation for Professionals in Services for Adolescents. Published by Elsevier Ltd. All rights reserved.

[Improving patient safety through voluntary peer review].

PubMed

Kluge, S; Bause, H

2015-01-01

The intensive care unit (ICU) is one area of the hospital in which processes and communication are of primary importance. Errors in intensive care units can lead to serious adverse events with significant consequences for patients. Therefore quality and risk-management are important measures when treating critically ill patients. A pragmatic approach to support quality and safety in intensive care is peer review. This approach has gained significant acceptance over the past years. It consists of mutual visits by colleagues who conduct standardised peer reviews. These reviews focus on the systematic evaluation of the quality of an ICU's structure, its processes and outcome. Together with different associations, the State Chambers of Physicians and the German Medical Association have developed peer review as a standardized tool for quality improvement. The common goal of all stakeholders is the continuous and sustainable improvement in intensive care with peer reviews significantly increasing and improving communication between professions and disciplines. Peer reviews secure the sustainability of planned change processes and consequently lead the way to an improved culture of quality and safety.

A New HIV Prevention Network Approach: Sociometric Peer Change Agent Selection

PubMed Central

Schneider, John A.; Zhou, A. Ning; Laumann, Edward O.

2014-01-01

Internationally, the Peer Change Agent (PCA) model is the most frequently used conceptual framework for HIV prevention. Change agents themselves can be more important than the messages they convey. PCA selection is operationalized via heterogeneous methods based upon individual-level attributes. A sociometric position selection strategy, however, could increase peer influence potency and halt transmission at key network locations. In this study, we selected candidate PCAs based upon relative sociometric bridging and centrality scores and assessed their attributes in comparison to one another and to existing peer educators. We focused upon an emerging HIV epidemic among men who have sex with men in Southern India in 2011. PCAs selected based on their bridging score were more likely to be innovators when compared to other centrally-located PCAs, to PCAs located on the periphery, and to existing peer educators. We also found that sociodemographic attributes and risk behaviors were similar across all candidate PCAs, but risk behaviors of existing peer educators differed. Existing peer educators were more likely to engage in higher risk behavior such as receiving money for sex when compared to sociometrically selected peer changes agents. These existing peer educators were also more likely to exhibit leadership qualities within the overall network; they were, however, just as likely as other non-trained candidate peer change agents to report important HIV intravention behavior (encouraging condoms within their network). The importance of identifying bridges who may be able to diffuse innovation more effectively within high risk HIV networks is especially critical given recent efficacy data from novel HIV prevention interventions such as pre-exposure prophylaxis. Moreover, while existing peer educators were more likely to be leaders in our analysis, using peer educators with high risk behavior may have limited utility in enacting behavior change among sex worker peers or male clients in the network. PMID:24518188

7 CFR 3411.10 - Establishment and operation of peer review groups.

Code of Federal Regulations, 2010 CFR

2010-01-01

...) COOPERATIVE STATE RESEARCH, EDUCATION, AND EXTENSION SERVICE, DEPARTMENT OF AGRICULTURE NATIONAL RESEARCH INITIATIVE COMPETITIVE GRANTS PROGRAM Scientific Peer Review of Research Grant Applications § 3411.10 Establishment and operation of peer review groups. Subject to § 3411.5, the Administrator shall adopt procedures...

7 CFR 3400.10 - Establishment and operation of peer review groups.

Code of Federal Regulations, 2010 CFR

2010-01-01

...) COOPERATIVE STATE RESEARCH, EDUCATION, AND EXTENSION SERVICE, DEPARTMENT OF AGRICULTURE SPECIAL RESEARCH GRANTS PROGRAM Scientific Peer Review of Research Grant Applications § 3400.10 Establishment and operation of peer review groups. Subject to § 3400.5, the Administrator will adopt procedures for the...

42 CFR 52h.5 - Conflict of interest.

Code of Federal Regulations, 2014 CFR

2014-10-01

... Health PUBLIC HEALTH SERVICE, DEPARTMENT OF HEALTH AND HUMAN SERVICES GRANTS SCIENTIFIC PEER REVIEW OF...) This section applies only to conflicts of interest involving members of peer review groups. This... Executive Order 11222, as amended. For those federal employees serving on peer review groups, in accordance...

42 CFR 52h.5 - Conflict of interest.

Code of Federal Regulations, 2013 CFR

2013-10-01

... Health PUBLIC HEALTH SERVICE, DEPARTMENT OF HEALTH AND HUMAN SERVICES GRANTS SCIENTIFIC PEER REVIEW OF...) This section applies only to conflicts of interest involving members of peer review groups. This... Executive Order 11222, as amended. For those federal employees serving on peer review groups, in accordance...

42 CFR 52h.5 - Conflict of interest.

Code of Federal Regulations, 2012 CFR

2012-10-01

... Health PUBLIC HEALTH SERVICE, DEPARTMENT OF HEALTH AND HUMAN SERVICES GRANTS SCIENTIFIC PEER REVIEW OF...) This section applies only to conflicts of interest involving members of peer review groups. This... Executive Order 11222, as amended. For those federal employees serving on peer review groups, in accordance...

Psychopathic traits moderate peer influence on adolescent delinquency.

PubMed

Kerr, Margaret; Van Zalk, Maarten; Stattin, Håkan

2012-08-01

Peer influence on adolescent delinquency is well established, but little is known about moderators of peer influence. In this study, we examined adolescents' (targets) and their peers' psychopathic personality traits as moderators of peer influence on delinquency in peer networks. We used three separate dimensions of the psychopathic personality: grandiose-manipulative traits, callous-unemotional traits, and impulsive-irresponsible traits. We used a peer network approach with five waves of longitudinal data from 847 adolescents in one community. Peer nominations were not limited to the school context, thus allowing us to capture all potentially important peers. In addition, peers reported on their own delinquency, thus allowing us to avoid problems of false consensus or projection that arise when individuals report on their peers' delinquency. We used simulation investigation for empirical network analyses (SIENA), which is the only program currently available that can be used to study peer influence effects in peer networks of multiple relationships while controlling for selection effects. Targets' and peers' callous-unemotional and grandiose-manipulative traits uniquely moderated peer influence on delinquency. Relative to those with low levels, targets who were high on these traits were less influenced by peers' delinquency, and peers who were high on these traits were more influential on targets' delinquency. Selection effects were found for impulsive-irresponsible traits, but these traits did not moderate peer influence on delinquency. As the first study to look at moderating effects of psychopathic traits on peer influence, this study advances knowledge about peer influence on delinquency and about psychopathic traits in adolescents. In addition, the study contributes to the literature by looking at unique effects of the three dimensions of psychopathy and taking a peer network approach, in which network effects, self-selection, and other selection effects are controlled when examining influence and moderators of influence. © 2011 The Authors. Journal of Child Psychology and Psychiatry © 2011 Association for Child and Adolescent Mental Health.

Can editors save peer review from peer reviewers?

PubMed

D'Andrea, Rafael; O'Dwyer, James P

2017-01-01

Peer review is the gold standard for scientific communication, but its ability to guarantee the quality of published research remains difficult to verify. Recent modeling studies suggest that peer review is sensitive to reviewer misbehavior, and it has been claimed that referees who sabotage work they perceive as competition may severely undermine the quality of publications. Here we examine which aspects of suboptimal reviewing practices most strongly impact quality, and test different mitigating strategies that editors may employ to counter them. We find that the biggest hazard to the quality of published literature is not selfish rejection of high-quality manuscripts but indifferent acceptance of low-quality ones. Bypassing or blacklisting bad reviewers and consulting additional reviewers to settle disagreements can reduce but not eliminate the impact. The other editorial strategies we tested do not significantly improve quality, but pairing manuscripts to reviewers unlikely to selfishly reject them and allowing revision of rejected manuscripts minimize rejection of above-average manuscripts. In its current form, peer review offers few incentives for impartial reviewing efforts. Editors can help, but structural changes are more likely to have a stronger impact.

o'Peer: open peer review

NASA Astrophysics Data System (ADS)

Brewer, J. H.

2014-12-01

I have built a "demonstration" website at http://oPeer.org to illustrate how peer review and publication might be improved relative to the current model, which was designed and implemented in an era when scientific communication was either face-to-face or relied upon human delivery of ink marks on dead trees.

Protocol for a systematic review of instruments for the assessment of quality of life and well-being in children and adolescents with cerebral palsy.

PubMed

Mpundu-Kaambwa, Christine; Chen, Gang; Huynh, Elisabeth; Russo, Remo; Ratcliffe, Julie

2017-09-11

Cerebral palsy is the most common cause of physical disability in children and adolescents and is associated with impairments that may reduce the quality of life (QOL) of this population. Patient-reported outcome measures (PROMs) can facilitate the assessment of the effect of disease and treatment on QOL, from a patient viewpoint. The purpose of this systematic review is to identify PROMs that are used to measure QOL and subjective well-being (SWB) outcomes in young people with cerebral palsy and to evaluate the suitability of these PROMs for application in economic evaluations within this population. MEDLINE, Scopus, the Cochrane Library, Web of Science Core Collection, EconLit, PsycINFO, CINAHL, EMBASE and Informit will be systematically searched from inception to date of search. Published peer-reviewed, English-language articles reporting PROMs measuring QOL or SWB outcomes in children and adolescents with cerebral palsy will be included. One reviewer will conduct the initial search and screen titles and abstracts for potentially eligible studies. The search will be performed in November 2017. To reduce the likelihood of reviewer selection bias, two other reviewers will independently screen a randomly selected subsample (10%) of the citations. Two reviewers will then retrieve full texts of potentially eligible studies and assess them against predefined inclusion criteria. The suitability of selected PROMs for use in economic evaluations of young people with cerebral palsy will be assessed using the International Society of Quality of Life Research recommended Minimum Standards and the Patient-Centered Outcomes and Comparative Effectiveness Research checklist. A narrative synthesis of extracted data will be presented including study descriptive data, PROMs measurement properties, settings in which they were applied and the valuation methods. Recommendations for practice on the selection of PROMs for use in economic evaluations of children and adolescents with cerebral palsy will be presented. Ethical approval is not required as the proposed systematic review will not use primary data. The results of this study will be widely disseminated through publication in a peer-reviewed journal and conference presentation(s). International Prospective Register of Systematic Reviews number: CRD42016049746. © Article author(s) (or their employer(s) unless otherwise stated in the text of the article) 2017. All rights reserved. No commercial use is permitted unless otherwise expressly granted.

Voluntary peer review as innovative tool for quality improvement in the intensive care unit – a retrospective descriptive cohort study in German intensive care units

PubMed Central

Kumpf, Oliver; Bloos, Frank; Bause, Hanswerner; Brinkmann, Alexander; Deja, Maria; Marx, Gernot; Kaltwasser, Arnold; Dubb, Rolf; Muhl, Elke; Greim, Clemens-A.; Weiler, Norbert; Chop, Ines; Jonitz, Günther; Schaefer, Henning; Felsenstein, Matthias; Liebeskind, Ursula; Leffmann, Carsten; Jungbluth, Annemarie; Waydhas, Christian; Pronovost, Peter; Spies, Claudia; Braun, Jan-Peter

2014-01-01

Introduction: Quality improvement and safety in intensive care are rapidly evolving topics. However, there is no gold standard for assessing quality improvement in intensive care medicine yet. In 2007 a pilot project in German intensive care units (ICUs) started using voluntary peer reviews as an innovative tool for quality assessment and improvement. We describe the method of voluntary peer review and assessed its feasibility by evaluating anonymized peer review reports and analysed the thematic clusters highlighted in these reports. Methods: Retrospective data analysis from 22 anonymous reports of peer reviews. All ICUs – representing over 300 patient beds – had undergone voluntary peer review. Data were retrieved from reports of peers of the review teams and representatives of visited ICUs. Data were analysed with regard to number of topics addressed and results of assessment questionnaires. Reports of strengths, weaknesses, opportunities and threats (SWOT reports) of these ICUs are presented. Results: External assessment of structure, process and outcome indicators revealed high percentages of adherence to predefined quality goals. In the SWOT reports 11 main thematic clusters were identified representative for common ICUs. 58.1% of mentioned topics covered personnel issues, team and communication issues as well as organisation and treatment standards. The most mentioned weaknesses were observed in the issues documentation/reporting, hygiene and ethics. We identified several unique patterns regarding quality in the ICU of which long-term personnel problems und lack of good reporting methods were most interesting Conclusion: Voluntary peer review could be established as a feasible and valuable tool for quality improvement. Peer reports addressed common areas of interest in intensive care medicine in more detail compared to other methods like measurement of quality indicators. PMID:25587245

Voluntary peer review as innovative tool for quality improvement in the intensive care unit--a retrospective descriptive cohort study in German intensive care units.

PubMed

Kumpf, Oliver; Bloos, Frank; Bause, Hanswerner; Brinkmann, Alexander; Deja, Maria; Marx, Gernot; Kaltwasser, Arnold; Dubb, Rolf; Muhl, Elke; Greim, Clemens-A; Weiler, Norbert; Chop, Ines; Jonitz, Günther; Schaefer, Henning; Felsenstein, Matthias; Liebeskind, Ursula; Leffmann, Carsten; Jungbluth, Annemarie; Waydhas, Christian; Pronovost, Peter; Spies, Claudia; Braun, Jan-Peter

2014-01-01

Quality improvement and safety in intensive care are rapidly evolving topics. However, there is no gold standard for assessing quality improvement in intensive care medicine yet. In 2007 a pilot project in German intensive care units (ICUs) started using voluntary peer reviews as an innovative tool for quality assessment and improvement. We describe the method of voluntary peer review and assessed its feasibility by evaluating anonymized peer review reports and analysed the thematic clusters highlighted in these reports. Retrospective data analysis from 22 anonymous reports of peer reviews. All ICUs - representing over 300 patient beds - had undergone voluntary peer review. Data were retrieved from reports of peers of the review teams and representatives of visited ICUs. Data were analysed with regard to number of topics addressed and results of assessment questionnaires. Reports of strengths, weaknesses, opportunities and threats (SWOT reports) of these ICUs are presented. External assessment of structure, process and outcome indicators revealed high percentages of adherence to predefined quality goals. In the SWOT reports 11 main thematic clusters were identified representative for common ICUs. 58.1% of mentioned topics covered personnel issues, team and communication issues as well as organisation and treatment standards. The most mentioned weaknesses were observed in the issues documentation/reporting, hygiene and ethics. We identified several unique patterns regarding quality in the ICU of which long-term personnel problems und lack of good reporting methods were most interesting Conclusion: Voluntary peer review could be established as a feasible and valuable tool for quality improvement. Peer reports addressed common areas of interest in intensive care medicine in more detail compared to other methods like measurement of quality indicators.

Three decades of disasters: a review of disaster-specific literature from 1977-2009.

PubMed

Smith, Erin; Wasiak, Jason; Sen, Ayan; Archer, Frank; Burkle, Frederick M

2009-01-01

The potential for disasters exists in all communities. To mitigate the potential catastrophes that confront humanity in the new millennium, an evidence-based approach to disaster management is required urgently. This study moves toward such an evidence-based approach by identifying peer-reviewed publications following a range of disasters and events over the past three decades. Peer-reviewed, event-specific literature was identified using a comprehensive search of the electronically indexed database, MEDLINE (1956-January 2009). An extended comprehensive search was conducted for one event to compare the event-specific literature indexed in MEDLINE to other electronic databases (EMBASE, CINAHL, AMED, CENTRAL, Psych Info, Maternity and Infant Care, EBM Reviews). Following 25 individual disasters or overwhelming crises, a total of 2,098 peer-reviewed, event-specific publications were published in 789 journals (652 publications following disasters/events caused by natural hazards, 966 following human-made/technological disasters/events, and 480 following conflict/complex humanitarian events).The event with the greatest number of peer-reviewed, event-specific publications was the 11 September 2001 terrorist attacks (686 publications). Prehospital and Disaster Medicine published the greatest number of peer-reviewed, event-specific publications (54), followed by Journal of Traumatic Stress (42), Military Medicine (40), and Psychiatric Services (40). The primary topics of event-specific publications were mental health, medical health, and response. When an extended, comprehensive search was conducted for one event, 75% of all peer-reviewed, event-specific publications were indexed in MEDLINE. A broad range of multi-disciplinary journals publish peer reviewed, event-specific publications. While the majority of peer-reviewed, event-specific literature is indexed in MEDLINE, comprehensive search strategies should include EMBASE to increase yield.

Non-Financial Conflicts of Interest in Academic Grant Evaluation: A Qualitative Study of Multiple Stakeholders in France

PubMed Central

Abdoul, Hendy; Perrey, Christophe; Tubach, Florence; Amiel, Philippe; Durand-Zaleski, Isabelle; Alberti, Corinne

2012-01-01

Background Peer review is the most widely used method for evaluating grant applications in clinical research. Criticisms of peer review include lack of equity, suspicion of biases, and conflicts of interest (CoI). CoIs raise questions of fairness, transparency, and trust in grant allocation. Few observational studies have assessed these issues. We report the results of a qualitative study on reviewers’ and applicants’ perceptions and experiences of CoIs in reviews of French academic grant applications. Methodology and Principal Findings We designed a qualitative study using semi-structured interviews and direct observation. We asked members of assessment panels, external reviewers, and applicants to participate in semi-structured interviews. Two independent researchers conducted in-depth reviews and line-by-line coding of all transcribed interviews, which were also subjected to Tropes® software text analysis, to detect and qualify themes associated with CoIs. Most participants (73/98) spontaneously reported that non-financial CoIs predominated over financial CoIs. Non-financial CoIs mainly involved rivalry among disciplines, cronyism, and geographic and academic biases. However, none of the participants challenged the validity of peer review. Reviewers who felt they might be affected by CoIs said they reacted in a variety of ways: routine refusal to review, routine attempt to conduct an impartial review, or decision on a case-by-case basis. Multiple means of managing non-financial CoIs were suggested, including increased transparency throughout the review process, with public disclosure of non-financial CoIs, and careful selection of independent reviewers, including foreign experts and methodologists. Conclusions Our study underscores the importance of considering non-financial CoIs when reviewing research grant applications, in addition to financial CoIs. Specific measures are needed to prevent a negative impact of non-financial CoIs on the fairness of resource allocation. Whether and how public disclosure of non-financial CoIs should be accomplished remains debatable. PMID:22496913

Reflections of a CHAMPUS-APA peer reviewer.

PubMed

Parlour, R R

1986-02-01

Peer review is a major professional response to the problems of health insurance coverage for psychiatric services. Standard insurance programs reimburse only services that are conventional and cost-effective. The system assumes that services are skillfully documented by providers. Experience as a peer reviewer helps clinicians acquire skill in documentation.

Marketing Academics' Perceptions of the Peer Review Process

ERIC Educational Resources Information Center

Bailey, Charles D.; Hair, Joe F.; Hermanson, Dana R.; Crittenden, Victoria L.

2012-01-01

Publication in refereed journals is critical to career success for most marketing faculty members, and the peer review process is the gatekeeper for a refereed journal. The study reported here examines marketing academics' perceptions of this peer review process. Based on responses from 653 marketing academics, we find favorable overall…

The Neuroscience Peer Review Consortium

PubMed Central

Saper, Clifford B; Maunsell, John HR

2009-01-01

As the Neuroscience Peer Review Consortium (NPRC) ends its first year, it is worth looking back to see how the experiment has worked. In order to encourage dissemination of the details outlined in this Editorial, it will also be published in other journals in the Neuroscience Peer Review Consortium. PMID:19284614

42 CFR 24.5 - Peer review.

Code of Federal Regulations, 2014 CFR

2014-10-01

... 42 Public Health 1 2014-10-01 2014-10-01 false Peer review. 24.5 Section 24.5 Public Health PUBLIC HEALTH SERVICE, DEPARTMENT OF HEALTH AND HUMAN SERVICES PERSONNEL SENIOR BIOMEDICAL RESEARCH SERVICE § 24.5 Peer review. An individual may not be considered for appointment into the SBRS unless his/her...

42 CFR 24.5 - Peer review.

Code of Federal Regulations, 2012 CFR

2012-10-01

... 42 Public Health 1 2012-10-01 2012-10-01 false Peer review. 24.5 Section 24.5 Public Health PUBLIC HEALTH SERVICE, DEPARTMENT OF HEALTH AND HUMAN SERVICES PERSONNEL SENIOR BIOMEDICAL RESEARCH SERVICE § 24.5 Peer review. An individual may not be considered for appointment into the SBRS unless his/her...

42 CFR 24.5 - Peer review.

Code of Federal Regulations, 2013 CFR

2013-10-01

... 42 Public Health 1 2013-10-01 2013-10-01 false Peer review. 24.5 Section 24.5 Public Health PUBLIC HEALTH SERVICE, DEPARTMENT OF HEALTH AND HUMAN SERVICES PERSONNEL SENIOR BIOMEDICAL RESEARCH SERVICE § 24.5 Peer review. An individual may not be considered for appointment into the SBRS unless his/her...

42 CFR 24.5 - Peer review.

Code of Federal Regulations, 2011 CFR

2011-10-01

... 42 Public Health 1 2011-10-01 2011-10-01 false Peer review. 24.5 Section 24.5 Public Health PUBLIC HEALTH SERVICE, DEPARTMENT OF HEALTH AND HUMAN SERVICES PERSONNEL SENIOR BIOMEDICAL RESEARCH SERVICE § 24.5 Peer review. An individual may not be considered for appointment into the SBRS unless his/her...

78 FR 63795 - Endangered and Threatened Wildlife and Plants; Determination of Endangered Status for Chromolaena...

Federal Register 2010, 2011, 2012, 2013, 2014

2013-10-24

... responses. The peer reviewers generally concurred with our methods and conclusions, and they provided... corallicola, and Harrisia aboriginum. The peer reviewers generally concurred with our methods and conclusions... discussion, below. (6) Comment: One peer reviewer provided research findings on the seed longevity and...

Peer Review Undergoing Revitalization

ERIC Educational Resources Information Center

Sawchuk, Stephen

2009-01-01

Established in the 142,000-student Montgomery County, Maryland, district in 1999, peer assistance and review (PAR)--or "peer review," as it is occasionally called--is actually an old idea. In 1981, the then-president of the Toledo Federation of Teachers, Dal Lawrence, helped create the first PAR program. Almost 30 years later, only a…

Peer-review: An IOP Publishing Perspective

NASA Astrophysics Data System (ADS)

Smith, Timothy

2015-03-01

Online publishing is challenging, and potentially changing, the role of publishers in both managing the peer-review process and disseminating the work that they publish in meeting contrasting needs from diverse groups of research communities. Recognizing the value of peer-review as a fundamental service to authors and the research community, the underlying principles of managing the process for journals published by IOP Publishing remain unchanged and yet the potential and demand for alternative models exists. This talk will discuss the traditional approach to peer-review placed in the context of this changing demand.

The objective impact of clinical peer review on hospital quality and safety.

PubMed

Edwards, Marc T

2011-01-01

Despite its importance, the objective impact of clinical peer review on the quality and safety of care has not been studied. Data from 296 acute care hospitals show that peer review program and related organizational factors can explain up to 18% of the variation in standardized measures of quality and patient safety. The majority of programs rely on an outmoded and dysfunctional process model. Adoption of best practices informed by the continuing study of peer review program effectiveness has the potential to significantly improve patient outcomes.

Incidence of neonatal necrotising enterocolitis in high-income countries: a systematic review.

PubMed

Battersby, Cheryl; Santhalingam, Tharsika; Costeloe, Kate; Modi, Neena

2018-03-01

To conduct a systematic review of neonatal necrotising enterocolitis (NEC) rates in high-income countries published in peer-reviewed journals. We searched MEDLINE, Embase and PubMed databases for observational studies published in peer-reviewed journals. We selected studies reporting national, regional or multicentre rates of NEC in 34 Organisation for Economic Co-operation and Development countries. Two investigators independently screened studies against predetermined criteria. For included studies, we extracted country, year of publication in peer-reviewed journal, study time period, study population inclusion and exclusion criteria, case definition, gestation or birth weight-specific NEC and mortality rates. Of the 1888 references identified, 120 full manuscripts were reviewed, 33 studies met inclusion criteria, 14 studies with the most recent data from 12 countries were included in the final analysis. We identified an almost fourfold difference, from 2% to 7%, in the rate of NEC among babies born <32 weeks' gestation and an almost fivefold difference, from 5% to 22%, among those with a birth weight <1000 g but few studies covered the entire at-risk population. The most commonly applied definition was Bell's stage ≥2, which was used in seven studies. Other definitions included Bell's stage 1-3, definitions from the Centers for Disease Control and Prevention, International Classification for Diseases and combinations of clinical and radiological signs as specified by study authors. The reasons for international variation in NEC incidence are an important area for future research. Reliable inferences require clarity in defining population coverage and consistency in the case definition applied. PROSPERO INTERNATIONAL PROSPECTIVE REGISTER OF SYSTEMATIC REVIEWS REGISTRATION NUMBER: CRD42015030046. © Article author(s) (or their employer(s) unless otherwise stated in the text of the article) 2018. All rights reserved. No commercial use is permitted unless otherwise expressly granted.

Advancing oral health policy and advocacy to prevent childhood obesity and reduce children's consumption of sugar-sweetened beverages.

PubMed

Sanghavi, Ankit; Siddiqui, Nadia J

2017-06-01

While a large body of work documents the interconnections between oral health and obesity, less is known about the role that oral health professionals and organizations play to prevent childhood obesity, especially by influencing children's consumption of sugar-sweetened beverages (SSBs). This review identifies efforts by oral health professionals and organizations to influence such policy and advocacy, while informing future opportunities to leverage and expand on existing efforts. A scoping review of peer-reviewed literature and a web-based review of oral health policy and advocacy initiatives addressing prevention of obesity and reducing children's consumption of SSBs were conducted. Of 30 unique references identified, four peer-reviewed and seven non-peer-reviewed references met selection criteria. Qualitative and quantitative data were extracted using a priori determined headings. Findings suggest a strong role for oral health professionals in preventing childhood obesity and reducing children's consumption of SSBs; however, only a few national, state, and local oral-health-advocacy and -policy efforts were identified, such as policy statements by national associations, state and local education campaigns, and clinical guidelines. Evidence was limited on the role of oral health professionals in influencing broader communitywide advocacy and policy efforts such as soda taxation and limiting SSB consumption in schools. This review provides an emerging evidence base to support growing recognition among oral health professionals of their dual role in preventing childhood obesity and dental caries by targeting SSB consumption. It also identifies opportunities for oral health professionals to build on initial efforts to more proactively influence future policy and advocacy. © 2017 American Association of Public Health Dentistry.

Identifying and Remediating Student Misconceptions in Introductory Biology via Writing-to-Learn Assignments and Peer Review.

PubMed

Halim, Audrey S; Finkenstaedt-Quinn, Solaire A; Olsen, Laura J; Gere, Anne Ruggles; Shultz, Ginger V

2018-06-01

Student misconceptions are an obstacle in science, technology, engineering, and mathematics courses and unless remediated may continue causing difficulties in learning as students advance in their studies. Writing-to-learn assignments (WTL) are characterized by their ability to promote in-depth conceptual learning by allowing students to explore their understanding of a topic. This study sought to determine whether and what types of misconceptions are elicited by WTL assignments and how the process of peer review and revision leads to remediation or propagation of misconceptions. We examined four WTL assignments in an introductory biology course in which students first wrote about content by applying it to a realistic scenario, then participated in a peer-review process before revising their work. Misconceptions were identified in all four assignments, with the greatest number pertaining to protein structure and function. Additionally, in certain contexts, students used scientific terminology incorrectly. Analysis of the drafts and peer-review comments generated six profiles by which misconceptions were addressed through the peer-review process. The prevalent mode of remediation arose through directed peer-review comments followed by correction during revision. It was also observed that additional misconceptions were elicited as students revised their writing in response to general peer-review suggestions.

Peering into peer-review at GigaScience

PubMed Central

2013-01-01

Fostering and promoting more open and transparent science is one of the goals of GigaScience. One of the ways we have been doing this is by throwing light on the peer-review process and carrying out open peer-review as standard. In this editorial, we provide our rationale for undertaking this policy, give examples of our positive experiences to date, and encourage others to open up the normally opaque publication process. PMID:23587291

Data bank has operational impact. Proper peer review can protect hospitals from antitrust and defamation suits.

PubMed

Purtell, D L

1990-11-01

The Health Care Quality Improvement Act of 1986 can help protect medical professionals and healthcare facilities from antitrust and defamation claims and other forms of litigation arising from the peer review process. Some hospitals may need to make major changes in their peer review activity as a result of the act. The healthcare entity, not the physicians involved in peer review, has the burden of complying with the provisions of the act. Failure to comply with the act can lead to loss of immunity from damages, fines, and potential exclusion from the Medicare program. The potential for liability has sparked a need for hospitals to reexamine and possibly reorganize medical staff and update procedures and related governing documents. Healthcare entities may consider changes such as implementing a director of medical affairs function, choosing medical staff for multiple-year terms, and centralizing physician review files. In the 1980s many hospitals created quality assurance and risk management programs. Risk managers need to share data with quality assurance personnel, who must in turn share the information with medical staff involved with credentialing, peer review, and medical affairs management. Legal counsel will need to be familiar with the legalities of the act, as well as the hospital's peer review procedures and operations. General legal counsel should oversee coordination of hospital proceedings and assist in educating staff on the legalities of peer review.

Peer Network Drinking Predicts Increased Alcohol Use From Adolescence to Early Adulthood After Controlling for Genetic and Shared Environmental Selection

PubMed Central

Cruz, Jennifer E.; Emery, Robert E.; Turkheimer, Eric

2013-01-01

Research consistently links adolescents' and young adults' drinking with their peers' alcohol intake. In interpreting this correlation, 2 essential questions are often overlooked. First, which peers are more important, best friends or broader social networks? Second, do peers cause increased drinking, or do young people select friends whose drinking habits match their own? The present study combines social network analyses with family (twin and sibling) designs to answer these questions via data from the National Longitudinal Study of Adolescent Health. Analysis of peer nomination data from 134 schools (n = 82,629) and 1,846 twin and sibling pairs shows that peer network substance use predicts changes in drinking from adolescence into young adult life even after controlling for genetic and shared environmental selection, as well as best friend substance use. This effect was particularly strong for high-intensity friendships. Although the peer-adolescent drinking correlation is partially explained by selection, the present finding offers powerful evidence that peers also cause increased drinking. PMID:22390657

Clinical peer review program self-evaluation for US hospitals.

PubMed

Edwards, Marc T

2010-01-01

Prior research has shown wide variation in clinical peer review program structure, process, governance, and perceived effectiveness. This study sought to validate the utility of a Peer Review Program Self-Evaluation Tool as a potential guide to physician and hospital leaders seeking greater program value. Data from 330 hospitals show that the total score from the self-evaluation tool is strongly associated with perceived quality impact. Organizational culture also plays a significant role. When controlling for these factors, there was no evidence of benefit from a multispecialty review process. Physicians do not generally use reliable methods to measure clinical performance. A high rate of change since 2007 has not produced much improvement. The Peer Review Program Self-Evaluation Tool reliably differentiates hospitals along a continuum of perceived program performance. The full potential of peer review as a process to improve the quality and safety of care has yet to be realized.

Variability of Reviewers' Comments in the Peer Review Process for Orthopaedic Research.

PubMed

Iantorno, Stephanie E; Andras, Lindsay M; Skaggs, David L

2016-07-01

Retrospective analysis of peer review comments. To assess the likelihood that comments provided by peer reviewers of one orthopaedic journal would be similar to comments of reviewers from the same journal and a second journal. The consistency of the peer review process in orthopedic research has not been objectively examined. Nine separate clinical papers related to spinal deformity were submitted for publication in major peer-reviewed journals and initially rejected. The exact same manuscripts were then submitted to different journals. All papers were returned with comments from two to three reviewers from each journal. Reviews were divided into distinct conceptual criticisms that were regarded as separate comments. Comments were compared between reviewers of the same journal and to comments from reviewers of the second journal. When comparing comments from reviewers of the same journal, an average of 11% of comments were repeated (range 0% [0/12] to 23% [3/13]). On average, 20% of comments from the first journal were repeated by a reviewer at the second journal (range 10% [1/10] to 33% [6/18]). If a comment was made by two or more reviewers from the first journal, it had a higher likelihood (43% [6/14]) of being repeated by a reviewer from the second journal. When an identical manuscript is submitted to a second journal after being rejected, 80% of peer review comments from the first journal are not repeated by reviewers from the second journal. One may question if addressing every peer review comment in a rejected manuscript prior to resubmission is an efficient use of resources. Comments that appear twice or more in the first journal review are more likely to reappear and may warrant special attention from the researcher. Level IV. Copyright © 2016 Scoliosis Research Society. Published by Elsevier Inc. All rights reserved.

Directly Improving the Quality of Radiation Treatment Through Peer Review: A Cross-sectional Analysis of Cancer Centers Across a Provincial Cancer Program.

PubMed

Rouette, Julie; Gutierrez, Eric; O'Donnell, Jennifer; Reddeman, Lindsay; Hart, Margaret; Foxcroft, Sophie; Mitera, Gunita; Warde, Padraig; Brundage, Michael D

2017-07-01

To describe the outcomes of peer review across all 14 cancer centers in Ontario. We identified all peer-reviewed, curative treatment plans delivered in Ontario within a 3-month study period from 2013 to 2014 using a provincial cancer treatment database and collected additional data on the peer-review outcomes. Considerable variation was found in the proportion of peer-reviewed plans across the centers (average 70.2%, range 40.8%-99.2%). During the study period, 5561 curative plans underwent peer review. Of those, 184 plans (3.3%) had changes recommended. Of the 184 plans, the changes were major (defined as requiring repeat planning or having a major effect on planning or clinical outcomes, or both) in 40.2% and minor in 47.8%. For the remaining 12.0%, data were missing. The proportions of recommended changes varied among disease sites (0.0%-7.0%). The disease sites with the most recommended changes to treatment plans after peer review and with the greatest potential for benefit were the esophagus (7.0%), uterus (6.7%), upper limb (6.3%), cervix and lower limb (both 6.0%), head and neck and bilateral lung (both 5.9%), right supraclavicular lymph nodes (5.7%), rectum (5.3%), and spine (5.0%). Although the heart is an organ at risk in left-sided breast treatment plans, the proportions of recommended changes did not significantly differ between the left breast treatment plans (3.0%, 95% confidence interval 2.0%-4.5%) and right breast treatment plans (2.4%, 95% confidence interval 1.5%-3.8%). The recommended changes were more frequently made when peer review occurred before radiation therapy (3.8%) than during treatment (1.4%-2.8%; P=.0048). The proportion of plans with recommended changes was not significantly associated with patient volume (P=.23), peer-review performance (P=.36), or center academic status (P=.75). Peer review of treatment plans directly affects the quality of care by identifying important clinical and planning changes. Provincial strategies are underway to optimize its conduct in radiation oncology. Copyright © 2016. Published by Elsevier Inc.

Highlights in asthma 2005.

PubMed

Heraghty, J L; Henderson, A J

2006-05-01

It is usual at the end of a year for top tens to feature large in our collective consciousness. These inevitably include the occasional controversial selection and without fail will overlook a number of gems, whether in the field of literature, art, or science. The approaches to such compilations include personal selections, convening expert committees through to letting the market decide. However, it is well recognised that experts can be wrong and markets distorted. A novel approach to identifying the key publications in the field of medicine, Faculty of 1000 Medicine (http://www.f1000medicine.com), uses faculty evaluations to assign ratings to published papers within topics and categories, bringing a flavour of the dynamism of post hoc peer review to biological sciences that exists in other fields of scholarship. Archives of Disease in Childhood has also developed a market led system of peer evaluation through its web based top ten most read articles feature.

Alternatives to Peer Review: Novel Approaches for Research Evaluation

PubMed Central

Birukou, Aliaksandr; Wakeling, Joseph Rushton; Bartolini, Claudio; Casati, Fabio; Marchese, Maurizio; Mirylenka, Katsiaryna; Osman, Nardine; Ragone, Azzurra; Sierra, Carles; Wassef, Aalam

2011-01-01

In this paper we review several novel approaches for research evaluation. We start with a brief overview of the peer review, its controversies, and metrics for assessing efficiency and overall quality of the peer review. We then discuss five approaches, including reputation-based ones, that come out of the research carried out by the LiquidPub project and research groups collaborated with LiquidPub. Those approaches are alternative or complementary to traditional peer review. We discuss pros and cons of the proposed approaches and conclude with a vision for the future of the research evaluation, arguing that no single system can suit all stakeholders in various communities. PMID:22174702

IRIS Toxicological Review of Libby Amphibole Asbestos ...

EPA Pesticide Factsheets

On August 25, 2011, the draft Toxicological Review of Libby Amphibole Asbestos and the charge to external peer reviewers were released for external peer review and public comment. The Toxicological Review and charge were reviewed internally by EPA and by other federal agencies and White House Offices before public release. In the new IRIS process (May 2009), introduced by the EPA Administrator, all written comments on IRIS assessments submitted by other federal agencies and White House Offices will be made publicly available. Accordingly, interagency comments and the interagency science consultation draft of the IRIS Toxicological Review of Libby Amphibole Asbestos and the charge to external peer reviewers are posted on this site. The project supports OSWER and Region 8 site clean-up and related risk management initiatives at this Superfund site. As with all IRIS assessments, the draft document will undergo agency review, OMB/interagency review and independent external peer review before being included on the IRIS data base.

Enhancing the role of case-oriented peer review to improve quality and safety in radiation oncology: Executive summary

PubMed Central

Marks, Lawrence B.; Adams, Robert D.; Pawlicki, Todd; Blumberg, Albert L.; Hoopes, David; Brundage, Michael D.; Fraass, Benedick A.

2013-01-01

This report is part of a series of white papers commissioned for the American Society for Radiation Oncology (ASTRO) Board of Directors as part of ASTRO's Target Safely Campaign, focusing on the role of peer review as an important component of a broad safety/quality assurance (QA) program. Peer review is one of the most effective means for assuring the quality of qualitative, and potentially controversial, patient-specific decisions in radiation oncology. This report summarizes many of the areas throughout radiation therapy that may benefit from the application of peer review. Each radiation oncology facility should evaluate the issues raised and develop improved ways to apply the concept of peer review to its individual process and workflow. This might consist of a daily multidisciplinary (eg, physicians, dosimetrists, physicists, therapists) meeting to review patients being considered for, or undergoing planning for, radiation therapy (eg, intention to treat and target delineation), as well as meetings to review patients already under treatment (eg, adequacy of image guidance). This report is intended to clarify and broaden the understanding of radiation oncology professionals regarding the meaning, roles, benefits, and targets for peer review as a routine quality assurance tool. It is hoped that this work will be a catalyst for further investigation, development, and study of the efficacy of peer review techniques and how these efforts can help improve the safety and quality of our treatments. PMID:24175002

Peer Victimization among Schoolchildren: Correlations, Causes, Consequences, and Considerations in Assessment and Intervention

ERIC Educational Resources Information Center

Card, Noel A.; Hodges, Ernest V. E.

2008-01-01

Peer victimization among schoolchildren is a common problem that predicts serious maladjustment. In this article, the authors define peer victimization, provide a brief overview of the history of research on the topic, and review prevalence rates, common measurement approaches, and the correlates of peer victimization. This review leads to…

Making Teaching Community Property: A Menu for Peer Collaboration and Peer Review. AAHE Teaching Initiative.

ERIC Educational Resources Information Center

Hutchings, Pat

A collection of program descriptions and case studies in college faculty peer collaboration and peer review includes: "Setting a Scholarly Tone: Teaching Circles in the History Department at Kent State University"; "Fostering Collective Responsibility for Student Learning: Teaching Seminars in the University of North Carolina at Charlotte…

Research management peer exchange hosted by the Oregon Department of Transportation Research Group, August 20-24, 2001. Summary report.

DOT National Transportation Integrated Search

2001-05-01

The team began this peer exchange with a review of the first Oregon Peer Exchange conducted in may, 1998. The review included a summary of recommendations made and the changes made as a result of the 1998 Peer Exchange Report. : The primary focus of ...

Advice for a career in academic gastroenterology: from fellowship application through job selection and contract negotiations to research and promotion.

PubMed

Cappell, M S

2009-03-01

This study aims to describe a comprehensive strategy for success in academic gastroenterology by reporting common sense, but mostly previously unpublished, recommendations. The recommendation are based on expert opinion from personal experience mentoring 125 gastroenterology fellows and residents as a program director for nine years and from mentoring research while publishing more than 160 articles in peer-reviewed journals and editing 11 books during a 23-year academic career. Primary criteria for fellowship applicant selection include board scores, clinical performance, interview performance, clinical training, and research productivity. For optimal chances, select the subspecialty of gastroenterology early during residency, consult a mentor, and develop a well-planned strategy. Faculty advancement depends upon publications, grants, national recognition, interpersonal skills, and recommendations. Article categories from highest-to-lowest in prestige are original investigations, review articles, book chapters, case reports, and letters/abstracts. Articles are judged by the prestige of the journal of publication. Resubmit rejected articles to successively less prestigious journals until accepted for publication. Articles in journals without peer-review have negligible career impact. Grant support creates protected time. Institutional reputation is important in academics. Do not accept a job without a written contract. Have a lawyer review your contract. An outside offer strengthens a negotiating position. Be sociable and nonconfrontational at work. Network with colleagues. Seek a mentor. Meet your supervisor regularly for feedback. Never express anger at your boss or patients. Avoid litigation with employers. Sub-subspecialize to develop expertise in one area. Focus on this area in your research and clinical practice. In conclusion, a well-planned strategy can help you achieve a senior academic position early and efficiently.

Peering into peer review: Galileo, ESP, Dr Scott Reuben, and advancing our professional evolution.

PubMed

Biddle, Chuck

2011-10-01

The fundamental purpose of peer review is quality control that facilitates the introduction of information into our discipline; information that is essential to the care of patients who require anesthesia services. While the AANA Journal relies heavily on this process to maintain the overall quality of our scholarly literature, it may fail that objective under certain conditions. This editorial serves to inform readers of the nature and goals of the peer review process.

2017 Building Technologies Office Peer Review Report

DOE Office of Scientific and Technical Information (OSTI.GOV)

None, None

The 2017 Building Technologies Office Peer Review Report summarizes the feedback submitted by reviewers for the 109 Building Technologies Office (BTO) projects presented at the 2017 BTO Peer Review. The report presents an overview of the goals and activities under each technology program area, a summary of project scores for each program, and a brief analysis of general evaluation trends within each program area or its constituent subprograms.

What do we know about grant peer review in the health sciences?

PubMed

Guthrie, Susan; Ghiga, Ioana; Wooding, Steven

2017-01-01

 Peer review decisions award >95% of academic medical research funding, so it is crucial to understand how well they work and if they could be improved.  This paper summarises evidence from 105 relevant papers identified through a literature search on the effectiveness and burden of peer review for grant funding.  There is a remarkable paucity of evidence about the overall efficiency of peer review for funding allocation, given its centrality to the modern system of science. From the available evidence, we can identify some conclusions around the effectiveness and burden of peer review. The strongest evidence around effectiveness indicates a bias against innovative research. There is also fairly clear evidence that peer review is, at best, a weak predictor of future research performance, and that ratings vary considerably between reviewers. There is some evidence of age bias and cronyism. Good evidence shows that the burden of peer review is high and that around 75% of it falls on applicants. By contrast, many of the efforts to reduce burden are focused on funders and reviewers/panel members.  We suggest funders should acknowledge, assess and analyse the uncertainty around peer review, even using reviewers' uncertainty as an input to funding decisions. Funders could consider a lottery element in some parts of their funding allocation process, to reduce both burden and bias, and allow better evaluation of decision processes. Alternatively, the distribution of scores from different reviewers could be better utilised as a possible way to identify novel, innovative research. Above all, there is a need for open, transparent experimentation and evaluation of different ways to fund research. This also requires more openness across the wider scientific community to support such investigations, acknowledging the lack of evidence about the primacy of the current system and the impossibility of achieving perfection.

Peer Review: Structured, Informal, Confidential, Helpful!

ERIC Educational Resources Information Center

Cassidy, Alice; Lee, Jack

2011-01-01

This paper describes an introductory workshop, Preparing to be a Peer Reviewer, presented at the University of British Columbia (UBC) to give hands-on practice to faculty members and others in order to provide formative peer review upon request. This workshop, which was designed at the request of a faculty member, is complemented by an Advanced…

Preparing English Learners for Effective Peer Review in the Writers' Workshop

ERIC Educational Resources Information Center

Kim, Soo Hyon

2015-01-01

English Language Learners (ELLs) often face challenges when participating in peer review activities in writers' workshops. This article identifies some of the potential difficulties that ELL writers may experience, and provides teachers with strategies to address these problems. The author describes a simple three-step peer review training model…

Using Peer Review to Improve Student Writing in Business Courses

ERIC Educational Resources Information Center

Rieber, Lloyd J.

2006-01-01

Student peer review has proven an effective technique for improving student writing in both English and business communication classes, yet the technique is not widely used in business courses other than business communication. In this article, the author discusses using student peer review in business classes to improve students' final written…

Peer Review of Teaching: Best Practices for a Non-Programmatic Approach

ERIC Educational Resources Information Center

Alabi, Jaena; Weare, William H., Jr.

2014-01-01

Many academic librarians who provide library instruction have never received formal training in educational theory and methods. To bridge this gap and improve the teaching skills of instruction librarians, some academic libraries have established peer review of teaching programs. Despite the recognized benefits of peer review, it may not be…

The Great Fossil Fiasco: Teaching about Peer Review.

ERIC Educational Resources Information Center

Gift, Nancy; Krasny, Marianne

2003-01-01

Describes a lesson that engages middle school students in learning about peer review. Uses the article "Archaeoraptor Fossil Trail," which was published in the November, 1999 issue of "National Geographic" as an example of a real life story of how peer review forces scientists to critically re-examine a fossil discovery. (SOE)

Influence of Peer Effects on Learning Outcomes: A Review of the Literature.

ERIC Educational Resources Information Center

Wilkinson, Ian A. G.; Hattie, John A.; Parr, Judy M.; Townsend, Michael A. R.; Fung, Irene; Ussher, Charlotte; Thrupp, Martin; Lauder, Hugh; Robinson, Tony

This report presents a literature review and conceptual model summarizing the influence of peer effects on learning outcomes. The report describes the approach to the review and provides a theoretical account of the environments, mechanisms, and processes that mediate learning among peers. It then summarizes the literature on compositional effects…

77 FR 58802 - Notice of Intent To Seek OMB Approval To Collect Information: Forms Pertaining to the Peer Review...

Federal Register 2010, 2011, 2012, 2013, 2014

2012-09-24

... Collect Information: Forms Pertaining to the Peer Review of ARS Research Projects AGENCY: Agricultural Research Service (ARS), USDA. ACTION: Notice and request for comments. SUMMARY: The proposed information... allow the ARS to efficiently manage data associated with the peer review of agricultural research. All...

DOE Hydrogen Program: 2010 Annual Merit Review and Peer Evaluation Report

DOE Office of Scientific and Technical Information (OSTI.GOV)

Not Available

This document summarizes the comments provided by peer reviewers on hydrogen and fuel cell projects presented at the FY 2010 U.S. Department of Energy (DOE) Hydrogen Program and Vehicle Technologies Program Annual Merit Review and Peer Evaluation Meeting (AMR), held June 7-11, 2010 in Washington, D.C.

Peer Review of Report Modeling the Relationship Between Lead in Drinking Water and Blood Lead Levels in Children

EPA Science Inventory

EPA is peer reviewing the Agency’s report modeling the relationship between lead in drinking water and blood lead levels in children utilizing the Integrated Exposure Uptake Biokinetic (IEUBK) model. The report being peer reviewed may be used to inform the derivation of a concent...

Peer Review: The CHAMPUS Program.

ERIC Educational Resources Information Center

Stricker, George

This paper examines the use of the peer review system in evaluating out-patient clinical services for a third-party payer seeking justification for payment of services. Peer review is defined as a process by which one professional, in an official capacity, makes a judgment about a co-professional in a matter involving professional functioning. The…

Systematic review of peer education intervention programmes among individuals with type 2 diabetes.

PubMed

Gatlin, Tricia K; Serafica, Reimund; Johnson, Michael

2017-12-01

To systematically review published randomised controlled trials of peer education interventions among adults with type 2 diabetes. Systematic reviews have shown mixed results for peer support interventions to improve diabetes self-management. Given the effectiveness of diabetes education by healthcare professionals, peer education interventions may be a useful alternative approach. This review addressed that gap. Systematic review. A systematic search of published randomised controlled trials between 2006-2016 was conducted using the keywords diabetes, type 2 diabetes, randomised controlled trials, self-management, peer education and peer support. The methodological quality of each study was assessed using the Jadad scale. Seven studies were included in the final review, and the Jadad scores ranged from 8-10 of a possible 13 points. There was no consistent design, setting, or outcome measurement among the studies. There were two types of peer education interventions compared to traditional diabetes education: face-to-face or a combination of face-to-face and telephone/texting. The most common clinical outcome measure was HbA1c. Two of six studies showed statistically significant improvement in HbA1c between intervention and control groups. An increase in diabetes knowledge was also statistically significant in two of five studies. Peer education could be successful in improving clinical outcomes. No evidence was found indicating that healthcare provider education was superior in regard to clinical knowledge or behavioural or psychological outcome measures than peer education. HbA1c was statistically significantly lower in some peer education groups compared to control groups. There is evidence that peer education can be useful in achieving positive clinical outcomes such as decreasing HbA1c levels and increasing diabetes knowledge. A certified diabetes educator or a trained healthcare professional should not be overlooked though when using peer educators. © 2017 John Wiley & Sons Ltd.

Peer review of human studies run amok: a break in the fiduciary relation between scientists and the public.

PubMed

Feldstein Ewing, Sarah W; Saitz, Richard

2015-02-01

Peer review aims to ensure the quality and credibility of research reporting. Conducted by volunteer scientists who receive no guidance or direction, peer review widely varies from fast and facilitative, to unclear and obstructive. Poor quality is an issue because most science research is publicly funded, whereby scientists must make an effort to quickly disseminate their findings back to the public. An unfortunately not uncommon barrier in this process is ineffective peer review. Most scientists agree that when done well, editors and reviewers drive and maintain the high standards of science. At the same time, ineffective peer review can cause great delay with no introduced improvement in final product. These delays and requests interfere with the path of communication between scientist and public, at a great cost to editors, reviewers, authors and those who stand to benefit from application of the results of the studies. We offer a series of concrete recommendations to improve this process.

IRIS Toxicological Review of Inorganic Arsenic (Cancer) ...

EPA Pesticide Factsheets

On February 19, 2010, the draft IRIS Toxicological Review of Inorganic Arsenic (Cancer) external review draft document and the charge to external peer reviewers were released for public review and comment. The draft document and the charge to external peer reviewers were reviewed internally by EPA and by other federal agencies and White House Offices before public release. In the new IRIS process, introduced by the EPA Administrator, all written comments on IRIS assessments submitted by other federal agencies and White House Offices will be made publicly available. Accordingly, interagency comments and the interagency science consultation draft of the Toxicological Review of Inorganic Arsenic and the charge to external peer reviewers are posted on this site. This draft IRIS health assessment addresses only cancer human health effects that may result from chronic exposure to this chemical. An assessment of noncancer health effects of inorganic arsenic will be released for external peer review and public comment at a later date.

Bibliometric analysis of poison center-related research published in peer-review journals.

PubMed

Forrester, M B

2016-07-01

Poison centers advance knowledge in the field of toxicology through publication in peer-review journals. This investigation describes the pattern of poison center-related publications. Cases were poison center-related research published in peer-review journals during 1995-2014. These were identified through searching the PubMed database, reviewing the tables of contents of selected toxicology journals, and reviewing abstracts of various national and international meetings. The following variables for each publication were identified: year of publication, journal, type of publication (meeting abstract vs. other, i.e. full article or letter to the editor), and the country(ies) of the poison center(s) included in the research. Of the 3147 total publications, 62.1% were meeting abstracts. There were 263 publications in 1995-1999, 536 in 2000-2004, 999 in 2005-2009, and 1349 in 2010-2014. The publications were in 234 different journals. The journals in which the highest number of research was published were Clinical Toxicology (69.7%), Journal of Medical Toxicology (2.2%), and Veterinary and Human Toxicology (2.1%). The research was reported from 62 different countries. The countries with the highest number of publications were the United States (67.9%), United Kingdom (6.5%), Germany (3.9%), France (2.5%), and Italy (2.4%). The number of publications increased greatly over the 20 years. Although the publications were in a large number of journals, a high proportion of the publications were in one journal. While the research came from a large number of countries, the preponderance came from the United States. © The Author(s) 2015.

Impact of peer review on reports of randomised trials published in open peer review journals: retrospective before and after study

PubMed Central

Collins, Gary S; Boutron, Isabelle; Yu, Ly-Mee; Cook, Jonathan; Shanyinde, Milensu; Wharton, Rose; Shamseer, Larissa; Altman, Douglas G

2014-01-01

Objective To investigate the effectiveness of open peer review as a mechanism to improve the reporting of randomised trials published in biomedical journals. Design Retrospective before and after study. Setting BioMed Central series medical journals. Sample 93 primary reports of randomised trials published in BMC-series medical journals in 2012. Main outcome measures Changes to the reporting of methodological aspects of randomised trials in manuscripts after peer review, based on the CONSORT checklist, corresponding peer reviewer reports, the type of changes requested, and the extent to which authors adhered to these requests. Results Of the 93 trial reports, 38% (n=35) did not describe the method of random sequence generation, 54% (n=50) concealment of allocation sequence, 50% (n=46) whether the study was blinded, 34% (n=32) the sample size calculation, 35% (n=33) specification of primary and secondary outcomes, 55% (n=51) results for the primary outcome, and 90% (n=84) details of the trial protocol. The number of changes between manuscript versions was relatively small; most involved adding new information or altering existing information. Most changes requested by peer reviewers had a positive impact on the reporting of the final manuscript—for example, adding or clarifying randomisation and blinding (n=27), sample size (n=15), primary and secondary outcomes (n=16), results for primary or secondary outcomes (n=14), and toning down conclusions to reflect the results (n=27). Some changes requested by peer reviewers, however, had a negative impact, such as adding additional unplanned analyses (n=15). Conclusion Peer reviewers fail to detect important deficiencies in reporting of the methods and results of randomised trials. The number of these changes requested by peer reviewers was relatively small. Although most had a positive impact, some were inappropriate and could have a negative impact on reporting in the final publication. PMID:24986891

A Multiple Case Study of a Baldrige-Based Peer Review Process in an Urban School District

ERIC Educational Resources Information Center

Ray, Janet L.

2012-01-01

Distinct purposes were identified for this phenomenological multiple-case study. The first purpose of the study was to determine in what ways the BbPRP influenced (a) leadership, (b) strategic planning, and (c) process management among the five selected schools within AISD. The second purpose of this study was to examine administrators'…

Global Ground Motion Prediction Equations Program | Just another WordPress

Science.gov Websites

Motion Task 2: Compile and Critically Review GMPEs Task 3: Select or Derive a Global Set of GMPEs Task 6 : Design the Specifications to Compile a Global Database of Soil Classification Task 5: Build a Database of Update on PEER's Global GMPEs Project from recent workshop in Turkey Posted on June 11, 2012 During May

Rein and Zheng Elected to American Academy of Microbiology | Poster

Cancer.gov

By Nancy Parrish, Staff Writer Earlier this year, Alan Rein, Ph.D., and Zhi-Ming (Thomas) Zheng, M.D., Ph.D., were elected to fellowship in the American Academy of Microbiology, the honorific leadership group within the American Society for Microbiology (ASM). They were among 88 microbiologists who were elected to the academy “through a highly selective, peer-review process,

Mitigation of Disagreement in Peer Review among L2 Learners and Native Speakers in a College Writing Class (Mitigación del Impacto de las Opiniones de Desacuerdo en el Proceso de Revisión por Pares entre Estudiantes de una Segunda Lengua y Hablantes Nativos en una Clase de Escritura a Nivel Universitario)

ERIC Educational Resources Information Center

Christoffersen, Katherine O'Donnell

2015-01-01

Peer review is now a commonplace practice in process-oriented writing instruction. A crucial aspect of peer review is assessing another classmate's work, which encompasses the act of disagreement. Given its prevalence in the classroom, it is necessary to analyze how L2 learners mitigate disagreement in the context of peer review with other L2…

New service of Earth Interactions offers sneak peek at work in progress

NASA Astrophysics Data System (ADS)

A new service of the all-electronic journal Earth Interactions (Web site http://EarthInter-actions.org) now provides online access to abstracts or preprints of selected papers being presented at various Earth system science conferences. The new service, “Earth Abstractions,” is separate from the peer-reviewed articles in Earth Interactions. The editors select the sessions that will be featured. AGU Spring Meeting abstracts are now highlighted on the site.The abstract titles in Earth Abstractions will link directly to online extended abstracts or preprints located on the authors' home servers if such abstracts are made available. As the author updates the preprint and posts it to the same URL, Earth Abstractions will continue to feature the most recent information from the author related to that work. Readers can preview an author's work as it evolves prior to the meeting as well as refer to it for a year after the meeting has ended. This exchange also provides a means for authors to receive positive feedback on their papers independent of the conference session, which may help those who plan to submit papers about their work to a peer-reviewed journal.

The test chemical selection procedure of the European Centre for the Validation of Alternative Methods for the EU Project ReProTect.

PubMed

Pazos, Patricia; Pellizzer, Cristian; Stummann, Tina C; Hareng, Lars; Bremer, Susanne

2010-08-01

The selection of reference compounds is crucial for a successful in vitro test development in order to proof the relevance of the test system. This publication describes the criteria and the selection strategy leading to a list of more than 130 chemicals suitable for test development within the ReProTect project. The presented chemical inventory aimed to support the development and optimization of in vitro tests that seek to fulfill ECVAM's criteria for entering into the prevalidation. In order to select appropriate substances, a primary database was established compiling information from existing databases. In a second step, predefined selection criteria have been applied to obtain a comprehensive list ready to undergo a peer review process from independent experts with industrial, academic and regulatory background. Finally, a peer reviewed chemical list containing 13 substances challenging endocrine disrupter tests, additional 50 substances serving as reference chemicals for various tests evaluating effects on male and female fertility, and finally 61 substances were identified as known to provoke effects on the early development of mammalian offspring. The final list aims to cover relevant and specific mode/site of actions as they are known to be relevant for various substance classes. However, the recommended list should not be interpreted as a list of reproductive toxicants, because such a description requires proven associations with adverse effects of mammalian reproduction, which are subject of regulatory decisions done by involved competent authorities. Copyright 2010 Elsevier Inc. All rights reserved.

Peer Acceptance and Friendship in Early Childhood: The Conceptual Distinctions between Them

ERIC Educational Resources Information Center

Beazidou, Eleftheria; Botsoglou, Kafenia

2016-01-01

This paper reviews previous literature about peer acceptance and friendship, two of the most critical aspects of peer relations that have received most of research attention during the past years. In this review, we will focus on the processes explaining the way children use the ability to socialise with peers; explore the hypothesis that certain…

Peer Response to L2 Student Writing: Patterns and Expectations

ERIC Educational Resources Information Center

Abdalla Salih, Abdel Rahman

2013-01-01

This paper reports the corrective feedback patterns in L2 writing and the student writers' preferences for peer feedback. The study examines the actual focus of peer review and the types of corrective feedback provided in L2 composing process. Sixteen L2 matriculation students at a Malaysian university took part in five peer review sessions,…

Iterative Design and Classroom Evaluation of Automated Formative Feedback for Improving Peer Feedback Localization

ERIC Educational Resources Information Center

Nguyen, Huy; Xiong, Wenting; Litman, Diane

2017-01-01

A peer-review system that automatically evaluates and provides formative feedback on free-text feedback comments of students was iteratively designed and evaluated in college and high-school classrooms. Classroom assignments required students to write paper drafts and submit them to a peer-review system. When student peers later submitted feedback…

Peer Review from the Students' Perspective: Invaluable or Invalid?

ERIC Educational Resources Information Center

Brammer, Charlotte; Rees, Mary

2007-01-01

Only a few instances of empirical research examine what the students themselves think of their participation in peer review. Perhaps because peer response is practically instinctive to those who teach writing, few have felt the need to study the student perspective. Instead, studies have focused on the quality of peer comments, their effect on the…

Peer Mentoring and Peer Tutoring among K-12 Students: A Literature Review

ERIC Educational Resources Information Center

Goodrich, Andrew

2018-01-01

The purpose of this literature review is to examine research on peer mentoring among K-12 students to assist practitioners with how to incorporate these instructional techniques into their own music programs. Primary themes across the music education literature of peer mentoring include the role of music teachers, the role of students as they…

Unmanned Maritime Systems Incremental Acquisition Approach

DTIC Science & Technology

2016-12-01

We find that current UMS acquisitions are utilizing previous acquisition reforms, but could benefit from additional contractor peer competition and...peer review. Additional cost and schedule benefits could result from contractor competition during build processes in each incremental process. We...acquisitions are utilizing previous acquisition reforms, but could benefit from additional contractor peer competition and peer review. Additional

What do we know about grant peer review in the health sciences?

PubMed Central

Guthrie, Susan; Ghiga, Ioana; Wooding, Steven

2018-01-01

Background: Peer review decisions award an estimated >95% of academic medical research funding, so it is crucial to understand how well they work and if they could be improved. Methods: This paper summarises evidence from 105 papers identified through a literature search on the effectiveness and burden of peer review for grant funding. Results: There is a remarkable paucity of evidence about the efficiency of peer review for funding allocation, given its centrality to the modern system of science. From the available evidence, we can identify some conclusions around the effectiveness and burden of peer review. The strongest evidence around effectiveness indicates a bias against innovative research. There is also fairly clear evidence that peer review is, at best, a weak predictor of future research performance, and that ratings vary considerably between reviewers. There is some evidence of age bias and cronyism. Good evidence shows that the burden of peer review is high and that around 75% of it falls on applicants. By contrast, many of the efforts to reduce burden are focused on funders and reviewers/panel members. Conclusions: We suggest funders should acknowledge, assess and analyse the uncertainty around peer review, even using reviewers’ uncertainty as an input to funding decisions. Funders could consider a lottery element in some parts of their funding allocation process, to reduce both burden and bias, and allow better evaluation of decision processes. Alternatively, the distribution of scores from different reviewers could be better utilised as a possible way to identify novel, innovative research. Above all, there is a need for open, transparent experimentation and evaluation of different ways to fund research. This also requires more openness across the wider scientific community to support such investigations, acknowledging the lack of evidence about the primacy of the current system and the impossibility of achieving perfection. PMID:29707193

IRIS Toxicological Review of Inorganic Arsenic (Cancer) (Interagency Science Consultation Draft)

EPA Science Inventory

On February 19, 2010, the draft IRIS Toxicological Review of Inorganic Arsenic (Cancer) external review draft document and the charge to external peer reviewers were released for public review and comment. The draft document and the charge to external peer reviewers were reviewed...

Does Peer Review of Radiation Plans Affect Clinical Care? A Systematic Review of the Literature

DOE Office of Scientific and Technical Information (OSTI.GOV)

Brunskill, Kelsey; Nguyen, Timothy K.; Boldt, R. Gabriel

Purpose: Peer review is a recommended component of quality assurance in radiation oncology; however, it is resource-intensive and its effect on patient care is not well understood. We conducted a systematic review of the published data to assess the reported clinical impact of peer review on radiation treatment plans. Methods and Materials: A systematic review of published English studies was performed in accordance with the PRISMA guidelines using the MEDLINE and EMBASE databases and abstracts published from major radiation oncology scientific meeting proceedings. For inclusion, the studies were required to report the effect of peer review on ≥1 element ofmore » treatment planning (eg, target volume or organ-at-risk delineation, dose prescription or dosimetry). Results: The initial search strategy identified 882 potentially eligible studies, with 11 meeting the inclusion criteria for full-text review and final analysis. Across a total of 11,491 patient cases, peer review programs led to modifications in a weighted mean of 10.8% of radiation treatment plans. Five studies differentiated between major and minor changes and reported weighted mean rates of change of 1.8% and 7.3%, respectively. The most common changes were related to target volume delineation (45.2% of changed plans), dose prescription or written directives (24.4%), and non-target volume delineation or normal tissue sparing (7.5%). Conclusions: Our findings suggest that peer review leads to changes in clinical care in approximately 1 of every 9 cases overall. This is similar to the reported rates of change in peer review studies from other oncology-related specialties, such as radiology and pathology.« less

Does Peer Review of Radiation Plans Affect Clinical Care? A Systematic Review of the Literature.

PubMed

Brunskill, Kelsey; Nguyen, Timothy K; Boldt, R Gabriel; Louie, Alexander V; Warner, Andrew; Marks, Lawrence B; Palma, David A

2017-01-01

Peer review is a recommended component of quality assurance in radiation oncology; however, it is resource-intensive and its effect on patient care is not well understood. We conducted a systematic review of the published data to assess the reported clinical impact of peer review on radiation treatment plans. A systematic review of published English studies was performed in accordance with the PRISMA guidelines using the MEDLINE and EMBASE databases and abstracts published from major radiation oncology scientific meeting proceedings. For inclusion, the studies were required to report the effect of peer review on ≥1 element of treatment planning (eg, target volume or organ-at-risk delineation, dose prescription or dosimetry). The initial search strategy identified 882 potentially eligible studies, with 11 meeting the inclusion criteria for full-text review and final analysis. Across a total of 11,491 patient cases, peer review programs led to modifications in a weighted mean of 10.8% of radiation treatment plans. Five studies differentiated between major and minor changes and reported weighted mean rates of change of 1.8% and 7.3%, respectively. The most common changes were related to target volume delineation (45.2% of changed plans), dose prescription or written directives (24.4%), and non-target volume delineation or normal tissue sparing (7.5%). Our findings suggest that peer review leads to changes in clinical care in approximately 1 of every 9 cases overall. This is similar to the reported rates of change in peer review studies from other oncology-related specialties, such as radiology and pathology. Copyright © 2016 Elsevier Inc. All rights reserved.

Challenges in the Ethical Review of Peer Support Interventions

PubMed Central

Simmons, David; Bunn, Christopher; Nakwagala, Fred; Safford, Monika M.; Ayala, Guadalupe X.; Riddell, Michaela; Graffy, Jonathan; Fisher, Edwin B.

2015-01-01

PURPOSE Ethical review processes have become increasingly complex. We have examined how 8 collaborating diabetes peer-support clinical trials were assessed by ethics committees. METHODS The ethical reviews from the 8 peer-support studies were collated and subjected to a thematic analysis. We mapped the recommendations of local Institutional Review Boards and ethics committees onto the “4+1 ethical framework” (autonomy, beneficence, non-maleficence, and justice, along with concern for their scope of application). RESULTS Ethics committees did not consistently focus on tasks within the 4+1 framework: many conducted reviews of scientific, organizational, and administrative activities. Of the 20 themes identified across the ethical reviews, only 4 fell within the scope of the 4+1 framework. Variation in processes and requirements for ethics committees were particularly evident between study countries. Some of the consent processes mandated by ethical review boards were disproportionate for peer support, increased participant burden, and reduced the practicality of testing an ethical intervention. Across the 8 studies, ethics committees’ reviews included the required elements to ensure participant safety; however, they created a range of hurdles that in some cases delayed the research and required consent processes that could hinder the spontaneity and/or empathy of peer support. CONCLUSION Ethics committees should avoid repeating the work of other trusted agencies and consider the ethical validity of “light touch” consent procedures for peer-support interventions. The investigators propose an ethical framework for research on peer support. PMID:26304976

Turnitin and Peer Review in ESL Academic Writing Classrooms

ERIC Educational Resources Information Center

Li, Jinrong; Li, Mimi

2018-01-01

Despite the benefits of peer review, there are still challenges that need to be addressed to make it more effective for L2 students. With the development of technology, computer-mediated peer review has captured increasing attention from L2 writing researchers and instructors. While Turnitin is known for its use in detecting plagiarism, its newly…

Working in Triads: A Case Study of a Peer Review Process

ERIC Educational Resources Information Center

Grainger, Peter; Bridgstock, Martin; Houston, Todd; Drew, Steve

2015-01-01

Peer review of teaching has become an accepted educational procedure in Australia to quality assure the quality of teaching practices. The institutional implementation of the peer review process can be viewed as genuine desire to improve teaching quality or an imposition from above as a measure of accountability and performativity. One approach is…

Peer-to-Peer Teaching in Higher Education: A Critical Literature Review

ERIC Educational Resources Information Center

Stigmar, Martin

2016-01-01

The aim of my critical literature review is to identify studies where students are engaged as partners in teaching in higher education and to analyze how tutors and tutees benefit from peer teaching. Thirty studies were included for review. Thirteen countries are represented and two thirds of the studies conducted in the United States of America…

Independent Research Projects in General Chemistry Classes as an Introduction to Peer-Reviewed Literature

ERIC Educational Resources Information Center

Tribe, Lorena; Cooper, Evan L.

2008-01-01

A well-structured independent literature research project with a poster session was used to introduce students to peer-reviewed literature in a general chemistry course. Overall, students reported an enhanced appreciation of the course due to performing research at some level, using peer-reviewed literature, and presenting their results in a…

U.S. Department of Energy Hydrogen and Fuel Cells Program 2011 Annual Merit Review and Peer Evaluation Report

DOE Office of Scientific and Technical Information (OSTI.GOV)

Satypal, S.

2011-09-01

This document summarizes the comments provided by peer reviewers on hydrogen and fuel cell projects presented at the FY 2011 U.S. Department of Energy (DOE) Hydrogen Program and Vehicle Technologies Program Annual Merit Review and Peer Evaluation Meeting (AMR), held May 9-13, 2011 in Arlington, Virginia

Bound by Tradition? Peer Review and New Scholarship: An Institutional Case Study

ERIC Educational Resources Information Center

White, Barbara Jo; Cruz, Laura; Ellern, Jill; Ford, George; Moss, Hollye

2012-01-01

Peer review is by no means a routine process for traditional, or basic, research. Even so, peer review is even less routinized for other forms of scholarship. In 1990, Ernest Boyer called for a reconsideration of scholarship and extended the definition to be inclusive of non-traditional modes of scholarly production and delivery. However, peer…

Peer Review Improves the Quality of MCQ Examinations

ERIC Educational Resources Information Center

Malau-Aduli, Bunmi S.; Zimitat, Craig

2012-01-01

The aim of this study was to assess the effect of the introduction of peer review processes on the quality of multiple-choice examinations in the first three years of an Australian medical course. The impact of the peer review process and overall quality assurance (QA) processes were evaluated by comparing the examination data generated in earlier…

Academic Excellence: A Commentary and Reflections on the Inherent Value of Peer Review

ERIC Educational Resources Information Center

Roberts, Thomas J.; Shambrook, Jennifer

2012-01-01

Academic peer review is widely viewed as fair, equitable, and essential to academic quality. Successfully completing the process through publication or award is widely deemed as one of the most rigorous and prestigious forms of scholarly accomplishment. Despite this sentiment the academic peer review process is not without fault. It is criticized…

Doing Peer Review and Receiving Feedback: Impact on Scientific Literacy and Writing Skills

ERIC Educational Resources Information Center

Geithner, Christina A.; Pollastro, Alexandria N.

2016-01-01

Doing peer review has been effectively implemented to help students develop critical reading and writing skills; however, its application in Human Physiology programs is limited. The purpose of the present study was to determine the impact of peer review on Human Physiology majors' perceptions of their scientific literacy and writing skills.…

Student Peer Review: Enhancing Formative Feedback with a Rebuttal

ERIC Educational Resources Information Center

Harland, Tony; Wald, Navé; Randhawa, Haseeb

2017-01-01

This study examines the use of peer review in an undergraduate ecology programme, in which students write a research proposal as a grant application, prior to carrying out the research project. Using a theoretical feedback model, we compared teacher and student peer reviews in a double blind exercise, and show how students responded to feedback…

A Review of Peer-Mediated Social Interaction Interventions for Students with Autism in Inclusive Settings

ERIC Educational Resources Information Center

Watkins, Laci; O'Reilly, Mark; Kuhn, Michelle; Gevarter, Cindy; Lancioni, Giulio E.; Sigafoos, Jeff; Lang, Russell

2015-01-01

This review addresses the use of peer-mediated interventions (PMI) to improve the social interaction skills of students with autism spectrum disorder (ASD) in inclusive settings. The purpose of this review is to (a) identify the characteristics and components of peer-mediated social interaction interventions, (b) evaluate the effectiveness of PMI…

Social Workers' Attitudes toward Peer-Reviewed Literature: The Evidence Base

ERIC Educational Resources Information Center

Knight, Carolyn

2013-01-01

Social workers from one state chapter of the National Association of Social Workers were surveyed to assess their use of and attitudes toward the peer-reviewed literature and their engagement in evidence-based practice. Results reveal that, in general, the practitioners in this study did not read the peer-reviewed literature, particularly articles…

Potential Benefits of Incorporating Peer-to-Peer Interactions Into Digital Interventions for Psychotic Disorders: A Systematic Review.

PubMed

Biagianti, Bruno; Quraishi, Sophia H; Schlosser, Danielle A

2018-04-01

Peer-to-peer interactions and support groups mitigate experiences of social isolation and loneliness often reported by individuals with psychotic disorders. Online peer-to-peer communication can promote broader use of this form of social support. Peer-to-peer interactions occur naturally on social media platforms, but they can negatively affect mental health. Recent digital interventions for persons with psychotic disorders have harnessed the principles of social media to incorporate peer-to-peer communication. This review examined the feasibility, acceptability, and preliminary efficacy of recent digital interventions in order to identify strategies to maximize benefits of online peer-to-peer communication for persons with psychotic disorders. An electronic database search of PubMed, EMBASE, PsycINFO, Ovid MEDLINE, Cochrane Central Register of Controlled Trials, and Health Technology Assessment Database was conducted in February 2017 and yielded a total of 1,015 results. Eight publications that reported data from six independent trials and five interventions were reviewed. The technology supporting peer-to-peer communication varied greatly across studies, from online forums to embedded social networking. When peer-to-peer interactions were moderated by facilitators, retention, engagement, acceptability, and efficacy were higher than for interventions with no facilitators. Individuals with psychotic disorders were actively engaged with moderated peer-to-peer communication and showed improvements in perceived social support. Studies involving service users in intervention design showed higher rates of acceptability. Individuals with psychotic disorders value and benefit from digital interventions that include moderated peer-to-peer interactions. Incorporating peer-to-peer communication into digital interventions for this population may increase compliance with other evidence-based therapies by producing more acceptable and engaging online environments.

Testing the Rebound Peer Review Concept

PubMed Central

Choi, Augustine M.K.

2013-01-01

Abstract This invited editorial addresses the rescue of the article by Skrzypek et al. “Interplay between heme oxygenase-1 and miR-378 affects non-small cell lung carcinoma growth, vascularization, and metastasis.” The work was rejected by the standard peer review system and subsequently rescued by the Rebound Peer Review (RPR) mechanism offered by Antioxidants and Redox Signaling (Antioxid Redox Signal 16: 293–296, 2012). The reviewers who openly rescued the article were James F. George, Justin C. Mason, Mahin D. Maines, and Yasufumi Sato. The initial article was a de novo resubmission of a previously rejected article, which was then reviewed by six reviewers. The reviewers raised substantial scientific concerns, including questions pertaining to the specificity of the findings, quality of the presentation, and other technical concerns; the editor returned a decision of reject. The authors voluntarily chose to exercise the option to rescue the article utilizing the RPR system, where the authors found qualified reviewers who were willing to advocate for acceptance with scientific reasoning. The open reviewers felt that the scientific and technical concerns raised by the reviewers were outweighed by the strengths and novelty of the findings to justify acceptance. The RPR, in this case, was a “success” in that it rescued a rejected article. Despite this assessment, we question the necessity of open peer review as a means to overturn a peer review decision, with concerns for the larger-than-usual peer review process, and the voluntary relinquishing of editorial privilege and disclosure of reviewer identity. Antioxid. Redox Signal. 19, 639–643. PMID:23725371

Editors’ Perspectives on Enhancing Manuscript Quality and Editorial Decisions Through Peer Review and Reviewer Development

PubMed Central

Janke, Kristin K.; Traynor, Andrew P.

2017-01-01

Objectives. To identify peer reviewer and peer review characteristics that enhance manuscript quality and editorial decisions, and to identify valuable elements of peer reviewer training programs. Methods. A three-school, 15-year review of pharmacy practice and pharmacy administration faculty’s publications was conducted to identify high-publication volume journals for inclusion. Editors-in-chief identified all editors managing manuscripts for participation. A three-round modified Delphi process was used. Rounds advanced from open-ended questions regarding actions and attributes of good reviewers to consensus-seeking and clarifying questions related to quality, importance, value, and priority. Results. Nineteen editors representing eight pharmacy journals participated. Three characteristics of reviews were rated required or helpful in enhancing manuscript quality by all respondents: includes a critical analysis of the manuscript (88% required, 12% helpful), includes feedback that contains both strengths and areas of improvement (53% required, 47% helpful), and speaks to the manuscript’s utility in the literature (41% required, 59% helpful). Hands-on experience with review activities (88%) and exposure to good and bad reviews (88%) were identified as very valuable to peer reviewer development. Conclusion. Reviewers, individuals involved in faculty development, and journals should work to assist new reviewers in defining focused areas of expertise, building knowledge in these areas, and developing critical analysis skills. PMID:28630514

Impartial judgment by the "gatekeepers" of science: fallibility and accountability in the peer review process.

PubMed

Hojat, Mohammadreza; Gonnella, Joseph S; Caelleigh, Addeane S

2003-01-01

High publication demands and the low acceptance rate of peer review journals place the journal editors and their reviewers in a powerful position. Journal reviewers have a vital role not only in influencing the journal editor's publication decisions, but also in the very nature and direction of scientific research. Because of their influence in peer review outcomes, journal reviewers are aptly described as the "gatekeepers of science." In this article we describe several pitfalls that can impede reviewers' impartial judgement. These include such issues as confirmatory bias, the negative results bias (the file drawer problem), the Matthew effect, the Doctor Fox effect, and gender, race, theoretical orientation, and "political correctness." We argue that procedures currently used by many professional journals, such as blind or masked review, may not completely alleviate the effects of these pitfalls. Instead, we suggest that increasing reviewers' awareness of the pitfalls, accountability, and vigilance can improve fairness in the peer review process. The ultimate responsibilities belong to the journal editors who are confronted with the difficult task of satisfying journal readers, contributors, reviewers, and owners. We recommend that the journal editors conduct periodic internal and external evaluations of their journals' peer review process and outcomes, with participation of reviewers, contributors, readers and owners.

A randomized trial of peer review: the UK National Chronic Obstructive Pulmonary Disease Resources and Outcomes Project: three-year evaluation.

PubMed

Roberts, Christopher M; Stone, Robert A; Buckingham, Rhona J; Pursey, Nancy A; Lowe, Derek; Potter, Jonathan M

2012-06-01

Peer review has been widely used within the National Health Service to facilitate health quality improvement but evaluation has been limited particularly over the longer-term. Change within the National Health Service (NHS) can take a prolonged period--1-2 years--to occur. We report here a 3-year evaluation of the largest randomized trial of peer review ever conducted in the UK. To evaluate whether targeted mutual peer review of respiratory units brings about improvements in services for chronic obstructive pulmonary disease (COPD) over 3 years. The peer review intervention was a reciprocal supportive exercise that included clinicians, hospital management, commissioners and patients, which focused on the quality of the provision of four specific evidence-based aspects of COPD care. Follow-up at 36 months demonstrated limited significant quantitative differences in the quality of services offered in the two groups but a strong trend in favour of intervention sites. Qualitative data suggested many benefits of peer review in most but not all intervention units and some control teams. The data identify factors that promote and obstruct change. The findings demonstrate significant change in service provision over 3 years in both control and intervention sites with great variability in both groups. The combined quantitative and qualitative findings indicate that targeted mutual peer review is associated with improved quality of care, improvements in service delivery and with changes within departments that promote and are precursors to quality improvement. The generic findings of this study have potential implications for the application of peer review throughout the NHS. © 2011 Blackwell Publishing Ltd.

Peer-based health interventions for people with serious mental illness: A systematic literature review.

PubMed

Cabassa, Leopoldo J; Camacho, David; Vélez-Grau, Carolina M; Stefancic, Ana

2017-01-01

Health interventions delivered by peer specialists or co-facilitated by peer specialists and health professionals can help improve the physical health of people with serious mental illness (SMI). Yet, the quality of the studies examining these health interventions and their impact on health outcomes remains unclear. To address this gap, we conducted a systematic literature review of peer-based health interventions for people with SMI. We rated the methodological quality of studies, summarized intervention strategies and health outcomes, and evaluated the inclusion of racial and ethnic minorities in these studies. We used the Preferred Reporting Items for Systematic Review and Meta-Analysis guidelines to conduct our systematic literature review. Electronic bibliographic databases and manual searches were used to locate articles that were published in English in peer-reviewed journals between 1990 and 2015, described peer-based health interventions for people with SMI, and evaluated the impact of the interventions on physical health outcomes. Two independent reviewers used a standardized instrument to rate studies' methodological quality, abstracted study characteristics, and evaluated the effects of the interventions on different health outcomes. Eighteen articles were reviewed. Findings indicated that the strength of the evidence generated from these studies is limited due to several methodological limitations. Mixed and limited intervention effects were reported for most health outcomes. The most promising interventions were self-management and peer-navigator interventions. Efforts to strengthen the evidence of peer-based interventions require a research agenda that focuses on establishing the efficacy and effectiveness of these interventions across different populations and settings. Copyright © 2016 Elsevier Ltd. All rights reserved.

IRIS Toxicological Review of Trimethylbenzenes (Interagency Science Consultation Draft)

EPA Science Inventory

On June 26, 2012, the draft Toxicological Review of Trimethylbenzenes and the draft charge to external peer reviewers were released for external peer review and public comment. The Toxicological Review and charge were reviewed internally by EPA and by other federal agencies and W...